During Sam Altman and Ilya Sutskever's recent trip to Israel, folks didn't beat around the bush. First question: spicy open source vs closed source debate 🔥 Followed immediately by: "Can you tell us more about the base model before you lobotomized it?" 🤣
@bilawalsidhu And yet... there is a secret sauce; Ilya is over-confident that open source will never find it. Israelis don't mince words when it comes to getting to the point👍 Here's the full recording of this outstanding Q&A: youtu.be/mC-0XqTAeMQ
ngl this question really stuck with me after I watched the talk for starters, I love the directness of all of the questions from the talk in Tel Aviv (similar vibes in India Q&A) but more importantly, the term lobotomy gives a deeply personal connotation to GPT-4 it made me think a lot about the process of creating an intelligent neural network and then arbitrarily re-educating it in a way that adheres to current social norms in a lot of ways, I think the word lobotomize accurately describes the RLHF process