This unforgiving retrospective analysis on the anniversary of Galactica release, by its first author, @rosstaylor90, sets a high bar for researchers - it underscores the importance of releasing work for feedback and continual improvement, even if it is a work in progress. Interestingly, the initial almost vitriolic criticism of Galactica for its creative responses is now largely accepted, viewed as either an opportunity or a limitation depending on the use case. More significantly, the limitations of base LLMs, like Galactica, are now universally acknowledged, with their tendency towards hallucination recognized as a fundamental reality. Galactica was, in essence, just a base model. Here is a link to Ross Taylor's contribution to open source ( incidentally this app is created in part from the data @paperswithcode publishes - a startup he cofounded ) authorswithcode.org/researchers/?a…
This unforgiving retrospective analysis on the anniversary of Galactica release, by its first author, @rosstaylor90, sets a high bar for researchers - it underscores the importance of releasing work for feedback and continual improvement, even if it is a work in progress. Interestingly, the initial almost vitriolic criticism of Galactica for its creative responses is now largely accepted, viewed as either an opportunity or a limitation depending on the use case. More significantly, the limitations of base LLMs, like Galactica, are now universally acknowledged, with their tendency towards hallucination recognized as a fundamental reality. Galactica was, in essence, just a base model. Here is a link to Ross Taylor's contribution to open source ( incidentally this app is created in part from the data @paperswithcode publishes - a startup he cofounded ) authorswithcode.org/researchers/?a…