James Michaelov @ ACL 🌴

@jamichaelov.bsky.social

4297 Followers 536 Following

Postdoc at MIT. Research: language, the brain, NLP. jmichaelov.com

Graph showing the performance at 12 tasks of the Pythia suite of models at various stages during training. Five tasks (TruthfulQA-MC1, TruthfulQA-MC2, Hindsight Neglect, Memo Trap, and Pattern Match Suppression) show clear evidence of inverse scaling, and three others (Redefine, Repetitive Algebra, and Resisting Correction) show inverse scaling for the largest model.