Ilya Sutzkever in 2023: "The data situation is still quite good, there is still lots to go." Ilya Sutzkever in 2024: "We've achieved Peak Data, and there will be no more. We have to deal with the data we have." I wrote about the end of the pretraining era. www.understandingai.org/p/its-the-en...

10 likes 0 replies