👟Jim “🈶️” Liu👟 @ founder mode @itsj.im · Nov 18 (While PyTorch is not a prerequisite, the book did come with Appendix A to help you learn PyTorch, and if you have no idea what PyTorch is, you should work through Appendix A to get an understanding)
1 likes 1 replies
?
Replies
Roadmap of the book: STAGE 1 includes chapter 1~4 Ch 1: high level concepts behind LLM; transformer architecture; a plan to build LLM from scratch Ch2: work with text data/tokenization; byte pair encoding; sampling with sliding window; converting tokens into vectors for LLM