It still surprises me how often people talk about LLMs without even mentioning word embeddings. Without embeddings, LLMs wouldn’t even exist. Hesam Hassani does a fantastic job breaking down what embeddings are (not just technically, but also from a historical perspective) in this article.

1 likes 1 replies