Tico

@ticocr.bsky.social

56 Followers 103 Following

Más tico que el gallo pinto

Pink pineapple
If the vocabulary changes or is reordered, this representation breaks and cannot transform meaningfully (e.g., “hello” could map to a completely different one-hot index in another system).
Say I want to tokenize the phrase “hello world” so that an LLM can predict that a common word after “hello” is “world”. Show me a proper tensor representation of this. Then show me a matrix representation that is not a tensor.