Context Travel
Context Travel is a free interactive infographic that follows a single token through a language model, from the moment you type it to the moment the model uses it to predict the next one.
Token, embedding, attention, prediction. Four words that get repeated constantly and explained rarely. This follows one token through all four so the sequence stops being abstract.
Open Context Travel on Testing Titbits Playground · 2-3 min · Tokens · Free, no sign-up
How to read it
- Type or pick a phrase to send through the model.
- Watch it split into tokens.
- Follow one token into the embedding space.
- See attention connect it to the rest of the context.
- Arrive at the prediction it helped produce.
What you will learn
- What a token actually is and why it is not a word.
- How embeddings turn a token into a position in meaning-space.
- What attention does with the rest of your context.
- Why the same prompt can produce different output.
Frequently asked questions
What is a token in AI?
A token is the unit a language model reads, roughly three to four characters of English. Words split into multiple tokens, and the split is not intuitive, which is why token counts rarely match word counts.
How does a language model use context?
Every token in the context window is embedded and then weighted against every other token through attention. The model uses that weighted picture to predict the next token, one at a time.
Do I need a maths background?
No. It is built to be followed visually.
More free games and infographics for testers
- Context Handoff
- Deep Context
- The Number
- Context Matters
- Guard Rails
- Bug Hunter
- Testing Emoji Charades
- AI Readiness Test
- Bug Maze
- Break the Field
- AI Engineering, Explained by Magic
- Exploratory Testing Dice
- The Tech Divide
- The Context Paradox
- Tokens, Explained
- How GenAI Works
- Loops at Work
- All games on Testing Titbits Playground
- Global leaderboard
Created by Rahul Parwal · TestingTitbits.com