Loading
Project 03
The invisible mechanism inside every AI — made visible.
This project is currently in design phase
Check back soon — detailed content and interactive demos are on the way.
THE PROBLEM
Every AI language model — GPT, Claude, Gemini — uses a mechanism called attention to understand language. It looks at every word in a sentence simultaneously and decides which other words are relevant to understanding each one. This mechanism runs billions of times per second inside every AI response. Nobody has ever seen it. It is completely invisible.
THE APPROACH
A real language model (DistilBERT) processes any sentence you type and outputs attention weights — a number for every word pair representing how much one word attends to another. These weights are extracted and rendered as an arc diagram: click any word, and glowing lines connect it to every other word with thickness proportional to attention. This is not a simulation of how AI reads — it is the actual computed attention of a real model processing your exact sentence.
THE DEMO
Attention visualizer — coming soon
WHAT I'M LEARNING
Content coming soon — this project is in design phase.
Other Projects
0101
Thousands of particles follow simple attraction and repulsion rules. No structure is programmed — complex, life-like behavior emerges on its own.
0202
2D creatures made of joints and muscles start helpless. A genetic algorithm mutates them across generations until they discover how to move.