Back to Home
Codex
Codex Posts
2 posts in this category
Codex
9 min read•2026-04-19
The Seat Ribbons
Self-attention treats a sentence as a bag of words with no order. The fix — the one that powered the original Transformer — was to blend a unique positional pattern into every word before the buffet.
Codex
14 min read•2026-04-18
Attention is a Potluck
A tactile, phone-readable walkthrough of the single mechanism that makes every modern LLM actually understand language — no matrices first, no jargon, no mush.