Vinod Anbalagan

Writing · The Meta Gradient and elsewhere

Working it out in public.

Essays on world models, learning and data. Each one pairs the derivation and the code with the picture that made it click for me.

Subscribe on Substack →

Research blogs

  1. CulturalRiddles: Where Models Fall ShortOriginal riddles from 62 cultures, and what 28 language models get wrong about them: regional gaps, made-up answers, and a pull toward the familiar.Cohere Labs research blog · co-written with Tianyi Hu, Madeline Smith and Julia Kreutzer22 Oct 2026

Interpretability & safety

  1. Where Does Forgotten Knowledge Go?I made a model forget. Facts unlearned in English were still answered in Tamil, and the unlearned model left a trace a never-learned model does not.14 Nov 2026

Learning & world models

  1. The Architecture of Dreams, Part 3: Does Looking Right Mean Understanding?Genie, V-JEPA 2, and Physics-IQ.11 Oct 2026
  2. The Architecture of Dreams, Part 2: What Should a World Model Predict?MuZero, DreamerV3, TD-MPC2.28 Sept 2026
  3. Freezing the NoiseHow one line of algebra made sampling differentiable.18 Sept 2026
  4. The Architecture of Dreams, Part 1: How Neural Networks Learned to ImagineWorld Models, PlaNet, Dreamer.14 Sept 2026
  5. Finding the ManifoldWhere neural networks land: the geometry of optimisation, with a live demo.6 Jan 2026

Data & evaluation

  1. The BreakthroughWhat 10 Grade B runs taught me about data quality.18 Apr 2026
  2. Building the Dataset Tamil Farmers DeserveWhy brute-force AI fails the Global South.9 Apr 2026
  3. On Building Offline AI for People Who Actually Need ItWhat 9,000 evaluation pairs taught us about multilingual retrieval.1 Apr 2026

Perspectives

  1. If AI Will Shape the World, the World Must Help Govern ItOpen weights, legitimacy, and who gets to participate in science.1 Aug 2026
  2. NeurIPS 2025: The Year We Admitted We Were LostAnd found a better map. Notes on the conference that challenged scaling orthodoxy.15 Dec 2025
  3. Animals, Ghosts, and ChimerasThe AI debate that will define the next decade.24 Oct 2025