Research
What does a planning agent need to remember?
I work on world models as the basis for robot control, and on memory in particular: what a planner must keep, and how to keep it small enough to plan in real time.
In progressWorld models · robot learning
Notch
What should a robot remember?
Working title: What Should a Robot Remember? Plan Change as a Write Signal for Lean Memory in World-Model Planning · preprint planned for December 2026
Abstract
A robot that acts only on its current camera frame fails as soon as the frame stops showing what it needs: an object that is now hidden, a cue that has disappeared. Memory fixes that, at a price, and inside a sampling-based planner the price is multiplied, because the world model reads its memory at every step of every imagined rollout.
Notch studies the choice a small memory forces: what gets written. On one trained world model with one fixed memory budget, it compares five write rules: time, chance, the model's own surprise, whether an observation changed the plan, and the two combined. Plan change is something only a planner can measure about itself. A moving distractor is surprising but leaves the plan untouched; an object that is not where it should be changes it. Reliability and planning time are reported together, on tasks that cannot be solved from the current frame.
Prior work gates memory on surprise, learns when to write end to end, or adds always-on memory slots, usually around a policy and rarely with timing. Notch compares write signals on equal terms inside a planner and checks that what the memory keeps actually guides the plan.
JEPA world model · latent planning · write rules for a fixed memory · simulation first, then a robot arm
The animation on the home page sketches one of the five rules, surprise. It is an illustration, not model output.
Nov 2026Unlearning · interpretabilityPre-registered
Where Does Forgotten Knowledge Go?
Auditing Unlearning in English and Tamil. Did the model really forget, or just learn to hide the answer?
Lexsi Labs AI Safety & Alignment Hackathon (with Cohere Labs, Hugging Face)
A controlled bilingual testbed: 96 invented people taught to a small multilingual model, Tiny Aya Global, plus a twin model that never learned them. Circuit discovery with CircuitKIT located where the facts live; SafeTune NPO unlearning then removed them in English. The question was whether unlearning removes knowledge or only hides it.
- All 34 facts silenced in English were still answered in Tamil.
- Unlearned models suppress answers below the never-learned baseline (Jacobian-lens top-10 access 0 to 21%, against 83 to 93%): a detectable trace that unlearning happened.
- Every run was pre-registered; the automatic judge was validated against 2,022 blind human labels (κ 0.96).
Interactive Space ↗Article ↗Code ↗Models ↗Data and every run log ↗
MRL 2026Co-first authorMultilingual evaluation
CulturalRiddles
A multicultural benchmark of riddles across 51 languages.
arXiv:2610.29968 ↗· To be presented at MRL 2026, Budapest · under review at TACL
Riddles are a setting where surface fluency and real understanding come apart sharply. A model can produce perfect Tamil and still miss what a Tamil riddle is actually about. CulturalRiddles collects around 6,100 riddles written by native speakers from 62 language communities, and evaluates how well language models solve them in the cultural context they come from.
- Co-first author and cross-team lead, with the Cohere Labs Open Science Community
- Led data creation, validation, evaluation and analysis
- Coordinated 200+ contributors across writing, validation and evaluation, including 165 riddle writers
- A living dataset: new communities keep joining
- Designed the canonical schema, the benchmarking pipeline and the dataset release
Paper ↗Research blog ↗Dashboard ↗Dataset ↗Take the quiz ↗
I built · results dashboard
The CulturalRiddles dashboard
A public dashboard on Hugging Face Spaces for exploring the benchmark by model, culture, region, difficulty and error type. Every figure is reconciled to the human-evaluation source data.
Open the dashboard ↗I co-wrote · Cohere Labs research blog
The public write-up of the paper: why a 79% overall score hides communities where no model passes 22%, why translation only closes part of the gap, and why models reach for the familiar answer. Co-written with Tianyi Hu, Madeline Smith and Julia Kreutzer.
Read the blog ↗