Where Does Forgotten Knowledge Go? Auditing Unlearning in English and Tamil
Nov 2026Lexsi Labs AI Safety & Alignment Hackathon (with Cohere Labs, Hugging Face)
- Built a controlled bilingual testbed (96 invented people, a never-learned twin model) to test whether unlearning removes knowledge or only hides it; chained CircuitKIT circuit discovery with SafeTune NPO unlearning on Tiny Aya Global.
- Found that 34/34 facts silenced in English were still answered in Tamil, and that unlearned models suppress answers below a never-learned baseline (Jacobian-lens top-10 access 0 to 21% vs 83 to 93%), a detectable trace of unlearning.
- Pre-registered every run; validated the automatic judge against 2,022 blind human labels (κ 0.96); published models, data, all run logs and an interactive explainer.
Space ↗Code ↗Article ↗Models ↗Data and logs ↗
Gridline & Prism: Vision-Language Fine-Tuning for Chart QA
2026Adaption Labs AutoScientist Challenge · 2nd Place
- Built two correct-by-construction chart-QA datasets (one visual style, then ten) with a hand-authored hardset from real StatCan, BLS, ECB, and WHO charts and eight perceptual-difficulty mechanics (truncated and log axes, unlabeled values, near-ties, dual axes).
- Fine-tuned LoRA adapters on Gemma-3-27B and Qwen3.5-9B vision-language models across 15 training runs; Gridline won 62% of pairwise comparisons against its base model.
- Showed the challenge’s win-rate metric partly rewards easier test sets: with the base model fixed, win rate fell from 62% to 24% as perceptual difficulty and visual variety increased.
- Diagnosed a reproducible failure where maximal data-enhancement settings made fine-tuned models worse than their base (31–35% win rate): even with explicit guard instructions, 31.6% of the platform’s rewritten answers diverged from source, including 41 changed numbers.
Dataset v1 ↗Dataset v2 ↗Gridline model ↗Prism model ↗
DocuNative: Offline Cross-Lingual Document QA
Mar 2026Cohere Expedition Hackathon
- Privacy-first document QA for newcomers: ask about a foreign-language document in your own language and get answers with source quotes and a hallucination trust score, with nothing leaving the device.
- Pipeline lead on a 7-person team: RAG with BGE-M3, ChromaDB, Tiny Aya via llama.cpp, and mDeBERTa NLI verification; 9,000+ evaluations across Chinese, Hindi, and Polish showed cross-lingual embedding quality, not LLM capability, was the main bottleneck.
Project ↗Write-up ↗
Agricultural Advisory Datasets
2026Adaption Labs Uncharted Data Challenge · Grade A (9.4/10)
- 187 curated Tamil Q&A records (48 crops, 20 categories) from Kisan Call Centre logs, TNAU, and ICAR sources over 10 iterative submissions, with honorary recognition from Sara Hooker; extended to 718 records in 11 Indian languages using a layered regex and local LLM-as-judge filter.
Tamil ↗11-language ↗