Anand Kannappan

Cofounder and CEO

Anand is cofounder and CEO of Patronus AI and a coauthor on its benchmarks, including FinanceBench, TRAIL and SpeedrunBench. Before Patronus, he led ML explainability and experimentation work at Meta Reality Labs.

At Patronus· Newest first

Newest first

Papers

“Byrd Glacier”, Transantarctic Mountains, Antarctica

SpeedrunBench

Video game speedrunning as a test of whether agents can beat strategies humans already know.

Yoshinari Fujinuma, Keisuke Kamahori, Ryuto Koike, Abdelrahman Madkour, Varun Prashant Gangal, Monty Bichouna, Martyna Markiewicz, Shivani Jain, Duncan Curtis, Rebecca Qian, Anand Kannappan
arXiv 2610.08076
September 3, 2026
speedrunbench
https://arxiv.org/abs/2610.08076
“Melted Colors”, Great Sandy Desert, Western Australia

FigmaTrace

Human design workflows in Figma, captured as training data for creative design tasks.

Darshan Deshpande, Yoshinari Fujinuma, Martyna Markiewicz, Devanshu Bansal, Shivani Jain, Nicholas Saban, Chirag Maheshwari, Anand Kannappan
arXiv 2608.21460
August 20, 2026
figmatrace
https://arxiv.org/abs/2608.21460
“Konari, Iran”, Zagros Mountains

DETOUR

A two-agent benchmark for tip-of-the-tongue search across several turns.

Li Siyan, Darshan Deshpande, Anand Kannappan, Rebecca Qian
arXiv 2602.00352
ACL 2026 GEM Workshop
January 30, 2026
Workshop
detour
https://arxiv.org/abs/2602.00352
ACL 2026 GEM Workshop
“Alluvial Fan”, Taklimakan Desert, China

TRACE

54 kinds of reward exploit in code RL, and how well models catch them.

Darshan Deshpande, Anand Kannappan, Rebecca Qian
arXiv 2601.20103
ICML 2026
January 27, 2026
Main
trace
https://arxiv.org/abs/2601.20103
ICML 2026
“Desert Ribbons”, Morocco

MEMTRACK

Testing whether agents keep track of facts spread across workplace tools.

Darshan Deshpande, Varun Prashant Gangal, Hersh Mehta, Anand Kannappan, Rebecca Qian, Peng Wang
arXiv 2510.01353
NeurIPS 2025 Workshop
October 1, 2025
Workshop
memtrack
https://arxiv.org/abs/2510.01353
NeurIPS 2025 Workshop
“Capillaries”, Meta River, Colombia–Venezuela border

TRAIL

A benchmark for finding the step where an agent went wrong.

Darshan Deshpande, Varun Prashant Gangal, Hersh Mehta, Jitin Krishnan, Anand Kannappan, Rebecca Qian
arXiv 2505.08638
May 13, 2025
trail
https://arxiv.org/abs/2505.08638
“Icy Vortex”, Foxe Basin, northern Canada

BLUR

573 tip-of-the-tongue questions that need search, reasoning and tool use.

Sky CH-Wang, Darshan Deshpande, Smaranda Muresan, Anand Kannappan, Rebecca Qian
arXiv 2503.19193
ACL 2025
March 24, 2025
Main
blur
https://arxiv.org/abs/2503.19193
ACL 2025
“Slessor Glacier”, Antarctica

GLIDER

A small, explainable judge model for grading LLM interactions.

Darshan Deshpande, Selvan Sunitha Ravi, Sky CH-Wang, Bartosz Mielczarek, Anand Kannappan, Rebecca Qian
arXiv 2412.14140
December 18, 2024
glider-sota-slm-judge
https://arxiv.org/abs/2412.14140
“Re-entry”, Jebel Kissu, Sudan

Lynx

An open-source model for detecting hallucinations in retrieval-augmented generation.

Selvan Sunitha Ravi, Bartosz Mielczarek, Anand Kannappan, Douwe Kiela, Rebecca Qian
arXiv 2407.08488
July 11, 2024
lynx-hallucination-detection-model
https://arxiv.org/abs/2407.08488
“Desert Patterns”, Erg Chech, Algeria

FinanceBench

Open-book financial question answering about publicly traded companies.

Pranab Islam, Anand Kannappan, Douwe Kiela, Rebecca Qian, Nino Scherrer, Bertie Vidgen
arXiv 2311.11944
November 20, 2023
financebench
https://arxiv.org/abs/2311.11944
“Guinea-Bissau”, West Africa

SimpleSafetyTests

100 prompts for finding critical safety risks in language models.

Bertie Vidgen, Nino Scherrer, Hannah Rose Kirk, Rebecca Qian, Anand Kannappan, Scott A. Hale, Paul Röttger
arXiv 2311.08370
November 14, 2023
simplesafetytests
https://arxiv.org/abs/2311.08370

Posts

Lower Falls of the Yellowstone, Wyoming. Photo: NPS, Yellowstone National Park (public domain)

Introducing SpeedrunBench: A Challenging Benchmark for Frontier Agents

September 3, 2026
·
Research
introducing-speedrunbench-a-challenging-benchmark-for-frontier-agents
Varun Prashant Gangal
Abdelrahman Madkour
Rebecca Qian
Anand Kannappan
Corona Arch, Moab, Utah. Photo: Vulturesong (CC0)

Introducing FigmaTrace: A Comprehensive Training Dataset for Figma Design Workflows

August 20, 2026
·
Research
figmatrace-a-comprehensive-training-dataset-for-figma-design-workflows
Darshan Deshpande
Anand Kannappan
Bald cypress swamp. Photo: Ryan Hagerty, USFWS (public domain)

Introducing BLUR: A Benchmark for Tip-of-the-Tongue Search and Reasoning

April 2, 2025
·
Research
the-blur-benchmark-browsing-lost-unformed-recollections
Anand Kannappan

No papers or posts here yet.

Work with Anand

See open roles →
Anand Kannappan
show