Generative Simulators

Generative Simulators: The Foundations for Self-Adapting Intelligence

Environments that generate their own tasks, world dynamics and rewards.

Rebecca Qian, Darshan Deshpande, Varun Prashant Gangal, Li Siyan
“A Study in Color”, Kenya
01

In brief

02

Key figure

A Generative Simulator sets task difficulty once and generates tasks, timelines and tool stacks to match. A curriculum filter picks the tasks the agent runs, and a reward function scores its trajectories into an evaluation report that feeds back into the difficulty scale.
A Generative Simulator sets task difficulty once and generates tasks, timelines and tool stacks to match. A curriculum filter picks the tasks the agent runs, and a reward function scores its trajectories into an evaluation report that feeds back into the difficulty scale.
03

Runs

03

Abstract

As machine learning systems become increasingly agentic, static datasets, hand-written environments, and fixed benchmarks are proving insufficient for training, evaluation, and governance. Agents deployed in real-world settings must reason under uncertainty, interact over long horizons, and continuously remember and adapt as their understanding of tasks, tools, and constraints evolves. We introduce Generative Simulators, adaptive environments that jointly co-generate tasks, world dynamics, and reward functions. We believe that generative simulators constitute the foundational infrastructure for self-adaptive world modeling, extending beyond reinforcement learning algorithms and beyond human-curated datasets.

Cite this
TextBibTeXCopy
Rebecca Qian, Darshan Deshpande, Varun Prashant Gangal, Li Siyan. Generative Simulators: The Foundations for Self-Adapting Intelligence. Technical report, Patronus AI, 2025.
@techreport{qian2025generativesi, title={Generative Simulators: The Foundations for Self-Adapting Intelligence}, author={Rebecca Qian and Darshan Deshpande and Varun Prashant Gangal and Li Siyan}, institution={Patronus AI}, year={2025}, url={https://cdn.prod.website-files.com/64e655d42d3be60f582d0472/69a9a7fb3752c2472158db02_Position__Adaptive_RLVR_Environments_Need_to_Jointly_Scale_Task__Scaffolding_and_Reward_Design%20.pdf} }
Technical report (PDF)
December 17, 2025
generative-simulators
More research
All research →
“Earth’s Aquarium”, Bering Sea
NeurIPS 2026
meta

World Modeling for Agentic RL

A language model that stands in for an environment while an agent trains.

May 7, 2026
arXiv 2607.16204
Main
world-modeling-for-agentic-rl
NeurIPS 2026
“Konari, Iran”, Zagros Mountains
ACL 2026 GEM Workshop
meta

DETOUR

A two-agent benchmark for tip-of-the-tongue search across several turns.

January 30, 2026
arXiv 2602.00352
Workshop
detour
ACL 2026 GEM Workshop
“Himalayas”, Eastern Himalaya, southwestern China
Nature
meta

Humanity’s Last Exam

A multi-modal benchmark at the frontier of human knowledge.

January 24, 2025
arXiv 2501.14249
Main
humanitys-last-exam
Nature
From the blog
All posts →