A Generative Simulator sets task difficulty once and generates tasks, timelines and tool stacks to match. A curriculum filter picks the tasks the agent runs, and a reward function scores its trajectories into an evaluation report that feeds back into the difficulty scale.
03
Runs
03
Abstract
As machine learning systems become increasingly agentic, static datasets, hand-written environments, and fixed benchmarks are proving insufficient for training, evaluation, and governance. Agents deployed in real-world settings must reason under uncertainty, interact over long horizons, and continuously remember and adapt as their understanding of tasks, tools, and constraints evolves. We introduce Generative Simulators, adaptive environments that jointly co-generate tasks, world dynamics, and reward functions. We believe that generative simulators constitute the foundational infrastructure for self-adaptive world modeling, extending beyond reinforcement learning algorithms and beyond human-curated datasets.
Rebecca Qian, Darshan Deshpande, Varun Prashant Gangal, Li Siyan. Generative Simulators: The Foundations for Self-Adapting Intelligence. Technical report, Patronus AI, 2025.
@techreport{qian2025generativesi,
title={Generative Simulators: The Foundations for Self-Adapting Intelligence},
author={Rebecca Qian and Darshan Deshpande and Varun Prashant Gangal and Li Siyan},
institution={Patronus AI},
year={2025},
url={https://cdn.prod.website-files.com/64e655d42d3be60f582d0472/69a9a7fb3752c2472158db02_Position__Adaptive_RLVR_Environments_Need_to_Jointly_Scale_Task__Scaffolding_and_Reward_Design%20.pdf}
}