AI Agents

SWE-Universe: Scale Real-World Verifiable Environments to Millions

MMouxiang ChenLLei ZhangYYunlong FengXXuwu WangWWenting ZhaoRRuisheng CaoJJiaxi YangJJiawei ChenMMingze LiZZeyao MaHHao GeZZongmeng ZhangZZeyu CuiDDayiheng LiuJJingren ZhouJJianling SunJJunyang LinBBinyuan Hui
Published
February 2, 2026
Authors
18

Abstract

We propose SWE-Universe, a scalable and efficient framework for automatically constructing real-world software engineering (SWE) verifiable environments from GitHub pull requests (PRs). To overcome the prevalent challenges of automatic building, such as low production yield, weak verifiers, and prohibitive cost, our framework utilizes a building agent powered by an efficient custom-trained model. This agent employs iterative self-verification and in-loop hacking detection to ensure the reliable generation of high-fidelity, verifiable tasks. Using this method, we scale the number of real-world multilingual SWE environments to a million scale (807,693). We demonstrate the profound value of our environments through large-scale agentic mid-training and reinforcement learning. Finally, we applied this technique to Qwen3-Max-Thinking and achieved a score of 75.3% on SWE-Bench Verified. Our work provides both a critical resource and a robust methodology to advance the next generation of coding agents.

Keywords

building agentself-verificationin-loop hacking detectionreal-world software engineeringGitHub pull requestscustom-trained modelverifiable environmentsagentic mid-trainingreinforcement learningSWE-Bench Verified

More in AI Agents

View all
SWE-Universe: Scale Real-World Verifiable Environments to Millions | Paperchime