Model Releases
Code2Games: Enabling Coding Agents for Gaming World Generation
arXiv:2610.05033v1 Announce Type: new Abstract: Generating a high-quality gaming world from a natural-language game intent requires joint reasoning about scene structure, spatial layout, gameplay obje
arXiv:2610.05033v1 Announce Type: new Abstract: Generating a high-quality gaming world from a natural-language game intent requires joint reasoning about scene structure, spatial layout, gameplay objectives, interactive entities, and executable gameplay logic. Existing coding agents can generate individual assets, scenes, or scripts, but often struggle to maintain consistency across these components. We propose Code2Games, an agentic framework that builds a structured gaming world upon a base Blender world generated from the same game intent. Code2Games coordinates scene analysis, gameplay planning, constrained gaming-world generation, and gaming-engine customization through a shared scene-gameplay representation with persistent element correspondence. After world generation, Code2Games adapts the generated world to Unreal Engine 5 and employs an execution-guided reconstruction process that uses compilation diagnostics, runtime feedback, and gameplay test results to resolve inconsistencies arising during engine adaptation. To systematically evaluate gaming-world generation, we introduce the GameCode4D benchmark, which comprises ten fixed game prompts spanning different levels of scene and gameplay complexity. We evaluate the generated results across four dimensions: visual quality, interactive fidelity, multimodal artifact quality, and playable-game quality. Experiments demonstrate that, compared with direct gaming-world generation by coding agents and existing baseline methods, Code2Games consistently improves the visual quality and interactive fidelity of generated gaming worlds, as well as the quality of the resulting games after engine adaptation.
Related
- MT-Web2Code: Benchmarking Coding Agents on Multi-Turn Regional Reconstruction and Localized Modification
- Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation
- SpatialCrafter: Single Image World Modeling with Generative 3D Proxies
- SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
- Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations
Source: arXiv cs.CV | 2026-10-06