aDSL: Agentic 3D Creation via Joint Agent-Program Design

Rui-Huan Wang, Si-Tong Wei, Jia-Qi He, Heng-Yi Wei, Baoquan Chen, Peng-Shuai Wang
Peking University
Corresponding Author

Abstract

Programmatic representations provide a compelling paradigm for 3D content creation, enabling fine-grained edits, interpretability, and explicit structural control. Yet, agentic workflows that rely on large language models (LLMs) to author 3D programs remain brittle, often failing to translate high-level intent into consistent low-level geometry. We attribute this fragility to a mismatch between existing programmatic interfaces and the reasoning strengths of LLMs, which favor semantic structure and spatial relations over fragile numeric choices. In this paper, we jointly design an Agent-centric Domain-Specific Language (aDSL) and a role-specialized multi-agent system to close this gap. aDSL bridges semantic logic and geometric constraints by emphasizing composability and spatial reasoning; it enables agents to manipulate geometry through relational operators instead of brittle absolute coordinates. Building on aDSL, our training-free multi-agent system follows a Plan–Execute–Critic loop to decompose requests, synthesize code, and iteratively repair errors and constraint violations using execution feedback. Experiments show that this co-design improves robustness, controllability, and faithfulness to user intent. Our method outperforms prior LLM-based baselines on text-to-shape and image-to-shape tasks while preserving explicit structure, editability, and interpretability. It also enables downstream applications such as articulated object creation and structured scene composition.

Qualitative Results

Text-to-shape comparisons across Trellis, BlenderLLM, LlamaMesh, BlenderMCP, ShapeCraft, IL3M, Scene Language, and aDSL on bookshelf, office desk, and chair prompts
Text-conditioned generation
Image-to-shape comparisons across Trellis, LN3Diff, Direct3D-S2, ShapeCraft, Scene Language, and aDSL on bicycle and vehicle reference images
Image-conditioned generation

Local Edit

From Structure to Fidelity

By applying external 3D generative models to structured aDSL outputs, we enhance geometric detail while preserving the original composition and spatial relationships.

Interactive Assets

aDSL defines movable parts and their joints in the same program, making articulated assets directly executable and editable.

Method

Overview of aDSL showing primitives, Boolean operations, hierarchical composition, spatial reasoning, component fabrication, and global assembly
aDSL gives agents an editable 3D representation built around parts, relations, and constraints instead of relying on fragile absolute coordinates.
aDSL agent workflow from user input through Planner, Coder, Executor, Debugger, and Critic to an approved 3D asset
Specialized agents turn text or images into aDSL programs, execute them, and iteratively fix failures or violated constraints.

Citation

@article{wang2026adsl,
  title   = {aDSL: Agentic 3D Creation via Joint Agent-Program Design},
  author  = {Wang, Rui-Huan and Wei, Si-Tong and He, Jia-Qi and Wei, Heng-Yi and Chen, Baoquan and Wang, Peng-Shuai},
  journal = {arXiv preprint arXiv:2608.17975},
  year    = {2026}
}