arxiv:2609.18620
Published on Sep 17
· Submitted by
Can Li on Sep 21
Upvote
3
Authors:
Can Li ,
,
,
,
Abstract
Creating deformable assets for robot manipulation requires jointly specifying their geometry, appearance, and physical properties. This is especially challenging for deformable objects, since text and images provide limited evidence about how they deform and respond to contact, yet these responses directly affect their suitability for interaction. Automated generation therefore needs to resolve coupled physical requirements and use interaction evidence to guide construction and refinement. We present DeformSmith, a framework that enables automated generation of interactive, physically credible deformable assets from text or a single image. Through hierarchical agentic construction and a shared physics-grounded harness, it progressively builds, tests, and refines geometry, physical models, material behavior, and robot interaction until the resulting asset is ready for simulation and manipulation. Robot interaction closes the generation loop through manipulation feedback and replayable interaction data. Results show that DeformSmith generates assets with better visual quality and physical plausibility than state-of-the-art baselines, including PhysGen3D, PhysGM, and PhysX-Omni, while supporting the synthesis of data for robotic manipulation of deformable objects. Project page: https://can-lee.github.io/deformsmith-web/
View arXiv page View PDF Project pageGitHub 2 Add to collection
Community
Paper author Paper submitter 2 days ago
Generate the object. Establish its physics. Put it into interaction.
about 22 hours ago
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
-
PhysReal: Learning Real-World Deformable Object Physics via Hybrid Constitutive Modeling (2026)
-
NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation (2026)
-
GIF: Agentic Generation of Interactive and Functional Object Compositions for Robot Learning (2026)
-
IM-ENGINE: Image Editing for Embodied Data Generation (2026)
-
4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation (2026)
-
RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on HF Mirror checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
· Sign up or log in to comment
Upvote
3
Get this paper in your agent:
hf papers read 2609.18620
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2609.18620 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2609.18620 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2609.18620 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.