arxiv:2609.11638
Published on Sep 10
· Submitted by
Jintao Zhang on Sep 15
Upvote
695
Authors:
,
,
,
Ming Lin ,
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
Vidu S2 introduces real-time interactive avatar and video editing models that support high-resolution spatial video generation and dynamic reference updates.
Generated by thinkingmachines/Inkling-Small
We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu S2-Editing. Compared with Vidu S1, Vidu S2-Avatar supports real-time 720p video generation, generation with dynamic references that can be updated at any moment, and stronger instruction following, such as dancing. Vidu S2-Editing supports editing a video stream in real time, including style rendering, clothing replacement, character replacement, and background replacement. Experiments show that Vidu S2 outperforms all baselines. A playable online demo is available at https://vidu.com/vidu-stream.
View arXiv page View PDF Project pageGitHub 448 Add to collection
Community
Paper author Paper submitter 8 days ago
🚀 Thrilled to introduce Vidu S2: real-time AI video you can talk to, direct, and real-time editing.
🎙️ Vidu S2-Avatar Interactive characters at 720p and 25–42 FPS, with stronger instruction following, expressive full-body motion, and dancing. Introduce new reference images anytime to change outfits, interact with objects, or switch scenes mid-conversation.
🎨 Vidu S2-Editing Transform an incoming video stream in real time while preserving motion and timing: style transfer, virtual try-on, character replacement, and background replacement.
🥽 Spatial video Bring generated characters and live video edits into stereoscopic video for immersive VR experiences.
🏆 SOTA results across all five public benchmarks in our evaluation, spanning avatar generation and video editing.
🎮 Try it: https://vidu.com/vidu-stream 🛠️ API: http://platform.vidu.com/vidu-stream/doc 📄 Technical report: https://arxiv.org/pdf/2609.11638
7 days ago
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
-
JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion (2026)
-
EditaLive! Unified Character Video Editing for Live Streaming (2026)
-
Visko Orbis 1.0: A Live Model for Real-Time Interactive Long Video Generation (2026)
-
EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing (2026)
-
Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds (2026)
-
LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time (2026)
-
InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on HF Mirror checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
· Sign up or log in to comment
Upvote
695
Get this paper in your agent:
hf papers read 2609.11638
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2609.11638 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2609.11638 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2609.11638 in a Space README.md to link it from this page.