arxiv:2609.14462
Published on Sep 13
· Submitted by
Chuanhao on Sep 15
Upvote
26
Authors:
,
Zhen Li ,
,
Abstract
AlayaVista decouples panoramic scene evolution from perspective video synthesis to enable efficient, high-fidelity interactive world modeling, supported by the MUGEN dataset.
Generated by thinkingmachines/Inkling-Small
Interactive video world models must maintain broad scene context under camera motion while producing high-fidelity observations with low latency. Existing approaches face a representation trade-off: perspective models operate on local views and must preserve off-screen content over long rollouts, whereas broader spatial coverage is typically obtained by synthesizing full-sphere videos or constructing explicit 3D representations. Motivated by the complementary roles of global context and selective local acuity in visual perception, we present AlayaVista, a camera-controllable streaming video world model that decouples panoramic world evolution from perspective observation synthesis. Given a single perspective image, AlayaVista constructs a 360-degree scene prior using a pretrained panorama expansion model and then evolves the scene as a camera-conditioned panoramic latent state. A latent viewport renderer maps this state to the requested perspective video latents, while a perspective refiner restores details, suppresses artifacts, and performs super-resolution. To support efficient streaming, we adapt the panoramic generator to chunk-autoregressive generation and distill both panoramic generation and perspective refinement into few-step processes. To provide the supervision required by this design, we construct MUGEN, a large-scale real-world panoramic video dataset containing 1,318 hours of videos at resolutions of at least 4K, together with rich semantic and geometric annotations.
View arXiv page View PDF Project pageGitHub 32 Add to collection
Community
Paper author Paper submitter 8 days ago
AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video
7 days ago
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
-
AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (2026)
-
Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds (2026)
-
Sekai2: From World Exploration to Interactive World Modeling (2026)
-
Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory (2026)
-
Visko Orbis 1.0: A Live Model for Real-Time Interactive Long Video Generation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on HF Mirror checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
· Sign up or log in to comment
Upvote
26
Get this paper in your agent:
hf papers read 2609.14462
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2609.14462 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2609.14462 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2609.14462 in a Space README.md to link it from this page.