GlanceWAM: Sparse Test-Time Imagination
for World-Action Models

Linhan Wang1 Zijian An2 Mingyuan Zhang3 Chen Dai1 Yi Xu3 Can Cui4 Jiayan Wang3 Zichong Yang4 Yinlin Chen1 Lifeng Zhou2 Chang-Tien Lu1

1Virginia Tech 2Drexel University 3Northeastern University 4Purdue University

Spotlight & Honorable Mention (Best Paper Award) · RoBoWoMo Workshop @ IROS 2026
arXiv Code Data & Checkpoints
Synchronous imagination versus sparse lookahead foresight, and RoboCasa kitchen success rates
(a) Existing WAMs either skip test-time foresight or imagine video synchronously with every action chunk. (b) GlanceWAM glances ahead asynchronously to a single latent lookahead frame Hf ≈ 3 s away and reuses it across ≈4 action chunks, each decoded in 48 ms. (c) Success rate on RoboCasa kitchen (24 tasks, demos only).

Glance slowly, act fast. GlanceWAM keeps test-time visual imagination but moves it off the control path: a video DiT imagines one lookahead frame seconds ahead in the background, and the action head acts on it in latent space at control rate.

Real-Robot Rollouts

GlanceWAM on the IMETA Y1 platform, trained on 50 teleoperated demonstrations per task. Success rates are over 50 trials per task (GlanceWAM vs. π0.5).

Single-arm
Stack cups94% vs. 78%
Pick and place58% vs. 72%
Remove cup cap88% vs. 68%
Bimanual
Stack cups84% vs. 66%
Bowl72% vs. 64%

Continuous, uncut sessions. Robot rollouts are shown at 4×, human scene resets at 8×; people are masked out.

Abstract

Video generative models provide rich physical priors for robot learning, yet existing world-action models (WAMs) face a fundamental trade-off: synchronous video generation at control rate is latency-prohibitive, while abandoning test-time visual imagination sacrifices task success. We show that visual imagination achieves both real-time inference and superior success rates when generated asynchronously off the critical path and consumed directly in latent space. We introduce GlanceWAM, which decouples imagination from control on a single shared video DiT backbone: an asynchronous proposer glances ahead on a slow clock to imagine a single lookahead frame seconds into the future in the background, while an action head decodes action chunks at control rate (48 ms) purely in latent space without blocking. Enabled by a non-interfering attention mask that isolates video representations and staleness-robust horizon training that accommodates asynchronous lookahead aging, GlanceWAM breaks the speed–success dilemma. Trained purely on demonstrations, it attains 72.2% on the 24-task RoboCasa kitchen benchmark (vs. 67.1% for synchronous Cosmos Policy) and 99.0% on LIBERO while cutting per-chunk control latency 24× relative to synchronous world-action models (48 ms on one A100). In single-arm and bimanual real-robot manipulation, it achieves higher average success than π0.5 without any robot-data pretraining.

Method

GlanceWAM architecture: co-training and asynchronous inference
(a) In co-training, the video DiT predicts the future target xt+Hf, while the action head learns inverse dynamics toward a lookahead frame xt+u at a random offset u ~ U(0, Hf], so it sees every lookahead age it will meet at deployment. (b) At inference, the lookahead latent is generated asynchronously once per Hf and never decoded; each 0.8 s action chunk reads the held lookahead in 48 ms.

Asynchronous latent lookahead

The video DiT imagines one frame about 3 s ahead on a slow background clock. The action head decodes 0.8 s action chunks against it in a single 48 ms pass, with no VAE decoding in the loop.

Non-interfering attention mask

A prefix-LM mask keeps lookahead tokens from contaminating observation encodings. Retraining without it (bidirectional attention) drops RoboCasa success from 71.5% to 47.0%.

Staleness-robust horizon training

The policy is supervised on lookaheads at random offsets u ~ U(0, Hf], so it stays accurate as a held lookahead ages between refreshes.

Results

72.2%
RoboCasa kitchen
24 tasks, 50 demos/task
99.0%
LIBERO
4-suite average
48 ms
per action chunk
24× lower latency than synchronous WAMs
79.2%
real robot, 5 tasks
vs. 69.6% for π0.5

RoboCasa kitchen

ModelSR (%)Demos/task
Ï€062.5300
Video Policy66.0300
GR00T-N1.5 + HAMLET66.4300
FLARE66.4300
Cosmos Policy67.150
GlanceWAM (ours)72.250

Held-out scenes, 1,200 episodes. Selected rows; the full table is in the paper.

The lookahead is load-bearing

System (RoboCasa kitchen)SR (%)
Plain co-training (no lookahead)64.4
GlanceWAM, single-layer lookahead71.5
  same checkpoint, lookahead zeroed61.6
  retrained without mask47.0
GlanceWAM, multi-layer (final)72.2

Zeroing the lookahead at test time drops success below the no-lookahead baseline: the policy relies on it. One sampler step for the lookahead (71.2%) performs on par with ten (71.5%).

Real-robot evaluation

Real-robot success rates of GlanceWAM, pi0.5 and Fast-WAM on five tasks
Success of GlanceWAM, π0.5, and Fast-WAM over 50 trials per task on the IMETA Y1 platform. All policies are fine-tuned on the same 50 demonstrations per task; π0.5 is additionally pretrained on large-scale robot data, while GlanceWAM starts from an internet video prior.

What the model imagines

Observation, decoded lookahead, and the real frame 3 seconds later on simulated and real tasks
For each task: the observation ot, GlanceWAM's lookahead (decoded to RGB only for display), and the real frame 3 s later. Lookaheads get the target layout right while coarsening texture.

BibTeX

@article{wang2026glancewam,
  title         = {GlanceWAM: Sparse Test-Time Imagination for World-Action Models},
  author        = {Wang, Linhan and An, Zijian and Zhang, Mingyuan and Dai, Chen and Xu, Yi and
                   Cui, Can and Wang, Jiayan and Yang, Zichong and Chen, Yinlin and Zhou, Lifeng and
                   Lu, Chang-Tien},
  journal       = {arXiv preprint arXiv:2608.23927},
  eprint        = {2608.23927},
  archivePrefix = {arXiv},
  url           = {https://arxiv.org/abs/2608.23927},
  year          = {2026}
}