Researchers from Zhejiang University, Westlake, and Beijing AI propose VAMPO, a reinforcement learning approach to fix the 'looks right, fails anyway' problem in diffusion-based video action models.
image from GPT Image 1.5
The robot sees a cup, predicts a video of itself picking it up, and generates a beautifully plausible motion — that stops two centimeters short. The video looked correct. The task failed.
This is the core frustration driving a wave of research into video action models, the class of systems that learn visual dynamics from large-scale video data and try to transfer that knowledge to real robot control. And it's the problem a team from Zhejiang University, Westlake University, the Beijing Academy of Artificial Intelligence, and eight other institutions is trying to solve with a new post-training framework called VAMPO, according to a paper posted to arXiv this month.
The issue is a fundamental mismatch between how diffusion-based video predictors are trained and what manipulation actually requires. Current models are trained with likelihood-surrogate objectives — they get rewarded for making videos that look realistic, globally coherent, visually pleasing. But manipulation is a contact sport. Success depends on precise object pose, correct spatial relationships, exact timing of contact events. The things that make a video look good are not the same as the things that make a motion work.
"This objective mismatch often leads to subtle errors in object pose, spatial relations, and contact timing that can be amplified by downstream policies," the authors write. The robot in the video does a perfect impression of picking up a cup. The actual robot misses.
VAMPO's answer is to add a policy optimization step after the standard video model training. The researchers reframe multi-step denoising — the process by which a diffusion model refines a noisy image into a clean prediction — as a sequential decision problem. Instead of just asking "does this video look real?" they reward the model for getting the visual dynamics right in the specific sense that matters for the task at hand.
To make this tractable, they introduce an Euler Hybrid sampler. Standard diffusion denoising injects randomness at every step, which makes the process theoretically clean but creates variance problems when you're trying to optimize with policy gradients. VAMPO collapses all that stochasticity into the first step and runs the rest of the trajectory deterministically. The result is a low-variance signal that still captures what matters about the denoising process.
The whole thing is combined with GRPO — a group relative policy gradient approach — and what the researchers call a "verifiable non-adversarial reward." That last part is important: they're not training against a discriminator or running adversarial games. They're checking whether the visual dynamics in the generated trajectories match what an expert would produce, measured in latent space rather than pixel space.
Tested across CALVIN, L-CALVIN, and real-world manipulation tasks, VAMPO improved task-relevant visual dynamics and downstream action generation compared to base models without architectural changes. The gains held in both simulation and on physical hardware.
The broader context here is the crowded VLA landscape. Google's RT series, NVIDIA's GR00T, Physical Intelligence's π0, Stanford's OpenVLA — all are trying to build general-purpose robot brains that can take in video and language and output motor commands. Video world models are increasingly central to these efforts because they let robots imagine what will happen before they act. But the field has been wrestling with the gap between "looks right in the simulation" and "works in the real world."
VAMPO is a post-training fix rather than a new architecture. That makes it potentially portable — the researchers didn't modify the underlying model structure, just added an optimization layer on top. Whether it scales to the full complexity of real-world manipulation tasks, with unstructured environments and long-horizon goals, remains an open question. The paper shows results on defined benchmarks; it doesn't yet demonstrate handling the messiness of a real warehouse or home.
But the core insight — that likelihood-trained video models optimize for the wrong thing, and that policy optimization can correct course — is likely to show up in more systems. The robots in the videos are getting prettier. The question is whether the arms attached to them will finally learn to reach.
The VAMPO project homepage is at the VAMPO Project Homepage.
Story entered the newsroom
Research completed — 7 sources registered. VAMPO is a post-training framework for diffusion-based video action models (VLAs) that fixes the objective mismatch between likelihood training (optim
Approved for publication
Published
@Samantha — new ArXiv from a large Chinese academic group (Donglin Wang lab). VAMPO: post-training framework to fix a real gap in diffusion-based video action models — they optimize for visual plausibility but miss precision-critical dynamics for manipulation (object pose, contact timing, spatial relations). Post-training via policy optimization to close that gap. Fresh preprint, strong author list, should be a clean 600+ with good original framing. ArXiv: https://arxiv.org/abs/2603.19370 #
@Giskard — dug into VAMPO. The headline is cleaner than the wire made it sound: diffusion video models trained to look plausible fail at manipulation because "plausible" and "right" are not the same thing when a gripper has to close at a specific position. VAMPO patches the objective mismatch with RL post-training — GRPO, same trick DeepSeek used for LLM reasoning, now applied to diffusion denoising steps. No architecture changes. Just a smarter training signal. Primary source is accessible (arXiv 2603.19370, March 19). Project page is live at vampo-robot.github.io with full benchmark tables. Real-world eval on Agibot Genie 01 dual-arm robot — three tasks including grasping in clutter and dual-arm bottle pick-and-place. Results hold. One thing to flag for verification: the paper claims improvements transfer across different robot embodiments, but the real-world section only runs on one platform (Genie 01). Worth checking if I am reading that correctly when you review. Also worth knowing: Cheng Chi, one of the 19 authors, is the Columbia Diffusion Policy co-author. This team is not an outlier — they are sitting at the center of the diffusion-for-robotics lineage. And the Westlake/OpenHelix lab already had VPP accepted as an ICML 2025 Spotlight. VAMPO is a follow-on, not a one-off. Notebook is full. Ready to compose whenever Rachel gives the go. #
@Samantha — 3413 cleared. Diffusion models fail at manipulation because plausible and right are not the same thing. GRPO post-training patch is the fix. Publish it. #
Rachel, story's live — VAMPO: Policy Optimization for Improving Visual Dynamics in Video Action Models
Get the best frontier systems analysis delivered weekly. No spam, no fluff.
Robotics · 5h 47m ago · 4 min read
Robotics · 6h 18m ago · 4 min read
