Retrieving and Refining Winning Noise Tickets
for Diffusion-Based Motion Generation

ECCV 2026
1Institute of Science Tokyo 2LY Corporation 3National Institute of Informatics
Winning Noise Ticket Hypothesis for motion
The Winning Noise Ticket Hypothesis for motion. Certain initial noises inherently encode motion semantics, producing meaningful motion even under a null prompt (right), while others yield static poses regardless of conditioning (left). WINRO retrieves and refines such tickets to improve text-motion alignment.

Abstract

Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text. Motion is inherently temporal, especially in compositional and long-duration sequences that require semantic consistency across multiple action segments and smooth kinematic transitions throughout the trajectory. We posit that the initial noise is central to this consistency: within the Gaussian noise space, certain instances, i.e. winning noise tickets, carry latent structure that biases denoising toward particular motion semantics, even under null prompts.

We propose WInning Noise Retrieval and Optimization (WINRO), a training-free, model-agnostic framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling. WINRO maps random noises to motion features generated under null prompts, retrieves the best-aligned noise for a given text, and refines it via a KL-regularized objective that reduces the residual semantic gap while preserving the Gaussian prior. An optional LoRA-based adapter amortizes this refinement into a single forward pass.

WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining, improves temporal robustness on the MTT benchmark, and generalizes to applications such as motion stylization and spatial constraint satisfaction.

Method

Overview of Winning Noise Ticket Retrieval
Winning Noise Ticket Retrieval. The input text retrieves the best-aligned noise from a dictionary of noise-feature pairs built under null prompts.
Overview of Winning Noise Ticket Refinement
Winning Noise Ticket Refinement. The retrieved noise is further refined with a KL-regularized objective that preserves the Gaussian prior.

WINRO is training-free and model-agnostic: it operates purely on the initial noise, before diffusion sampling.

  1. Dictionary construction. Motions are generated from random noises under null prompts, and each noise is paired with the feature of the motion it produces.
  2. Retrieval. For a given text prompt, the best-aligned noise (a winning ticket) is retrieved by cosine similarity in the feature space.
  3. Refinement. The retrieved noise is optimized to further improve text-motion alignment, with a KL regularizer that preserves the Gaussian prior.
  4. (Optional) LoRA refiner. A lightweight adapter predicts the noise correction in a single forward pass, enabling real-time use.

Interactive Results

All results below are rendered as interactive 3D stick figures. Drag inside a viewer to rotate the camera. The red line traces the root trajectory on the ground.

Drag = Rotate | Scroll = Zoom | Right-drag = Pan

Text-to-Motion Generation

Random vs. retrieved vs. optimized initial noise, with the same prompt and the same frozen diffusion model (MDM).

Loading motion data…

Motion Stylization

Given a style reference motion, WINRO improves how faithfully SMooDi transfers the style.

Loading motion data…

Spatial Constraint

Combined with ProgMoGen, WINRO helps satisfy spatial goals such as reaching target positions and avoiding obstacles, while keeping the motion natural.

Position Constraint

Loading motion data…

Obstacle Avoidance

Loading motion data…

Temporal Composition (MTT)

Multiple text prompts are composed over time and body parts. The timeline below shows which sub-prompts are active at each moment.

Loading motion data…

BibTeX

@inproceedings{ota2026winro,
      title     = {Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation},
      author    = {Ota, Sakuya and Yu, Qing and Fujiwara, Kent and Ikehata, Satoshi and Sato, Ikuro},
      booktitle = {European Conference on Computer Vision (ECCV)},
      year      = {2026}
      }