PWM

Project demonstrations

PWM: Personalized World Models with Online Reinforcement Learning

Zhexin Lou1* Guancheng Lu2* Zeyu Zhang1*† Yi Zhang1 Yang Zhao3 Hao Tang1‡

1 School of Computer Science, Peking University 2 Northwestern University 3 La Trobe University

* Equal contribution. † Project lead. ‡ Corresponding author.

Paper Code Model Benchmark

Comparison rollouts across indoor, outdoor, and gaming environments, showing ground truth and learned world-model predictions side by side.

Method

Scene customization workflow and comparisons of support videos, Yume, and PWM across indoor, outdoor, and gaming scenes.
Scene customization with PWM. A short support video trains a scene LoRA on a frozen world model. Results use DanceGRPO. Indoor and Outdoor show matched generation times; Gaming shows different steps at similar viewing distances.
PWM training and generation workflow using a frozen Yume-5B backbone, a trainable scene LoRA, online rollouts, and DanceGRPO or DiffusionNFT.
PWM with GRPO and DiffusionNFT. Support video and controls condition fresh rollouts from frozen Yume-5B with a trainable scene LoRA. Rewards guide GRPO's clipped objective with a base-policy anchor, or DiffusionNFT's reward-weighted positive and negative flow-matching branches. Only LoRA parameters are updated. Eight epoch adapters are averaged for generation. Rollout icons are schematic.

Comparison

Three subsets · five rollouts each

Subset 01

Indoor

5 comparison videos
it04_s42Indoor comparison

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W). The camera pans to the right (→).

yw02_s777Indoor comparison

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W).

yw04_s123Indoor comparison

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W).

yw08_s123Indoor comparison

A first-person walking scene in an indoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

yw12_s777Indoor comparison

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Subset 02

Outdoor

5 comparison videos
nd145-38_s123Outdoor comparison

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

nd145-61_s42Outdoor comparison

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective.

nd145-70_s42Outdoor comparison

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective.

nd145-73_s42Outdoor comparison

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective. The camera pushes forward (W).

oadd07_s777Outdoor comparison

A first-person walking scene in an outdoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Subset 03

Gaming

5 comparison videos
mcnr63_s42Gaming comparison

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

mcrl37_s777Gaming comparison

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The camera pans to the left (←).

mcrl39_s42Gaming comparison

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The camera pans to the left (←).

mcnr06_s777Gaming comparison

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward and moves left (W+A). The rotation direction of the camera remains stationary (·).

mcrl01_s777Gaming comparison

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

PWM-Bench

5 indoor · 5 outdoor · 5 gaming
INDOOR
Indoor 01PWM-Bench

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Indoor 02PWM-Bench

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Indoor 03PWM-Bench

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Indoor 04PWM-Bench

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W).

Indoor 05PWM-Bench

A first-person walking scene captured from a head-mounted camera in an indoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

OUTDOOR
Outdoor 01PWM-Bench

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective.

Outdoor 02PWM-Bench

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Outdoor 03PWM-Bench

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective.

Outdoor 04PWM-Bench

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Outdoor 05PWM-Bench

A first-person walking scene captured from a head-mounted camera in an outdoor environment. First-person perspective. The camera pushes forward (W). The camera pans to the right (→).

GAMING
Gaming 01PWM-Bench

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Gaming 02PWM-Bench

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward and moves left (W+A). The rotation direction of the camera remains stationary (·).

Gaming 03PWM-Bench

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Gaming 04PWM-Bench

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward (W). The rotation direction of the camera remains stationary (·).

Gaming 05PWM-Bench

First-person Minecraft gameplay walking across natural terrain in clear daylight. First-person perspective. The camera pushes forward and moves left (W+A). The rotation direction of the camera remains stationary (·).