VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation

1 Physical SuperIntelligence Lab, University of Southern California

2 Department of Computer Science, Brown University

* Equal Contribution

Abstract

While recent video diffusion models produce visually impressive results, they fundamentally struggle to maintain 3D structural consistency, often resulting in object deformation or spatial drift. We hypothesize that these failures arise because standard denoising objectives lack explicit incentives for geometric coherence. To address this, we introduce **VideoGPA** (**Video** **G**eometric **P**reference **A**lignment), a data-efficient self-supervised framework that leverages geometry foundation model to automatically derive dense preference signals to guide VDMs via Direct Preference Optimization. This approach effectively steers the generative distribution toward inherent 3D consistency without requiring human annotations. VideoGPA significantly enhances temporal stability, phyiscal plausibility, and motion coherence using minimal preference pairs, consistently outperforming state-of-the-art baselines in extensive experiments.
VideoGPA Pipeline

Quantitative Benchmarks

Comprehensive results on 3D Reconstruction Error, 3D Geometric Consistency Metrics, and VideoReward Benchmark.

Method 3D Reconstruction Error 3D Consistency VideoReward (Win Rate %)
PSNR ↑SSIM ↑LPIPS ↓ MVCS ↑3DCS ↓Epipolar ↓ VQMQTAOVL
Image-to-Video (I2V) Tasks
Baseline-I2V14.570.4550.6530.9760.6870.706----
SFT15.230.5090.6390.9820.6650.62844.6733.0052.6735.00
Epipolar-DPO15.070.4790.6150.9840.6460.57167.3351.3356.6766.00
VideoGPA (Ours) 15.19 0.510 0.608 0.986 0.638 0.564 74.00 56.00 57.67 76.00
Text-to-Video (T2V) Tasks
Baseline-T2V17.530.6140.5080.9670.5330.584----
SFT17.070.5730.5630.9680.5860.71914.6723.6739.3315.33
Epipolar-DPO17.690.6180.5070.9710.5280.57945.0053.6749.0048.67
VideoGPA (Ours) 17.31 0.621 0.495 0.974 0.519 0.548 62.67 67.00 42.67 60.33
Comparison with State-of-the-Art
Baseline-T2V1515.570.4800.5550.9760.5880.685----
GeoVideo15.900.5100.6430.8520.6730.84017.3644.4430.5618.06
VideoGPA (Ours) 14.88 0.503 0.520 0.982 0.556 0.567 60.42 54.17 52.08 57.64
Note: 3DCS denotes our proposed 3D Consistency Score. VQ, MQ, TA, and OVL represent Visual Quality, Motion Quality, Text Alignment, and Overall, respectively. Filtered static videos as Training Stage.

Citation

                    Incoming