Hongyang Du 杜泓洋
Logo Master's Student

Hi, I am Hongyang Du — a Sc.M. student in Computer Science at Brown University advised by Randall Balestriero. Currently I am collaborating with Yue Wang at the USC Physical SuperIntelligence Lab. I previously obtained my B.S. in Computer Science and Mathematics from the University of Maryland, College Park. My research explores how Self-Supervised Learning can build World Models for Robotic Control. I focus on extracting spatiotemporal and 3D-aware priors to capture physical dynamics and how to create a scalable loop that couples causal prediction and action prediction.

Outside of research, I am an amateur powerlifter 💪 and a pro drummer 🥁; I am a Jazz cat and prog metalhead — think Chick Corea meets Animals as Leaders. Also, I live with a cat named Dingzhen(丁真)🐱, who keeps me grounded.


Education
  • Brown University
    Brown University
    Department of Computer Science
    Master's Student
    Aug. 2025 - present
  • University of Maryland, College Park
    University of Maryland, College Park
    B.S. in Computer Science and Mathematics
    Aug. 2021 - May. 2025
Honors & Awards
  • Robert Ma Scholarship Recipent
    2024
  • Break Thhrough Tech Scholarship Recipent
    2021
News
2026
🎉 Papers on GoS and MM-Zero accepted to EMNLP 2026 Main Conference!
Aug 20
🏆 VideoGPA won 🥉 place in eBay sponsored Image-to-Video Consistent Generation Challenge!
Jun 04
🌴 Joined Adobe in San Jose to research Self-Evolving Agentic Image Gen!
May 26
🎉 Paper on VideoGPA accepted to ICML 2026!
Apr 30
2025
🎉 Paper on Video INR Compression accepted to WACV 2026!
Nov 11
🎉 Paper on VideoHallu accepted to NeurIPS 2025!
Sep 18
🐻 Starting the Sc.M. Computer Science Program at Brown University in Fall 2025
Sep 01
🐢 Graduated from University of Maryland, College Park with Bachelor’s in Computer Science (Honors) and Minor in Mathematics!
May 21
🎉 Paper on VLM Survey accepted to CVPR Workshop 2025 as Oral presentation!
Apr 08
2024
🐱 found me in the wild!
Jun 14
Selected Publications (view all )
Sonic-AMG: Streaming Human Motion Generation from Spatial Audio
Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

Jingcheng Ni, Zekun Li, Zhiyang Dou, Xiaoyan Cong, Ziyao Zeng, Hongyang Du, Randall Balestriero, Taku Komura, Srinath Sridhar

arXiv 2026

TL;DR: Generating human motion in real time as spatial audio arrives.

Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

Jingcheng Ni, Zekun Li, Zhiyang Dou, Xiaoyan Cong, Ziyao Zeng, Hongyang Du, Randall Balestriero, Taku Komura, Srinath Sridhar

arXiv 2026

TL;DR: Generating human motion in real time as spatial audio arrives.

FuseReg: Regularizing Layer Fusion Mitigates the Reconstruction-Generation Gap in Representation Autoencoders
FuseReg: Regularizing Layer Fusion Mitigates the Reconstruction-Generation Gap in Representation Autoencoders

Hongyang Du, Yunfei Xie, Junjie Ye, Jiawei Yang, Xiaoyan Cong, Haodong Zhang, Yongchao Huang, Haiyu Wu, Zongxia Li, Shihang Gui, Dawei Liu, Runhao Li, Jingcheng Ni, Chen Wei, Randall Balestriero, Yue Wang

arXiv 2026 #1 HuggingFace Daily Paper

TL;DR: A very simple regularization can mitigate the reconstruction-generation gap.

FuseReg: Regularizing Layer Fusion Mitigates the Reconstruction-Generation Gap in Representation Autoencoders

Hongyang Du, Yunfei Xie, Junjie Ye, Jiawei Yang, Xiaoyan Cong, Haodong Zhang, Yongchao Huang, Haiyu Wu, Zongxia Li, Shihang Gui, Dawei Liu, Runhao Li, Jingcheng Ni, Chen Wei, Randall Balestriero, Yue Wang

arXiv 2026 #1 HuggingFace Daily Paper

TL;DR: A very simple regularization can mitigate the reconstruction-generation gap.

Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design
Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design

Hongyang Du, Lan Yan, Christian Flores, Asim Kadav

NeurIPS 2026 Workshop CLEA Oral

TL;DR: A design agent that keeps learning new skills from real users without retraining.

Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design

Hongyang Du, Lan Yan, Christian Flores, Asim Kadav

NeurIPS 2026 Workshop CLEA Oral

TL;DR: A design agent that keeps learning new skills from real users without retraining.

Graph of Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills
Graph of Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills

Dawei Liu*, Zongxia Li*, Hongyang Du, Xiyang Wu, Shihang Gui, Yongbei Kuang, Lichao Sun (* equal contribution)

EMNLP 2026

TL;DR: Helping AI agents find just the skills they need from a huge skill library.

Graph of Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills

Dawei Liu*, Zongxia Li*, Hongyang Du, Xiyang Wu, Shihang Gui, Yongbei Kuang, Lichao Sun (* equal contribution)

EMNLP 2026

TL;DR: Helping AI agents find just the skills they need from a huge skill library.

MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data
MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data

Zongxia Li*, Hongyang Du*, Chengsong Huang*, Xiyang Wu, Lantao Yu, Yicheng He, Jing Xie, Xiaomin Wu, Zhichao Liu, Jiarui Zhang, Fuxiao Liu (* equal contribution)

EMNLP 2026

TL;DR: A vision-language model that improves itself without any training data.

MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data

Zongxia Li*, Hongyang Du*, Chengsong Huang*, Xiyang Wu, Lantao Yu, Yicheng He, Jing Xie, Xiaomin Wu, Zhichao Liu, Jiarui Zhang, Fuxiao Liu (* equal contribution)

EMNLP 2026

TL;DR: A vision-language model that improves itself without any training data.

VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation
VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation

Hongyang Du*, Junjie Ye*, Xiaoyan Cong*, Runhao Li, Jingcheng Ni, Aman Agarwal, Zeqi Zhou, Zekun Li, Randall Balestriero, Yue Wang (* equal contribution)

ICML 2026 CVPR VGBE Challenge 🏆 Oral

TL;DR: Using 3D geometry knowledge to make generated videos more 3D-consistent.

VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation

Hongyang Du*, Junjie Ye*, Xiaoyan Cong*, Runhao Li, Jingcheng Ni, Aman Agarwal, Zeqi Zhou, Zekun Li, Randall Balestriero, Yue Wang (* equal contribution)

ICML 2026 CVPR VGBE Challenge 🏆 Oral

TL;DR: Using 3D geometry knowledge to make generated videos more 3D-consistent.

How to Design and Train Your Implicit Neural Representation for Video Compression
How to Design and Train Your Implicit Neural Representation for Video Compression

Matthew Gwilliam, Roy Zhang, Namitha Padmanabhan, Hongyang Du, Abhinav Shrivastava

WACV 2026

TL;DR: A practical guide to designing and training neural networks that compress videos.

How to Design and Train Your Implicit Neural Representation for Video Compression

Matthew Gwilliam, Roy Zhang, Namitha Padmanabhan, Hongyang Du, Abhinav Shrivastava

WACV 2026

TL;DR: A practical guide to designing and training neural networks that compress videos.

VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations for Synthetic Videos
VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations for Synthetic Videos

Zongxia Li*, Xiyang Wu*, Yubin Qin, Hongyang Du, Guangyao Shi, Dinesh Manocha, Tianyi Zhou, Jordan Lee Boyd-Graber (* equal contribution)

NeurIPS 2025

TL;DR: A benchmark showing that AI models still miss obvious errors in AI-generated videos.

VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations for Synthetic Videos

Zongxia Li*, Xiyang Wu*, Yubin Qin, Hongyang Du, Guangyao Shi, Dinesh Manocha, Tianyi Zhou, Jordan Lee Boyd-Graber (* equal contribution)

NeurIPS 2025

TL;DR: A benchmark showing that AI models still miss obvious errors in AI-generated videos.

Ipelets for the Convex Polygonal Geometry
Ipelets for the Convex Polygonal Geometry

Nithin Parepally, Ainesh Chatterjee, Auguste Gezalyan, Hongyang Du, Sukrit Mangla, Kenny Wu, Sarah Hwang, David Mount

40th International Symposium on Computational Geometry (SoCG) 2024

TL;DR: New Ipe plugins for drawing and exploring convex polygon geometry.

Ipelets for the Convex Polygonal Geometry

Nithin Parepally, Ainesh Chatterjee, Auguste Gezalyan, Hongyang Du, Sukrit Mangla, Kenny Wu, Sarah Hwang, David Mount

40th International Symposium on Computational Geometry (SoCG) 2024

TL;DR: New Ipe plugins for drawing and exploring convex polygon geometry.

All publications