Publications

Also on Google Scholar. Bold marks me; click BibTeX to copy a citation.

2026

arXiv

Decoding Looped Transformers Better for (Almost) Free

Weihao Liu, Huangjie Zheng, Tianrong Chen, Rohit Dilip, Richard He Bai, Yizhu Jiao, Yuyang Wang, Ruixiang Zhang

arXiv preprint arXiv:2610.02185, 2026

arXiv

Witness: Discovery, Deciphering, and Epiphany in Interactive Puzzle Environments

Guanghan Ning, Ping Liu, Linyi Li, Huangjie Zheng, Arjun Neervannan, Huu Nguyen, Michael Sklar, Deniz Zorlu, Nicolai Ouporov

arXiv preprint arXiv:2609.32208, 2026

arXiv

Roll Out and Roll Back: Diffusion LLMs are Their Own Efficiency Teachers

Fanqin Zeng, Feng Hong, Geng Yu, Huangjie Zheng, Xiaofeng Cao, Ya Zhang, Bo Han, Yanfeng Wang, Jiangchao Yao

arXiv preprint arXiv:2605.16941, 2026

arXiv

Embarrassingly Simple Self-Distillation Improves Code Generation

Ruixiang Zhang, Richard He Bai, Huangjie Zheng, Navdeep Jaitly, Ronan Collobert, Yizhe Zhang

arXiv preprint arXiv:2604.01193, 2026

arXiv

Rejection Mixing: Fast Semantic Propagation of Mask Tokens for Efficient DLLM Inference

Yushi Ye, Feng Hong, Huangjie Zheng, Xu Chen, Zhiyong Chen, Yanfeng Wang, Jiangchao Yao

arXiv preprint arXiv:2602.22868, 2026

ICLR 2026

Continuously Augmented Discrete Diffusion Model for Categorical Generative Modeling

Huangjie Zheng, Shansan Gong, Ruixiang Zhang, Tianrong Chen, Jiatao Gu, Mingyuan Zhou, Navdeep Jaitly, Yizhe Zhang

International Conference on Learning Representations (ICLR), 2026

ICLR 2026

Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs

Feng Hong, Geng Yu, Yushi Ye, Haicheng Huang, Huangjie Zheng, Ya Zhang, Yanfeng Wang, Jiangchao Yao

International Conference on Learning Representations (ICLR), 2026

ICLR 2026

DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation

Shansan Gong, Ruixiang Zhang, Huangjie Zheng, Jiatao Gu, Navdeep Jaitly, Lingpeng Kong, Yizhe Zhang

International Conference on Learning Representations (ICLR), 2026

2025

arXiv

Score Distillation of Flow Matching Models

Mingyuan Zhou, Yi Gu, Huangjie Zheng, Liangchen Song, Guande He, Yizhe Zhang, Wenze Hu, Yinfei Yang

arXiv preprint arXiv:2509.25127, 2025

NeurIPS 2025

Generative Data Augmentation via Diffusion Distillation, Adversarial Alignment, and Importance Reweighting

Ruyi An, Haicheng Huang, Huangjie Zheng, Mingyuan Zhou

Advances in Neural Information Processing Systems (NeurIPS), 2025

ASRU 2025

ChipChat: Low-Latency Cascaded Conversational Agent in MLX

Tatiana Likhomanenko, Richard He Bai, Zijin Gu, Zakaria Aldeneh, Shiladitya Dutta, Luke Carlson, Han Tran, Yizhe Zhang, Ruixiang Zhang, Huangjie Zheng, Navdeep Jaitly

IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), 2025

NeurIPS 2025

Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flows

Ruixiang Zhang, Shuangfei Zhai, Jiatao Gu, Yizhe Zhang, Huangjie Zheng, Tianrong Chen, Miguel Angel Bautista, Josh Susskind, Navdeep Jaitly

Advances in Neural Information Processing Systems (NeurIPS), 2025

NeurIPS 2025

TADA: Improved Diffusion Sampling with Training-free Augmented Dynamics

Tianrong Chen, Huangjie Zheng, David Berthelot, Jiatao Gu, Josh Susskind, Shuangfei Zhai

Advances in Neural Information Processing Systems (NeurIPS), 2025

NeurIPS 2025 Spotlight

STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesis

Jiatao Gu, Tianrong Chen, David Berthelot, Huangjie Zheng, Yuyang Wang, Ruixiang Zhang, Laurent Dinh, Miguel Angel Bautista, Josh Susskind, Shuangfei Zhai

Advances in Neural Information Processing Systems (NeurIPS) (Spotlight), 2025

ICML 2025 Oral

Normalizing Flows are Capable Generative Models

Shuangfei Zhai, Ruixiang Zhang, Preetum Nakkiran, David Berthelot, Jiatao Gu, Huangjie Zheng, Tianrong Chen, Miguel Angel Bautista, Navdeep Jaitly, Josh Susskind

International Conference on Machine Learning (ICML) (Oral), 2025

ICLR 2025

Adversarial Score Identity Distillation: Rapidly Surpassing the Teacher in One Step

Mingyuan Zhou, Huangjie Zheng, Yi Gu, Zhendong Wang, Hai Huang

International Conference on Learning Representations (ICLR), 2025

2024

TCSVT 2024

Modality-Consistent Prompt Tuning with Optimal Transport

Hairui Ren, Fan Tang, Huangjie Zheng, He Zhao, Dandan Guo, Yi Chang

IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2024

ICME 2024

MVTexGen: Synthesising 3D Textures Using Multi-view Diffusion

Jinyi Wang, Fei Ben, Huangjie Zheng, Jiangchao Yao, Ya Zhang, Yanfeng Wang

IEEE International Conference on Multimedia and Expo (ICME), 2024

arXiv

What If We Recaption Billions of Web Images with LLaMA-3?

Xianhang Li, Haoqin Tu, Mude Hui, Zeyu Wang, Bingchen Zhao, Junfei Xiao, Sucheng Ren, Jieru Mei, Qing Liu, Huangjie Zheng, Yuyin Zhou, Cihang Xie

arXiv preprint arXiv:2406.08478, 2024

arXiv

Guided Score Identity Distillation for Data-Free One-Step Text-to-Image Generation

Mingyuan Zhou, Zhendong Wang, Huangjie Zheng, Hai Huang

arXiv preprint arXiv:2406.01561, 2024

ICML 2024

Score Identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation

Mingyuan Zhou, Huangjie Zheng, Zhendong Wang, Mingzhang Yin, Hai Huang

International Conference on Machine Learning (ICML), 2024

ICLR 2024

Long-tailed Diffusion Models with Oriented Calibration

Tianjiao Zhang, Huangjie Zheng, Jiangchao Yao, Xiangfeng Wang, Mingyuan Zhou, Ya Zhang, Yanfeng Wang

International Conference on Learning Representations (ICLR), 2024

ICLR 2024

Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling

Huangjie Zheng, Zhendong Wang, Jianbo Yuan, Guanghan Ning, Pengcheng He, Quanzeng You, Hongxia Yang, Mingyuan Zhou

International Conference on Learning Representations (ICLR), 2024

2023

arXiv

InfiMM-Eval: Complex Open-Ended Reasoning Evaluation for Multi-Modal Large Language Models

Xiaotian Han, Quanzeng You, Yongfei Liu, Wentao Chen, Huangjie Zheng, Khalil Mrini, Xudong Lin, Yiqi Wang, Bohan Zhai, Jianbo Yuan, Heng Wang, Hongxia Yang

arXiv preprint arXiv:2311.11567, 2023

NeurIPS 2023

Beta Diffusion

Mingyuan Zhou, Tianqi Chen, Zhendong Wang, Huangjie Zheng

Advances in Neural Information Processing Systems (NeurIPS), 2023

TMLR 2023

Contrastive Attraction and Contrastive Repulsion for Representation Learning

Huangjie Zheng, Xu Chen, Jiangchao Yao, Hongxia Yang, Chunyuan Li, Ya Zhang, Hao Zhang, Ivor Tsang, Jingren Zhou, Mingyuan Zhou

Transactions on Machine Learning Research (TMLR), 2023

ICML 2023

POUF: Prompt-Oriented Unsupervised Fine-tuning for Large Pre-trained Models

Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng, Pengcheng He, Mingyuan Zhou

International Conference on Machine Learning (ICML), 2023

CVPR 2023

Class-Balancing Diffusion Models

Yiming Qin, Huangjie Zheng, Jiangchao Yao, Mingyuan Zhou, Ya Zhang

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023

NeurIPS 2023

Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models

Zhendong Wang, Yifan Jiang, Huangjie Zheng, Peihao Wang, Pengcheng He, Zhangyang Wang, Weizhu Chen, Mingyuan Zhou

Advances in Neural Information Processing Systems (NeurIPS), 2023

arXiv

Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, Alleviate Janus Problem and Beyond

Mohammadreza Armandpour, Ali Sadeghian, Huangjie Zheng, Amir Sadeghian, Mingyuan Zhou

arXiv preprint arXiv:2304.04968, 2023

CVPR 2023

DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration

Zhixin Wang, Xiaoyun Zhang, Ziying Zhang, Huangjie Zheng, Mingyuan Zhou, Ya Zhang, Yanfeng Wang

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023

ICLR 2023

Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

International Conference on Learning Representations (ICLR), 2023

ICLR 2023

Diffusion-GAN: Training GANs with Diffusion

Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

International Conference on Learning Representations (ICLR), 2023

2022

NeurIPS 2022

CARD: Classification and Regression Diffusion Models

Xizewen Han, Huangjie Zheng, Mingyuan Zhou

Advances in Neural Information Processing Systems (NeurIPS), 2022

arXiv

Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

arXiv preprint arXiv:2202.06510, 2022

ICLR 2022

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Dongsheng Wang, Dandan Guo, He Zhao, Huangjie Zheng, Korawat Tanwisuth, Bo Chen, Mingyuan Zhou

International Conference on Learning Representations (ICLR), 2022

2021

NeurIPS 2021

Exploiting Chain Rule and Bayes' Theorem to Compare Probability Distributions

Huangjie Zheng, Mingyuan Zhou

Advances in Neural Information Processing Systems (NeurIPS), 2021

NeurIPS 2021

Alignment Attention by Matching Key and Query Distributions

Shujian Zhang, Xinjie Fan, Huangjie Zheng, Korawat Tanwisuth, Mingyuan Zhou

Advances in Neural Information Processing Systems (NeurIPS), 2021

NeurIPS 2021

A Prototype-Oriented Framework for Unsupervised Domain Adaptation

Korawat Tanwisuth, Xinjie Fan, Huangjie Zheng, Shujian Zhang, Hao Zhang, Bo Chen, Mingyuan Zhou

Advances in Neural Information Processing Systems (NeurIPS), 2021

2020

arXiv

MCMC-Interactive Variational Inference

Quan Zhang, Huangjie Zheng, Mingyuan Zhou

arXiv preprint arXiv:2010.02029, 2020

TPAMI 2020

Learning on Attribute-Missing Graphs

Xu Chen, Siheng Chen, Jiangchao Yao, Huangjie Zheng, Ya Zhang, Ivor W. Tsang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020

2019

AAAI 2019

Understanding VAEs in Fisher-Shannon Plane

Huangjie Zheng, Jiangchao Yao, Ya Zhang, Ivor W. Tsang, Jia Wang

AAAI Conference on Artificial Intelligence (AAAI), 2019

CVPR 2019

Elastic Boundary Projection for 3D Medical Image Segmentation

Tianwei Ni, Lingxi Xie, Huangjie Zheng, Elliot K. Fishman, Alan L. Yuille

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019

2018

arXiv

Phase Collaborative Network for Multi-Phase Medical Imaging Segmentation

Huangjie Zheng, Lingxi Xie, Tianwei Ni, Ya Zhang, Yan-Feng Wang, Qi Tian, Elliot K. Fishman, Alan L. Yuille

arXiv preprint arXiv:1811.11814, 2018

TrustCom 2018

Learning and Applying Ontology for Machine Learning in Cyber Attack Detection

Huangjie Zheng, Yuchen Wang, Chen Han, Fangjie Le, Ruan He, Jialiang Lu

IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom/BigDataSE), 2018

arXiv

Degeneration in VAE: in the Light of Fisher Information Loss

Huangjie Zheng, Jiangchao Yao, Ya Zhang, Ivor W. Tsang

arXiv preprint arXiv:1802.06677, 2018

2017

MMM 2017

Describing Geographical Characteristics with Social Images

Huangjie Zheng, Jiangchao Yao, Ya Zhang

International Conference on Multimedia Modeling (MMM), 2017