Fating Hong/洪发挺

fatinghonggmail.com;   fhongacconnect.ust.hk

Biography

Hi, I am currently a PhD student in the School of Engineering at the HKUST, advised by Prof. DAN XU. My research interest is about talking head generation and image generation. I received my master's Degree in 2021 at Sun Yat-sen University, where I was advised by Prof. Wei-Shi Zheng and researched in video understanding.

Introduction

Hey, I am a final-year Ph.D. student in Computer Science at the Hong Kong University of Science and Technology (HKUST). My primary research interests lie in video generation, digital human and characters, and audio-visual learning. My work aims to enhance the capabilities of deep learning models to generate high-fidelity and temporally coherent digital human animation videos. By contributing to advancements in these fields, I hope to make a significant impact on applications such as teleconferencing, virtual reality, filmmaking, and the gaming industry.

Resume

Download Here

I'm seeking full-time positions/postdoc starting in 2026 :)

Captured by my wife in Xinjiang, China

Education

  • 08/2021 ~ Present: PhD Student, Department of Computer Science & Engineering, Hong Kong University of Science and Technology
  • 09/2018 ~ 07/2021: Computer Science and Technology, Sun Yat-sen University
  • 09/2014 ~ 07/2018: Computer Science and Technology, South China University of Technology

Research interests

  • Audio-Driven Human Video Generation
  • Expression-Driven Human Video Generation
  • Human Animation Video Generation
  • Human Video Editing

News

  • (Feb 2025): 4 papers accepted by CVPR 2025, stay tuned (Almost here)!
  • (Dec 2024): Our paper AnyTalk is accepted by AAAI 2025, stay tuned!
  • (Oct 2024): Start my internship at Hunyuan, Tencent.
  • (Sep 2024): Our temporal action localization work is accepted by TCSVT (Finally).
  • (May 2024): Start my internship at Adobe, U.S.

Preprints

Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modelling for Natural Talking Head Generation

Fa-Ting Hong, Zunnan Xu, Zixiang Zhou, Jun Zhou, Xiu Li, Qin Lin, Qinglin Lu, Dan Xu

Under Review 2025

Code | ArXiv | Project Page
GitHub stars GitHub forks GitHub issues

Identity-Preserving Video Dubbing Using Motion Warping

Runzhen Liu, Qinjie Lin, Yunfei Liu, Lijian Lin, Ye Zhu, Yu Li, Chuhua Xian Fa-Ting Hong

Under Review 2024

ArXiv

Learning Online Scale Transformation for Talking Head Video Generation.

Fa-Ting Hong, Dan Xu

ArXiv 2024

Paper

DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis.

Fa-Ting Hong, Yunfei Liu, Yu Li, Changyin Zhou, Fei Yu, Dan Xu

ArXiv 2024

Paper

Selected Publications

HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animation

Zunnan Xu, Zhentao Yu, Zixiang Zhou, Jun Zhou, Xiaoyu Jin, Fa-Ting Hong, Xiaozhong Ji, Junwei Zhu, Chengfei Cai, Shiyu Tang, Qin Lin, Xiu Li, Qinglin Lu

CVPR 2025

Code | ArXiv | Project Page

FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Model

Jun Zhou, Jiahao Li, Zunnan Xu, Hanhui Li, Yiji Cheng, Fa-Ting Hong, Qin Lin, Qinglin Lu, Xiaodan Liang

CVPR 2025

ArXiv | Project Page

AnyTalk: Multi-modal Driven Multi-domain Talking Head Generation

Yu Wang, Yunfei Liu, Fa-Ting Hong, Meng Cao, Lijian Lin, Yu Li

AAAI 2025

ArXiv

Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation

Shuling Zhao, Fa-Ting Hong, Xianshui Huang, Dan Xu

CVPR 2025

Code | ArXiv | Project Page

Free-viewpoint Human Animation with Pose-correlated Reference Selection

Fa-Ting Hong, Zhan Xu, Haiyang Liu, Qinjie Lin, Luchuan Song, Zhixin Shu, Yang Zhou, Duygu Ceylan, Dan Xu

CVPR 2025 (Highlight, 13.5% of accepted papers)

Code | ArXiv | Project Page

Weakly-Supervised Temporal Action Localization by Progressive Complementary Learning.

Jia-Run Du, Jia-Chang Feng, Kun-Yu Lin, Fa-Ting Hong, Xiao-Ming Wu, Zhongang Qi, Ying Shan, Wei-Shi Zheng

TCSVT 2024

Paper

DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, Li Shen, Dan Xu

TPAMI 2024

Paper

Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation

Fa-Ting Hong, Dan Xu

ICCV 2023

Code | Paper | Project Page
GitHub stars GitHub forks GitHub issues

Learning Relation Models to Detect Important People in Still Images

Yu-Kun Qiu, Fa-Ting Hong, Wei-Hong Li, and Wei-Shi Zheng

TMM 2022

Paper

Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, Longhao Zhang, Li Shen, Dan Xu

CVPR 2022

Code | Paper | Project Page
GitHub stars GitHub forks GitHub issues

Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization

Fa-Ting Hong, Jia-Chang Feng, Dan Xu, Ying Shan and Wei-Shi Zheng

ACM MM 2022

Code | Paper Project Page
GitHub stars GitHub forks GitHub issues

MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection

Jia-Chang Feng, Fa-Ting Hong, Wei-Shi Zheng

CVPR 2021

Code | Paper | Project Page
GitHub stars GitHub forks GitHub issues

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

Ling-An Zeng, Fa-Ting Hong, Wei-Shi Zheng#, Qi-Zhi Yu, Wei Zeng, Yao-Wei Wang, and Jian-Huang Lai

ACM International Conference on Multimedia (ACM MM) 2020

Code | Paper
GitHub stars GitHub forks GitHub issues

MINI-Net: Multiple Instance Ranking Network for Video Highlight Detection

Fa-Ting Hong, Xuanteng Huang, Wei-Hong Li, Wei-Shi Zheng

ECCV 2020

Code | Paper | Project Page
GitHub stars GitHub forks GitHub issues

Learning to Detect Important People in Unlabelled Images for Semi-supervised Important People Detection

Fa-Ting Hong, , Wei-Hong Li, Wei-Shi Zheng

CVPR 2020

Code | Paper |
GitHub stars GitHub forks GitHub issues

Learning to Learn Relation for Important People Detection in Still Images

Wei-Hong Li*, Fa-Ting Hong*, Wei-Shi Zheng

CVPR 2019

Code | Paper
GitHub stars GitHub forks GitHub issues

Intern Experience

Academic Services

  • Reviewer: ICLR, CVPR, ECCV, SIGGRAPH Asia, ACMMM, TPAMI, ICCV, NeurIPS, TMM, IJCV

Resume

Statistics