Fating Hong/洪发挺

fatinghonggmail.com;   fhongacconnect.ust.hk

Biography

Hi, I am currently a PhD student in the School of Engineering at the HKUST, advised by Prof. DAN XU. My research interest is about talking head generation and image generation. I received my master's Degree in 2021 at Sun Yat-sen University, where I was advised by Prof. Wei-Shi Zheng and researched in video understanding. Before SYSU, I have completed my B.E. supervised by Prof. Sheng Bi at the South China University of Technology where I was working on the SLAM of mobile robot.

Introduction

Hey, I am a 4th-year Ph.D. student in Computer Science at the Hong Kong University of Science and Technology (HKUST). My primary research interests lie in video generation, digital human and characters, and audio-visual learning. My work aims to enhance the capabilities of deep learning models to generate high-fidelity and temporally coherent digital human animation videos. By contributing to advancements in these fields, I hope to make a significant impact on applications such as teleconferencing, virtual reality, filmmaking, and the gaming industry.

Resume

Download Here

I'm seeking full-time positions/postdoc/intern starting in 2025 :)

Captured by my wife in Xinjiang, China

Education

  • 08/2021 ~ Present: PhD Student, Department of Computer Science & Engineering, Hong Kong University of Science and Technology
  • 09/2018 ~ 07/2021: Computer Science and Technology, Sun Yat-sen University
  • 09/2014 ~ 07/2018: Computer Science and Technology, South China University of Technology

Research interests

  • Audio-Driven Human Video Generation
  • Expression-Driven Human Video Generation
  • Human Animation Video Generation
  • Human Video Editing

News

  • (Feb 2025): 4 papers accepted by CVPR 2025, stay tuned (Almost here)!
  • (Dec 2024): Our paper AnyTalk is accepted by AAAI 2025, stay tuned!
  • (Oct 2024): Start my internship at Hunyuan, Tencent.
  • (Sep 2024): Our temporal action localization work is accepted by TCSVT (Finally).
  • (May 2024): Start my internship at Adobe, U.S.

Preprints

Identity-Preserving Video Dubbing Using Motion Warping

Runzhen Liu, Qinjie Lin, Yunfei Liu, Lijian Lin, Ye Zhu, Yu Li, Chuhua Xian Fa-Ting Hong

Under Review 2024

Learning Online Scale Transformation for Talking Head Video Generation.

Fa-Ting Hong, Dan Xu

ArXiv 2024

DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis.

Fa-Ting Hong, Yunfei Liu, Yu Li, Changyin Zhou, Fei Yu, Dan Xu

ArXiv 2024

Selected Publications

Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation

Shuling Zhao, Fa-Ting Hong, Xianshui Huang, Dan Xu

CVPR 2025

Free-viewpoint Human Animation with Pose-correlated Reference Selection

Fa-Ting Hong, Zhan Xu, Haiyang Liu, Qinjie Lin, Luchuan Song, Zhixin Shu, Yang Zhou, Duygu Ceylan, Dan Xu

CVPR 2025

Weakly-Supervised Temporal Action Localization by Progressive Complementary Learning.

Jia-Run Du, Jia-Chang Feng, Kun-Yu Lin, Fa-Ting Hong, ,Xiao-Ming Wu, Zhongang Qi, Ying Shan, Wei-Shi Zheng

TCSVT 2024

DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, , Li Shen, Dan Xu

TPAMI 2024

Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation

Fa-Ting Hong, , Dan Xu

ICCV 2023

Learning Relation Models to Detect Important People in Still Images

Yu-Kun Qiu, Fa-Ting Hong, , Wei-Hong Li, and Wei-Shi Zheng

TMM 2022

Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, , Longhao Zhang, Li Shen, Dan Xu

CVPR 2022

Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization

Fa-Ting Hong, , Jia-Chang Feng, Dan Xu, Ying Shan and Wei-Shi Zheng

ACM MM 2022

MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection

Jia-Chang Feng, Fa-Ting Hong, , Wei-Shi Zheng

CVPR 2021

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

Ling-An Zeng, Fa-Ting Hong, , Wei-Shi Zheng#, Qi-Zhi Yu, Wei Zeng, Yao-Wei Wang, and Jian-Huang Lai

ACM International Conference on Multimedia (ACM MM) 2020

MINI-Net: Multiple Instance Ranking Network for Video Highlight Detection

Fa-Ting Hong, , Xuanteng Huang, Wei-Hong Li, Wei-Shi Zheng

ECCV 2020

Learning to Detect Important People in Unlabelled Images for Semi-supervised Important People Detection

Fa-Ting Hong, , Wei-Hong Li, Wei-Shi Zheng

CVPR 2020

Learning to Learn Relation for Important People Detection in Still Images

Wei-Hong Li*, Fa-Ting Hong*, Wei-Shi Zheng

CVPR 2019

Intern Experience

Academic Services

  • Reviewer: ICLR, CVPR, ECCV, SIGGRAPH Asia, ACMMM, TPAMI, ICCV, NeurIPS, TMM, IJCV

Resume

Statistics