Fating Hong/洪发挺

fatinghonggmail.com;   fhongacconnect.ust.hk

Biography

Hi, I am currently a PhD student in the School of Engineering at the HKUST, advised by Prof. DAN XU. My research interest is about talking head generation and image generation. I received my master's Degree in 2021 at Sun Yat-sen University, where I was advised by Prof. Wei-Shi Zheng and researched in video understanding. Before SYSU, I have completed my B.E. supervised by Prof. Sheng Bi at the South China University of Technology where I was working on the SLAM of mobile robot.

Introduction

Hey, I am a 4th-year Ph.D. student in Computer Science at the Hong Kong University of Science and Technology (HKUST). My primary research interests lie in the areas of video generation and diffusion models, with a particular focus on image-driven and audio-driven digital human generation. My work aims to enhance the capabilities of deep learning models to generate high-fidelity and temporally coherent digital human animation videos. By contributing to advancements in these fields, I hope to make a significant impact on applications such as teleconferencing, virtual reality, filmmaking, and the gaming industry.

Resume

Download Here

I'm seeking full-time positions/postdoc/intern starting in 2025 :)

Captured by my wife in Xinjiang, China

Education

  • 08/2021 ~ Present: PhD Student, Department of Computer Science & Engineering, Hong Kong University of Science and Technology
  • 09/2018 ~ 07/2021: Computer Science and Technology, Sun Yat-sen University
  • 09/2014 ~ 07/2018: Computer Science and Technology, South China University of Technology

Research interests

  • Audio-Driven Human Video Generation
  • Expression-Driven Human Video Generation
  • Human Animation Video Generation
  • Human Video Editing

News

  • (Dec 2024): Our paper AnyTalk is accepted by AAAI 2025, stay tuned!
  • (Oct 2024): Start my internship at Hunyuan, Tencent.
  • (Sep 2024): Our temporal action localization work is accepted by TCSVT (Finally).
  • (May 2024): Start my internship at Adobe, U.S.

Preprints

Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation

Shuling Zhao, Fa-Ting Hong, Xianshui Huang, Dan Xu

ArXiv 2024

Learning Online Scale Transformation for Talking Head Video Generation.

Fa-Ting Hong, Dan Xu

ArXiv 2024

DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis.

Fa-Ting Hong, Yunfei Liu, Yu Li, Changyin Zhou, Fei Yu, Dan Xu

ArXiv 2024

Selected Publications

Weakly-Supervised Temporal Action Localization by Progressive Complementary Learning.

Jia-Run Du, Jia-Chang Feng, Kun-Yu Lin, Fa-Ting Hong, ,Xiao-Ming Wu, Zhongang Qi, Ying Shan, Wei-Shi Zheng

TCSVT 2024

DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, , Li Shen, Dan Xu

TPAMI 2024

Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation

Fa-Ting Hong, , Dan Xu

ICCV 2023

Learning Relation Models to Detect Important People in Still Images

Yu-Kun Qiu, Fa-Ting Hong, , Wei-Hong Li, and Wei-Shi Zheng

TMM 2022

Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, , Longhao Zhang, Li Shen, Dan Xu

CVPR 2022

Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization

Fa-Ting Hong, , Jia-Chang Feng, Dan Xu, Ying Shan and Wei-Shi Zheng

TMM 2022

MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection

Jia-Chang Feng, Fa-Ting Hong, , Wei-Shi Zheng

CVPR 2021

Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos

Ling-An Zeng, Fa-Ting Hong, , Wei-Shi Zheng#, Qi-Zhi Yu, Wei Zeng, Yao-Wei Wang, and Jian-Huang Lai

ACM International Conference on Multimedia (ACM MM) 2020

MINI-Net: Multiple Instance Ranking Network for Video Highlight Detection

Fa-Ting Hong, , Xuanteng Huang, Wei-Hong Li, Wei-Shi Zheng

ECCV 2020

Learning to Detect Important People in Unlabelled Images for Semi-supervised Important People Detection

Fa-Ting Hong, , Wei-Hong Li, Wei-Shi Zheng

CVPR 2020

Learning to Learn Relation for Important People Detection in Still Images

Wei-Hong Li*, Fa-Ting Hong*, Wei-Shi Zheng

CVPR 2019

Intern Experience

Academic Services

  • Reviewer: ICLR, CVPR, ECCV, SIGGRAPH Asia, ACMMM, TPAMI, ICCV, NeurIPS, TMM, IJCV

Resume

Statistics