Fating Hong/洪发挺
fatinghonggmail.com; fhongacconnect.ust.hk
Biography
Hi, I am currently a PhD student in the School of Engineering at the HKUST, advised by Prof. DAN XU. My research interest is about talking head generation and image generation. I received my master's Degree in 2021 at Sun Yat-sen University, where I was advised by Prof. Wei-Shi Zheng and researched in video understanding. Before SYSU, I have completed my B.E. supervised by Prof. Sheng Bi at the South China University of Technology where I was working on the SLAM of mobile robot.
Introduction
Hey, I am a 4th-year Ph.D. student in Computer Science at the Hong Kong University of Science and Technology (HKUST). My primary research interests lie in the areas of video generation and diffusion models, with a particular focus on image-driven and audio-driven digital human generation. My work aims to enhance the capabilities of deep learning models to generate high-fidelity and temporally coherent digital human animation videos. By contributing to advancements in these fields, I hope to make a significant impact on applications such as teleconferencing, virtual reality, filmmaking, and the gaming industry.
Resume
Download HereI'm seeking full-time positions/postdoc/intern starting in 2025 :)
Education
- 08/2021 ~ Present: PhD Student, Department of Computer Science & Engineering, Hong Kong University of Science and Technology
- 09/2018 ~ 07/2021: Computer Science and Technology, Sun Yat-sen University
- 09/2014 ~ 07/2018: Computer Science and Technology, South China University of Technology
Research interests
- Audio-Driven Human Video Generation
- Expression-Driven Human Video Generation
- Human Animation Video Generation
- Human Video Editing
News
- (Dec 2024): Our paper AnyTalk is accepted by AAAI 2025, stay tuned!
- (Oct 2024): Start my internship at Hunyuan, Tencent.
- (Sep 2024): Our temporal action localization work is accepted by TCSVT (Finally).
- (May 2024): Start my internship at Adobe, U.S.
Preprints
Free-viewpoint Human Animation with Pose-correlated Reference Selection
Fa-Ting Hong, Zhan Xu, Haiyang Liu, Qinjie Lin, Luchuan Song, Zhixin Shu, Yang Zhou, Duygu Ceylan, Dan Xu
Under Review 2024
Code |
ArXiv |
Project Page
Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation
Shuling Zhao, Fa-Ting Hong, Xianshui Huang, Dan Xu
ArXiv 2024
Code |
ArXiv |
Project Page
Selected Publications
Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation
Fa-Ting Hong, , Dan Xu
ICCV 2023
Code |
Paper |
Project Page
Depth-Aware Generative Adversarial Network for Talking Head Video Generation
Fa-Ting Hong, , Longhao Zhang, Li Shen, Dan Xu
CVPR 2022
Code |
Paper |
Project Page
Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization
Fa-Ting Hong, , Jia-Chang Feng, Dan Xu, Ying Shan and Wei-Shi Zheng
TMM 2022
MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection
Jia-Chang Feng, Fa-Ting Hong, , Wei-Shi Zheng
CVPR 2021
Code |
Paper |
Project Page
Hybrid Dynamic-static Context-aware Attention Network for Action Assessment in Long Videos
Ling-An Zeng, Fa-Ting Hong, , Wei-Shi Zheng#, Qi-Zhi Yu, Wei Zeng, Yao-Wei Wang, and Jian-Huang Lai
MINI-Net: Multiple Instance Ranking Network for Video Highlight Detection
Fa-Ting Hong, , Xuanteng Huang, Wei-Hong Li, Wei-Shi Zheng
ECCV 2020
Code |
Paper |
Project Page
Intern Experience
-
1.11 — Now 2024
Tencent
– Hunyuan Lab
24.5 — 24.8 2024
Adobe Research
– Media Intelligence Lab
1.9 — 1.4 2023/2024
IDEA (粤港澳大湾区数字经济研究院)
– Vistring Lab
Academic Services
- Reviewer: ICLR, CVPR, ECCV, SIGGRAPH Asia, ACMMM, TPAMI, ICCV, NeurIPS, TMM, IJCV
Resume
Statistics