Jierun CHEN (陈捷润)

Hi! I am Jierun Chen, a final-year Ph.D. candidate in HKUST CSE Department, advised by Prof. Shueng-Han Gary Chan. I interned at Snap Research working on efficient text-to-image models, with Jian Ren and Anil Kag. I also interned at MSRA, working with Fangyun Wei on multimodal large language models (MLLM). I received my B.Eng. in Electrical Engineering from Edison Experimental Class, Zhejiang University.

My research interests lie in foundation models, efficient deep learning, and their application to various computer vision tasks, with focuses on:

Efficient AIGC,
Multimodal Large Language Models (MLLM),
Mobile and Edge AI.

Email: jierunchen@gmail.com / CV / Google Scholar / LinkedIn / Github

Publications

AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation
Anil Kag, Huseyin Coskun, Jierun Chen, Junli Cao, Willi Menapace, Aliaksandr Siarohin, Sergey Tulyakov, Jian Ren
The 38th Annual Conference on Neural Information Processing Systems (NIPS), 2024
project / paper

Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models
Jierun Chen*, Fangyun Wei*, Jinjing Zhao, Sizhe Song, Bohuai Wu, Zhuoxuan Peng, S.-H. Gary Chan, Hongyang Zhang
Preprint, 2024
paper / code / dataset

We clean the widely-adopted RefCOCO,+,g benchmarks and introduce Ref-L4, a New REC benchmark in the LMM Era.

StableKD: Breaking Inter-block Optimization Entanglement for Stable Knowledge Distillation
Shiu-hong Kao*, Jierun Chen*, S.-H. Gary Chan
arxiv:2312.13223, 2023
paper

We propose StableKD, a simple and efficient Knowledge Distillation framework that attains higher accuracy using fewer training epochs and less data.

	Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks Jierun Chen, Shiu-hong Kao, Hao He, Weipeng Zhuo, Song Wen, Chul-Ho Lee, S.-H. Gary Chan IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 paper / code We propose a simple yet fast and effective partial convolution (PConv), as well as a latency-efficient family of architectures called FasterNet.
	TVConv: Efficient Translation Variant Convolution for Layout-Aware Visual Processing Jierun Chen, Tianlang He, Weipeng Zhuo, Li Ma, Sangtae Ha, S.-H. Gary Chan IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 paper / video / code TVConv works more computation-efficient than regular convolution when dealing with layout-specific tasks, e.g., face recognition.
	Joint Demosaicking and Denoising in the Wild: The Case of Training Under Ground Truth Uncertainty Jierun Chen, Song Wen, S.-H. Gary Chan Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2021 paper / video We consider the ground truth uncertainty for joint demosaicking and denoising in the wild, which provides better restoration result and interpretability.
	Target-agnostic Source-free Domain Adaptation for Regression Tasks Tianlang He, Zhiqiu Xia, Jierun Chen, Haoliang Li, S.-H. Gary Chan IEEE International Conference on Data Engineering (ICDE), 2024 paper We propose TASFAR, a novel target-agnostic source-free domain adaptation method for regression tasks.
	CP-NeRF: Conditionally Parameterized Neural Radiance Fields for Cross-scene Novel View Synthesis Hao He, Yixun Liang, Shishi Xiao, Jierun Chen, Yingcong Chen The 31th Pacific Conference on Computer Graphics and Applications (Pacific Graphics), 2023 paper and code coming soon We propose CP-NeRF to enable training a one-for-all NeRF across diverse scenes.
	FIS-ONE: Floor Identification System with One Label for Crowdsourced RF Signals Weipeng Zhuo, Ka Ho Chiu, Jierun Chen, Ziqi Zhao, S.-H. Gary Chan, Sangtae Ha, Chul-Ho Lee IEEE International Conference on Distributed Computing Systems (ICDCS), 2023 paper / code We design a floor identification system for crowdsourced RF signals in a building using only one labeled data sample from the bottom floor.
	Semi-supervised Learning with Network Embedding on Ambient RF Signals for Geofencing Services Weipeng Zhuo, Ka Ho Chiu, Jierun Chen, Jiajie Tan, Edmund Sumpena, Sangtae Ha, S.-H. Gary Chan, Chul-Ho Lee IEEE International Conference on Data Engineering (ICDE), 2023 paper / code We develop a practical geofencing system, solely based on ambient radio frequency (RF) signals, to enable applications like elderly care, dementia antiwandering, pandemic control, etc.

Selected Awards

RedBird Academic Excellence Award, HKUST, 2022
Postgraduate Scholarship, HKUST, 2019-2023
Outstanding Graduate, ZJU, 2018
Scholarship for Excellence in Research and Innovation, ZJU, 2017
1st prize in Nanjiang Lebo Cup Provincial Robot Competition (ranked 1/62), 2017
1st prize in National Undergraduate Electronic Design Contest (ranked 3/109 in Zhejiang Division), 2017
Scholarship for Outstanding Merits, ZJU, 2015, 2017
Excellent Student Awards, ZJU, 2015, 2017

Teaching

Teaching Assistant:

COMP 2012H Honors Object-Oriented Programming and Data Structures, Fall 2022
COMP 4911/6613D/ENTR4911 IT Entrepreneurship, Fall 2021
COMP 4021 Internet Computing, Fall 2020
COMP 4611 Design and Analysis of Computer Architectures, Spring 2020

Mentoring:

UROP 1000/1100/2100/3100, Spring 2023/Fall 2022/Spring 2022/Fall 2021/Fall 2020/Summer 2020/Spring 2020
MSBD 5014/CSIT 6910 Independent Project, Spring 2022/Fall 2021
COMP 4981/4981H Final Year Projects/Final Year Theses, Spring 2023/Fall 2022/Fall 2021

Academic Services

Conference Reviewer: ICLR 2025, CVPR 2023 - 2025, ECCV 2024, ICCV 2023, UbiComp2023, BMVC 2023, INFOCOM 2020 - 2023, BMVC 2020 - 2021

Journal Reviewer: IJCV, TIM