Enze Xie (谢恩泽)
CV / GitHub / Google Scholar / Email: Johnny_ez@163.com | xieenze@connect.hku.hk
I am currently a senior researcher at AI Theory Lab of Huawei Noah's Ark Lab (Hong Kong).
I obtained my Ph.D. degree from Department of Computer Science, The University of Hong Kong in 2022.
My advisor is Prof. Ping Luo and my co-advisor is Prof. Wenping Wang.
I also work very close with my friend Wenhai Wang.
I was fortunate to work with
Prof. Chunhua Shen,
Prof. Anima Anandkumar,
and Prof. Sanja Fidler,
During my PhD study, I collaborated with several researchers in industry e.g. Facebook (Meta) and NVIDIA.
I worked for a period of time at a small yet specialized quant trading firm, developing Transformer-based futures forecasting models.
My research interest is solving challenging problems in computer vision and machine learning. I did some works on instance-level detection and self/semi/weak-supervised learning. I developed a few well-known computer vision algorithms including:
I co-developed OpenSelfSup (now mmselfsup), a popular self-supervised learning framework with 2k+ github star.
In 2023, I lead or participate in the following research topics:
- AIGC, e.g. Diffusion Models in 2D/3D/Video
- Large Language Models (LLMs), e.g. AI4Math, Automated Mathematical Theorem Proving
- Autonomous Driving, e.g. 3D perception & prediction
Always looking for research interns with strong CV/ML background, feel free to shoot an email if interested.
We also have several positions for joint PhD programs with CUHK/HKUST and RAs, feel free to contact!
News
Publications
For the latest, check Google Scholar(* indicates equal contribution)
Selected Papers
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkuma, Jose M. Alvarez, Ping LuoNeurIPS 2021 [paper] [code] [中文解读] [demo] [NeurIPS 2021 Top-10 Influential Papers]
NVIDIA's first Vision Transformer work and transferred to several product teams.
PVTv2: Improved Baselines with Pyramid Vision Transformer
Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling ShaoTech report, arXiv [paper] [code] [ESI highly cited paper (1%), ESI hot papers (0.1%)]
A better version of PVT.
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling ShaoICCV 2021 (Oral) [paper] [code] [ICCV 2021 Top-10 Influential Papers]
The first work to extend Vision Transformer for object detection and segmentation.
PolarMask: Single Shot Instance Segmentation with Polar Representation
Enze Xie*, Peize Sun*, Xiaoge Song*, Wenhai Wang, Ding Liang, Chunhua Shen, Ping LuoCVPR 2020 (Oral) [paper] [code] [中文解读] [talk] [CVPR20 Top-10 Influential Papers]
We introduced a new Polar Representation to reformulate instance segmentation.
Other Papers
Improving Monocular Visual Odometry Using Learned Depth
Libo Sun, Wei Yin, Enze Xie, Zhengrong Li, Changming Sun, Chunhua ShenIEEE Transactions on Robotics 2022 [paper]
Segmenting Transparent Objects in the Wild with Transformer
Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping LuoIJCAI 2021 [paper] [code & dataset]
Segmenting Transparent Objects in the Wild
Enze Xie, Wenjia Wang, Wenhai Wang, Mingyu Ding, Chunhua Shen, Ping LuoECCV 2020 [paper] [code & dataset]
Scene Text Image Super-Resolution in the Wild
Wenjia Wang*, Enze Xie*, Xuebo Liu, Wenhai Wang, Ding Liang, Chunhua Shen, Xiang BaiECCV 2020 [paper] [code & dataset]
Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimation
Sheng Jin, Wentao Liu, Enze Xie, Wenhai Wang, Chen Qian, Wanli Ouyang, Ping LuoECCV 2020 [paper]
AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting
Wenhai Wang, Xuebo Liu, Xiaozhong Ji, Enze Xie, Ding Liang, ZhiBo Yang, Tong Lu, Chunhua Shen, Ping LuoECCV 2020 [paper] [Project Web]
Scene Text Detection with Supervised Pyramid Context Network
Enze Xie*, Yuhang Zang*, Shuai Shao, Gang Yu, Cong Yao, Guangyao LiAAAI 2019 [paper]
Technical Report
M^2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Bird’s-Eye View Representation
Enze Xie, Zhiding Yu, Daquan Zhou, Jonah Philion, Anima Anandkumar, Sanja Fidler, Ping Luo, Jose M. AlvarezTech report, arXiv [paper] [project page]
1st Place Solutions for OpenImage2019--Object Detection and Instance Segmentation
Yu Liu, Guanglu Song, Yuhang Zang, Yan Gao, Enze Xie, Junjie Yan, Chen Change Loy, Xiaogang WangTech report, arXiv [paper]
