I am Xiangtai and I work as a Research Fellow at MMLab@NTU S-Lab advised by Prof.Chen Change Loy.

I obtained my PhD degree at Peking University. My PhD supervisor is Prof.Yunhai Tong.

🔭 I’m currently working on Pixel-Wised Scene Understanding/Vision Transformer/Video Understanding in Computer Vision.

Previously, I did some research on Image/Video Semantic/Instance/Panoptic Segmentation as well as several related problems.

I did several works on these directions during my PhD in PKU. I am lucky mentored and also collaborate by Dr.Kuiyuan Yang, Prof.Li Zhang, Dr.Guangliang Cheng, Dr.Yibo Yang, Prof.Dacheng Tao, Prof.Zhouchen Lin, Mr.Xia li, Dr.Jiangmiao Pang.

(video) semantic segmentation, (video) instance segmentation, (video) panoptic segmentation, panoptic segmentation with depth/part, transparent object, boundary feature learning, aerial segmentation, video object detection/tracking/segmentation，

Remote Cooperations are Welcome (lxtpku@pku.edu.cn).

🔥 News

• 2022.08：  🎉🎉 Join the MMLab@NTU S-Lab! Our four works (Video K-Net, PanopticPartFormer, FashionFormer, and PolyphonicFormer in CVPR-22/ECCV-22) code are all released. Check out my github homepage.
• 2022.07：  🎉🎉 Our SFNet-Lite (extension of SFNet-ECCV20) achieve the best mIoU and speed trade-off on multiple driving datasets. SFNet-Lite can obtain 80.1 mIoU while running at 50 FPS, 78.8 mIoU while running at 120 FPS. Code.
• 2022.07:  🎉🎉 Three papers are accepted by ECCV-2022. One paper is accepted by ICIP-2022. Two Vision Transformer models are released.
• 2022.06:  🎉🎉 Graduated From PKU.
• 2022.03:  🎉🎉 One paper is accepted by CVPR-2022 as oral presentation.

📝 Publications

Full Publications can be found in this.

* means equal contribution.

Code can be found in this.

Conference

• Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation, Xiangtai Li, Shilin Xu, Yibo Yang, Guangliang Cheng, Yunhai Tong, Dacheng Tao, ECCV 2022 | Code
• Fashionformer: A Simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition, Shilin Xu*, Xiangtai Li*, Jingbo Wang, Guangliang Cheng, Yunhai Tong, Dacheng Tao, ECCV 2022 | Code
• PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation, Haobo Yuan*, Xiangtai Li*, Yibo Yang, Guangliang Cheng, Jing Zhang, Yunhai Tong, Lefei Zhang, Dacheng Tao, ECCV 2022 | Code
• Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation, Xiangtai Li*, Wenwei Zhang*, Jiangmiao Pang*, Kai Chen, Guangliang Cheng, Yunhai Tong, Chen Change Loy, CVPR 2022 (Oral) | Code
• PointFlow: Flowing Semantics Through Points for Aerial Image Segmentation, Xiangtai Li, Hao He, Xia Li, Duo Li, Guangliang Cheng, Jianping Shi, Lubin Weng, Yunhai Tong, Zhouchen Lin, CVPR 2021 | Code
• Enhanced Boundary Learning for Glass-like Object Segmentation, Hao He*, Xiangtai Li*, Guangliang Cheng, Jianping Shi, Yunhai Tong, Gaofeng Meng, Véronique Prinet, Lubin Weng, ICCV 2021 | Code
• End-to-End Video Object Detection with Spatial-Temporal Transformers, Lu He*, Qianyu Zhou*, Xiangtai Li*, Li Niu, Guangliang Cheng, Xiao Li, Wenxuan Liu, Yunhai Tong, Lizhuang Ma, Liqing Zhang ACM-MM 2021 | Code
• Semantic Flow for Fast and Accurate Scene Parsing, Xiangtai Li, Ansheng You, Zhen Zhu, Houlong Zhao, Maoke Yang, Kuiyuan Yang, Yunhai Tong, ECCV 2020 (Oral) | Code
• Improving Semantic Segmentation via Decoupled Body and Edge Supervision, Xiangtai Li, Xia Li, Li Zhang, Guangliang Cheng, Jianping Shi, Zhouchen Lin, Shaohua Tan, Yunhai Tong, ECCV 2020 | Code
• GFF: Gated Fully Fusion for Semantic Segmentation, Xiangtai Li, Houlong Zhao, Lei Han, Yunhai Tong, Kuiyuan Yang, AAAI 2020 (Oral) | Code
• Dual Graph Convolutional Network for Semantic Segmentation, Li Zhang*, Xiangtai Li*, Anurag Arnab, Kuiyuan Yang, Yunhai Tong, Philip H. S. Torr, BMVC 2019 | Code

Journal

• Improving Video Instance Segmentation via Temporal Pyramid Routing, Xiangtai Li, Hao He, Yibo Yang, Henghui Ding, Kuiyuan Yang, Guangliang Cheng, Yunhai Tong, Dacheng Tao T-PAMI-2022 | Code
• Towards Efficient Scene Understanding via Squeeze Reasoning, Xiangtai Li, Xia Li, Ansheng You, Li Zhang, Guangliang Cheng, Kuiyuan Yang, Yunhai Tong, Zhouchen Li, IEEE-TIP-2021 | Code
• Global Aggregation then Local Distribution for Scene Parsing, Xiangtai Li*, Li Zhang*, Guangliang Cheng, Kuiyuan Yang, Yunhai Tong, Xiatian Zhu, Tao Xiang, IEEE-TIP-2021 | Code

Arxiv

• A Person Cannot Be Segmented as A Cat: Towards Robust Referring Image Segmentation, Jianzong Wu, Xiangtai Li, Xia Li, Henghui Ding, Yunhai Tong, Dacheng Tao, arxiv | Project
• SFNet: Faster, Accurate, and Domain Agnostic Semantic Segmentation via Semantic Flow , Xiangtai Li, Jiangning Zhang, Yibo Yang, Guangliang Cheng, Yunhai Tong, Kuiyuan Yang, Dacheng Tao, arxiv | Code
• EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm , Jiangning Zhang, Xiangtai Li, Yabiao Wang, Chengjie Wang, Yibo Yang, Yong Liu, Dacheng Tao, arxiv | Code
• TransVOD: End-to-end Video Object Detection with Spatial-Temporal Transformers , Qianyu Zhou*, Xiangtai Li* , Lu He, Yibo Yang, Guangliang Cheng, Yunhai Tong, Lizhuang Ma, Dacheng Tao, arxiv | Code
• Multi-Task Learning with Multi-query Transformer for Dense Prediction , Yangyang Xu*, Xiangtai Li* , Haobo Yuan, Yibo Yang, Jing Zhang, Yunhai Tong, Lefei Zhang, Dacheng Tao, arxiv | Code
• BoundarySqueeze: Image Segmentation as Boundary Squeezing, Hao He*, Xiangtai Li*, Yibo Yang, Guangliang Cheng, Yunhai Tong, Lubin Weng, Zhouchen Lin, Shiming Xiang, arxiv | Code

🎖 Honors and Awards

• 2021.09 National Scholarship, Ministry of Education of China in PKU (2020-2021, 2019-2020)
• 2021.06 President Scholarship of PKU (2020-2021)
• 2017, 2022 Beijing Excellent Graduates
• 2021.11 Winner of Segmenting and Tracking Every Point and Pixel: 6th Workshop on ICCV-2021 Track2 (Project Leader and First Author, 2021-10-17)

📖 Educations

• 2017.09 - 2022.06, PhD in Peking University (PKU)
• 2013.09 - 2017.06, Bachelor in Beijing University of Posts and Telecommunications (BUPT)

💬 Invited Talks

• 2022.05 Invited talk on Panoptic Segmentation and Beyond in Baidu PaddleSeg Group
• 2021.12 Invited talk on Video Segmentation in DiDi Auto-Driving Group
• 2021.10 Invited talk on Aligned Segmentation HuaWei Noah Auto-Driving Group

💻 Internships and Professional activities

• SenseTime, mentored by Dr.Guangliang Cheng and Dr.Jianping Shi.
• JD AI (remote cooperation), mentored by Dr.Yibo Yang and Prof.Dacheng Tao.
• DeepMotion (Now Xiaomi Car), mentored by Dr.Kuiyuan Yang.
• Conference Reviewer for CVPR, ICCV, ECCV, ICLR, AAAI, NeurIPS, ICML and Journal Reviewer For IEEE-TIP/ IEEE-TPAMI/ IJCV.

Friends and Mentored Students

Much thanks to these friends and collaborators.

Hao He, Shilin Xu, Jianzong Wu, Haobo Yuan, Qianyu Zhou, Yangyang Xu, Ansheng You, Houlonng Zhao, Yibo Yang, Xia Li, Jingbo Wang, Jiangning Zhang, Jiangmiao Pang, Wenwei Zhang, Henghui Ding.