I am Xiangtai Li (ๆŽ็ฅฅๆณฐ) and I work as a Research Fellow at MMLab@NTU, S-Lab advised by Prof.Chen Change Loy.

I obtained my PhD degree at Peking University under the supervision of Prof.Yunhai Tong, and my bachelorโ€™s degree at Beijing University of Posts and Telecommunications.

My research work focuses on several directions, including pixel-wise scene understanding for video/image scene understanding (such as semantic/instance/panoptic segmentation and object detection), zero/few shot variants, general deep learning methods with applications (such as vision transformer, efficient model design, and neural collapse), and vision meets language (including open vocabulary learning, visual prompting, and visual grounding).

Besides, I am also very interested at aerial image analysis since I am a fun of history and military games.

During my PhD, I conducted research on image/video semantic/instance/panoptic segmentation, as well as several related problems.

๐Ÿ”ฅ News

  • 2023.03: Checkout our new survey on transformer-based segmentation and detection.
  • 2023.03๏ผšPlease checkout our new work, Tube-Link, the first universal video segmentation framework that outperforms specific video segmentation methods (VIS,VSS,VPS).
  • 2023.03๏ผšOne paper on Panoptic Video Scene Graph Generation (PVSG) is accepted by CVPR-2023.
  • 2022.11๏ผšTwo paper on Video Scene Understanding is accepted by T-PAMI.
  • 2022.09๏ผšOne paper on Neural Collapse is accepted by NeurIPS-2022.
  • 2022.08๏ผš ย ๐ŸŽ‰๐ŸŽ‰ Join the MMLab@NTU S-Lab! Our four works (Video K-Net, PanopticPartFormer, FashionFormer, and PolyphonicFormer in CVPR-22/ECCV-22) code are all released. Check out my github homepage.
  • 2022.07๏ผš ย ๐ŸŽ‰๐ŸŽ‰ Our SFNet-Lite (extension of SFNet-ECCV20) achieve the best mIoU and speed trade-off. on multiple driving datasets. SFNet-Lite can obtain 80.1 mIoU while running at 50 FPS, 78.8 mIoU while running at 120 FPS. Code.
  • 2022.07: ย ๐ŸŽ‰๐ŸŽ‰ Three papers are accepted by ECCV-2022. One paper is accepted by ICIP-2022.
  • 2022.07: ย ๐ŸŽ‰๐ŸŽ‰ Graduated From PKU.
  • 2022.03: ย ๐ŸŽ‰๐ŸŽ‰ Video K-Net is accepted by CVPR-2022 as oral presentation.

๐Ÿ“ Selected Publications

Full Publications Per Year can be found in Here.

* means equal contribution.

Code can be found in this.

Selected Arxiv

Selected Conference

Selected Journal

๐ŸŽ– Honors and Awards

  • National Scholarship, Ministry of Education of China in PKU (year 2020-2021) (year 2019-2020)
  • President Scholarship of PKU (year 2020-2021)
  • 2017, 2022 Beijing Excellent Graduates
  • 2017, 2022 BUPT/PKU Excellent Graduates
  • 2021.11 Winner of Segmenting and Tracking Every Point and Pixel: 6th Workshop on ICCV-2021 Track2 (Project Leader and First Author)

๐Ÿ“– Educations

  • 2017.09 - 2022.06, PhD in Peking University (PKU)
  • 2013.09 - 2017.06, Bachelor in Beijing University of Posts and Telecommunications (BUPT)

๐Ÿ’ฌ Invited Talks

  • 2022.05 Invited talk on Panoptic Segmentation and Beyond in Baidu PaddleSeg Group
  • 2021.12 Invited talk on Video Segmentation in DiDi Auto-Driving Group
  • 2021.10 Invited talk on Aligned Segmentation HuaWei Noah Auto-Driving Group

๐Ÿ’ป Internships and Professional activities