I am Xiangtai and I work as a Research Fellow at MMLab@NTU S-Lab advised by Prof.Chen Change Loy.

I obtained my PhD degree at Peking University. My PhD supervisor is Prof.Yunhai Tong.

๐Ÿ”ญ Iโ€™m currently working on Pixel-Wised Scene Understanding/Vision Transformer/Video Understanding in Computer Vision.

Previously, I did some research on Image/Video Semantic/Instance/Panoptic Segmentation as well as several related problems.

I did several works on these directions during my PhD in PKU. I am lucky mentored and also collaborate by Dr.Kuiyuan Yang, Prof.Li Zhang, Dr.Guangliang Cheng, Dr.Yibo Yang, Prof.Dacheng Tao, Prof.Zhouchen Lin, Mr.Xia li, Dr.Jiangmiao Pang.

(video) semantic segmentation, (video) instance segmentation, (video) panoptic segmentation, panoptic segmentation with depth/part, transparent object, boundary feature learning, aerial segmentation, video object detection/tracking/segmentation๏ผŒ

Remote Cooperations are Welcome (lxtpku@pku.edu.cn).

๐Ÿ”ฅ News

  • 2022.08๏ผš ย ๐ŸŽ‰๐ŸŽ‰ Join the MMLab@NTU S-Lab! Our four works (Video K-Net, PanopticPartFormer, FashionFormer, and PolyphonicFormer in CVPR-22/ECCV-22) code are all released. Check out my github homepage.
  • 2022.07๏ผš ย ๐ŸŽ‰๐ŸŽ‰ Our SFNet-Lite (extension of SFNet-ECCV20) achieve the best mIoU and speed trade-off on multiple driving datasets. SFNet-Lite can obtain 80.1 mIoU while running at 50 FPS, 78.8 mIoU while running at 120 FPS. Code.
  • 2022.07: ย ๐ŸŽ‰๐ŸŽ‰ Three papers are accepted by ECCV-2022. One paper is accepted by ICIP-2022. Two Vision Transformer models are released.
  • 2022.06: ย ๐ŸŽ‰๐ŸŽ‰ Graduated From PKU.
  • 2022.03: ย ๐ŸŽ‰๐ŸŽ‰ One paper is accepted by CVPR-2022 as oral presentation.

๐Ÿ“ Publications

Full Publications can be found in this.

* means equal contribution.

Code can be found in this.




๐ŸŽ– Honors and Awards

  • 2021.09 National Scholarship, Ministry of Education of China in PKU (2020-2021, 2019-2020)
  • 2021.06 President Scholarship of PKU (2020-2021)
  • 2017, 2022 Beijing Excellent Graduates
  • 2021.11 Winner of Segmenting and Tracking Every Point and Pixel: 6th Workshop on ICCV-2021 Track2 (Project Leader and First Author, 2021-10-17)

๐Ÿ“– Educations

  • 2017.09 - 2022.06, PhD in Peking University (PKU)
  • 2013.09 - 2017.06, Bachelor in Beijing University of Posts and Telecommunications (BUPT)

๐Ÿ’ฌ Invited Talks

  • 2022.05 Invited talk on Panoptic Segmentation and Beyond in Baidu PaddleSeg Group
  • 2021.12 Invited talk on Video Segmentation in DiDi Auto-Driving Group
  • 2021.10 Invited talk on Aligned Segmentation HuaWei Noah Auto-Driving Group

๐Ÿ’ป Internships and Professional activities

  • SenseTime, mentored by Dr.Guangliang Cheng and Dr.Jianping Shi.
  • JD AI (remote cooperation), mentored by Dr.Yibo Yang and Prof.Dacheng Tao.
  • DeepMotion (Now Xiaomi Car), mentored by Dr.Kuiyuan Yang.
  • Conference Reviewer for CVPR, ICCV, ECCV, ICLR, AAAI, NeurIPS, ICML and Journal Reviewer For IEEE-TIP/ IEEE-TPAMI/ IJCV.

Friends and Mentored Students

Much thanks to these friends and collaborators.

Hao He, Shilin Xu, Jianzong Wu, Haobo Yuan, Qianyu Zhou, Yangyang Xu, Ansheng You, Houlonng Zhao, Yibo Yang, Xia Li, Jingbo Wang, Jiangning Zhang, Jiangmiao Pang, Wenwei Zhang, Henghui Ding.