Jianxiong Xiao (Professor X)


Founder and CEO, AutoX Inc. (We are hiring!)

Email: profxoffice [at] autox [dot] ai

Homepage: www.jianxiongxiao.com
GitHub: https://github.com/jianxiongxiao

Professor X is my nickname. If you want to know more about my actual name:
       How to pronouce it? (click the [Speaker] button at the bottom left corner to hear the sound)
       In the Wade-Giles system of romanization, it is rendered as Chien-Shiung Hsiao.
       In Chinese characters, it is 肖健雄 (Simplified) or 蕭健雄 (Traditional).

Brief Bio:

Jianxiong Xiao (a.k.a., Professor X) is the Founder and CEO of AutoX Inc., a high-tech startup working on A.I. software solution for self-driving vehicles. AutoX's mission is to democratize autonomy and make autonomous driving universally accessible to everyone. Its innovative camera-first self-driving solution amounts to only a tiny fraction of the cost of traditional LiDar-based approaches. Dr. Xiao has over ten years of research and engineering experience in Computer Vision, Autonomous Driving, and Robotics. In particular, he is a pioneer in the fields of 3D Deep Learning, RGB-D Recognition and Mapping, Big Data, Large-scale Crowdsourcing, and Deep Learning for Robotics. Jianxiong received a BEng. and MPhil. in Computer Science from the Hong Kong University of Science and Technology in 2009. He received his Ph.D. from the Computer Science and Artificial Intelligence Laboratory (CSAIL) at the Massachusetts Institute of Technology (MIT) in 2013. And he was an Assistant Professor at Princeton University and the founding director of the Princeton Computer Vision and Robotics Labs from 2013 to 2016. His work has received the Best Student Paper Award at the European Conference on Computer Vision (ECCV) in 2012 and the Google Research Best Papers Award for 2012, and has appeared in the popular press. He was awarded the Google U.S./Canada Fellowship in Computer Vision in 2012, the MIT CSW Best Research Award in 2011, NSF/Intel VEC Research Award in 2016, and two Google Faculty Awards in 2014 and in 2015 respectively. He co-lead the MIT+Princeton joint team to participate in the Amazon Picking Challenge in 2016, and won the 3rd and 4th place worldwide. He was named to be one of the 35 Innovators Under 35 by MIT Technology Review in 2017. More information can be found at: http://www.jianxiongxiao.com.

Selected Press:

Recent Public Speech:

Source Code:

Publications:

Google Scholar  ·  Bibtex  ·  DBLP

A. Seff, J. Xiao.
Learning from Maps: Visual Common Sense for Autonomous Driving
arxiv:1611.08583
Paper ·  Project Webpage ·  Source Code ·  MIT Tech Review ·  Singularity Hub

Y. Zhang, M. Bai, P. Kohli, S. Izadi, and J. Xiao
DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding
Proceedings of 16th IEEE International Conference on Computer Vision (ICCV2017)
Paper ·  Project Webpage

A. Zeng, S. Song, M. Nießner, M. Fisher, and J. Xiao.
3DMatch: Learning the Matching of Local 3D Geometry in Range Scans
Proceedings of 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2017)
Oral Presentation ·  Paper ·  Project Webpage

A. Zeng, K.T. Yu, S. Song, D. Suo, E. Walker Jr., A. Rodriguez, and J. Xiao
Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challenge
Proceedings of IEEE International Conference on Robotics and Automation (ICRA2017)
Paper ·  Project Webpage and Dataset ·  Code (Github)

C. Chen, M. Liu, O. Tuzel, J. Xiao.
R-CNN for Small Object Detection
Asian Conference on Computer Vision (ACCV2016)
Paper

S. Song, and J. Xiao.
Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images
Proceedings of 29th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2016)
Spotlight Presentation ·  Paper ·  Project Webpage and Source Code

C. Chen, A. Seff, A. Kornhauser and J. Xiao.
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Proceedings of 15th IEEE International Conference on Computer Vision (ICCV2015)
Paper ·  Project Webpage, Source Code, and Dataset

S. Song, L. Zhang, and J. Xiao.
Robot In a Room: Toward Perfect Object Recognition in Closed Environments
arXiv:1507.02703 [cs.CV] 9 Jul 2015
Paper ·  Project Webpage and Source Code

Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang and J. Xiao
3D ShapeNets: A Deep Representation for Volumetric Shapes
Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2015)
Oral Presentation ·  Paper ·  Source Code and Project Webpage ·  Princeton ModelNet Dataset

S. Song, S. Lichtenberg, and J. Xiao
SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite
Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2015)
Oral Presentation ·  Paper ·  Dataset and Project Webpage

F. Yu, J. Xiao, and T. Funkhouser
Semantic Alignment of City-Scale LiDAR Data
Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2015)
Paper ·  Supplementary Materials ·  Project Webpage

P. Xu, K. A. Ehinger, Y. Zhang, A. Finkelstein, S. R. Kulkarni, and J. Xiao.
TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking
arXiv:1504.06755 [cs.CV] 25 Apr 2015
Paper ·  Project Webpage, Source Code, and iSUN dataset

F. Yu, Y. Zhang, S. Song, A. Seff, and J. Xiao.
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
arXiv:1506.03365 [cs.CV] 10 Jun 2015
Paper ·  LSUN dataset

A. Chang, T. Funkhouser, L. Guibas, P. Hanrahan, Q. Huang, Z. Li, S. Savarese, M. Savva, S. Song, H. Su, J. Xiao, L. Yi, and F. Yu.
ShapeNet: An Information-Rich 3D Model Repository
arXiv:1512.03012 [cs.CV] 9 Dec 2015
Paper ·  ShapeNet dataset

S. Song and J. Xiao
Sliding Shapes for 3D Object Detection in Depth Images
Proceedings of the 13th European Conference on Computer Vision (ECCV2014)
Oral Presentation ·  Paper ·  Source Code and Data and Project Webpage

Y. Zhang, S. Song, P. Tan, and J. Xiao
PanoContext: A Whole-room 3D Context Model for Panoramic Scene Understanding
Proceedings of the 13th European Conference on Computer Vision (ECCV2014)
Oral Presentation ·  Paper ·  Source Code and Data and Project Webpage

B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva
Learning Deep Features for Scene Recognition using Places Database
Advances in Neural Information Processing Systems 27 (NIPS2014)
Paper ·  Project Webpage, Data, and Demo

S. Zhu, T. Fang, J. Xiao and L. Quan
Local Readjustment for High-Resolution 3D Reconstruction
Proceedings of 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2014)
Paper ·  More Results ·  Project Webpage

S. Song and J. Xiao
Tracking Revisited using RGBD Camera: Unified Benchmark and Baselines
Proceedings of 14th IEEE International Conference on Computer Vision (ICCV2013)
Paper ·  Project Webpage, Data, Source Code and Evaluation Server  ·  Poster  ·  Spotlight  ·  Talk Slides  ·  Video

D. Lin and J. Xiao
Characterizing Layouts of Outdoor Scenes Using Spatial Topic Processes
Proceedings of 14th IEEE International Conference on Computer Vision (ICCV2013)
Paper ·  Project Webpage

J. Xiao, A. Owens and A. Torralba
SUN3D: A Database of Big Spaces Reconstructed using SfM and Object Labels
Proceedings of 14th IEEE International Conference on Computer Vision (ICCV2013)
Paper ·  Project Webpage, Data and Source Code  ·  Poster  ·  Spotlight  ·  Talk Slides  ·  Video (HighRes, YouTube)

A. Owens, J. Xiao, A. Torralba and W. T. Freeman
Shape Anchors for Data-driven Multi-view Reconstruction
Proceedings of 14th IEEE International Conference on Computer Vision (ICCV2013)
Paper ·  Project Webpage  ·  Poster  ·  Spotlight  ·  Talk Slides

J. Xiao
A 2D + 3D Rich Data Approach to Scene Understanding
PhD Thesis. Massachusetts Institute of Technology, 2013.
Thesis ·  Thesis Page

J. Xiao, K. A. Ehinger, J. Hays, A. Torralba, and A. Oliva
SUN Database: Exploring a Large Collection of Scene Categories
International Journal of Computer Vision (IJCV)
Paper  ·  Database Webpage  ·  Scene Classification Benchmark Webpage

J. Xiao and Y. Furukawa
Reconstructing the World's Museums
International Journal of Computer Vision (IJCV)
Paper ·  Project Webpage

P. Isola, J. Xiao, D. Parikh, A. Torralba, and A. Oliva
What Makes a Photograph Memorable?
Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2013
Paper ·  Project Webpage (Dataset and Source Code)

J. Xiao, J. Hays, B. C. Russell, G. Patterson, K. A. Ehinger, A. Torralba and A. Oliva
Basic Level Scene Understanding: Categories, Attributes and Structures
Frontiers in Psychology, Volume 4, Number 00506, 2013
Paper ·  Link

Y. Zhang, J. Xiao, J. Hays and P. Tan
FrameBreak: Dramatic Image Extrapolation by Guided Shift-Maps
Proceedings of 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2013)
Paper ·  Project Webpage and Source Code

H. Jiang and J. Xiao
A Linear Approach to Matching Cuboids in RGBD Images
Proceedings of 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2013)
Paper ·  Project Webpage ·  Poster ·  Source Code ·  RGB-D cuboid Dataset

J. Xiao, B. C. Russell, and A. Torralba
Localizing 3D Cuboids in Single-view Images
Advances in Neural Information Processing Systems 25 (NIPS2012)
Paper ·  Project Webpage and SUNprimitive Dataset

A. Khosla, J. Xiao, A. Torralba and A. Oliva
Memorability of Image Regions
Advances in Neural Information Processing Systems 25 (NIPS2012)
Paper ·  Project Webpage

J. Xiao and Y. Furukawa
Reconstructing the World's Museums
Proceedings of the 12th European Conference on Computer Vision (ECCV2012)
Best Student Paper Award ·  Oral Presentation ·  Paper ·  Project Webpage

J. Xiao, B. C. Russell, J. Hays, K. A. Ehinger, A. Oliva and A. Torralba
Basic Level Scene Understanding: From Labels to Structure and Beyond
ACM SIGGRAPH Asia 2012
Invited Paper of Technical Briefs

J. Xiao*, A. Khosla*, P. Isola, A. Torralba and A. Oliva (* - indicates equal contribution)
Image Memorability and Visual Inception
ACM SIGGRAPH Asia 2012
Invited Paper of Technical Briefs

J. Xiao
3D Reconstruction is Not Just a Low-level Task: Retrospect and Survey
MIT9.S912: What is Intelligence?
Technical Report

J. Xiao, K. A. Ehinger, A. Oliva and A. Torralba
Recognizing Scene Viewpoint using Panoramic Place Representation
Proceedings of 25th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2012)
Paper ·  Project Webpage (Dataset and Source Code)

K. A. Ehinger, J. Xiao, A. Torralba and A. Oliva
Estimating Scene Typicality from Human Ratings and Image Features
Proceedings of 33rd Annual Meeting of the Cognitive Science Society (CogSci2011)
Oral Presentation ·  Paper  ·  Slides

P. Isola, J. Xiao, A. Torralba and A. Oliva
What Makes an Image Memorable?
Proceedings of 24th IEEE Conference on Computer Vision and Pattern Recognition (CVPR2011)
Paper ·  Project Webpage (Dataset and Source Code)
Press Coverage: MIT Homepage, MIT News, Slashdot, Science Daily, Armenian Medical, e!Science, etc.

H. Zhang, J. Xiao, and L. Quan
Supervised Label Transfer for Semantic Segmentation of Street Scenes
Proceedings of the 11th European Conference on Computer Vision (ECCV2010)
Paper

J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba
SUN Database: Large-scale Scene Recognition from Abbey to Zoo
Proceedings of 23rd IEEE Conference on Computer Vision and Pattern Recognition (CVPR2010)
Paper ·  Object and Scene Webpage ·  Scene Classification Benchmark Data and Source Code ·  Poster ·  DrawMe

P. Zhao, T. Fang, J. Xiao, H. Zhang, Q. Zhao, and L. Quan
Rectilinear Parsing of Architecture in Urban Environment
Proceedings of 23rd IEEE Conference on Computer Vision and Pattern Recognition (CVPR2010)
Oral Presentation ·  Paper

J. Xiao, T. Fang, P. Zhao, M. Lhuillier, and L. Quan
Image-based Street-side City Modeling
ACM Transaction on Graphics (TOG), Volume 28, Number 5. Proceedings of ACM SIGGRAPH Asia 2009.
Project Webpage ·  Paper ·  Video of System Explanation ·  Video of Results

J. Xiao and L. Quan
Multiple View Semantic Segmentation for Street View Images
Proceedings of 12th IEEE International Conference on Computer Vision (ICCV2009)
Project Webpage ·  Paper ·  High Resolution Poster (126M) ·  Low Resolution Poster ·  Video in YouTube

J. Xiao
Image-based Building Modeling
Thesis for Master of Philosophy in Computer Science and Engineering, The Hong Kong University of Science and Technology.
M.Phil. Thesis  ·  HKUST Institutional Repository

J. Xiao, T. Fang, P. Tan, P. Zhao, E. Ofek, and L. Quan
Image-based Facade Modeling
ACM Transaction on Graphics (TOG), Volume 27, Number 5. Proceedings of ACM SIGGRAPH Asia 2008.
[Image is selected for Back Cover of ToG. Video is selected for Papers Preview.]
Low Resolution Paper  ·  High Resolution Paper ·  Project Webpage  ·  Video in YouTube  ·  Slides ·  Image 1 ·  Image 2

P. Tan, T. Fang, J. Xiao, P. Zhao, and L. Quan
Single Image Tree Modeling
ACM Transaction on Graphics (TOG), Volume 27, Number 5. Proceedings of ACM SIGGRAPH Asia 2008.
Video is selected for Papers Preview  ·  Low Resolution Paper  ·  High Resolution Paper  ·  Project Webpage  ·  Video in YouTube

J. Xiao, J. Chen, D.-Y. Yeung, and L. Quan
Learning Two-view Stereo Matching
Proceedings of the 10th European Conference on Computer Vision (ECCV2008)
Oral Presentation ·  Low Resolution Paper  ·  High Resolution Paper  ·  Slides

J. Xiao, J. Chen, D.-Y. Yeung, and L. Quan
Structuring Visual Words in 3D for Arbitrary-view Object Localization
Proceedings of the 10th European Conference on Computer Vision (ECCV2008)
Low Resolution Paper  ·  High Resolution Paper  ·  Slides ·  Multi-view Shoe Data Set (742MB)

J. Xiao, J. Wang, P. Tan, and L. Quan
Joint Affinity Propagation for Multiple View Segmentation
Proceedings of 11th IEEE International Conference on Computer Vision (ICCV2007)
Oral Presentation ·  Low Resolution Paper  ·  High Resolution Paper  ·  Slides

Service:

Awards:

Talk Slides: