Dr Shaodi You

Senior Research Scientist
Senior Honorary Lecturer
Ph.D.

Dr. Shaodi You is a senior research scientist at Data61, (Previously known as NICTA) Canberra Research Lab and a senior adjunct lecturer of College of Engineering and Computer Science at Australian National University (ANU). He receives his Ph.D. and M.E. degrees from The University of Tokyo, Japan in 2015 and 2012 and his bachelor's degree from Tsinghua University, P. R. China in 2009. His research interests are 1. physics based vision, 2. perception based vision and learning, and 3. 3D geometry.

 

Research Homepage: http://users.cecs.anu.edu.au/~shaodi.you/

 

I am organizing Workshops of ACCV: CfP:ACCV2018 Workshops:

I am organizing DICTA 2018. dicta2018.org

 

Info. of ANU and Data61 Ph.D. scholarships (link)

ANU and Data61 offer various scholarships for potential Ph.D. students. Deadline for 2018 Domestic PhD students is Mar. 15th, 2018; for international students is Apr. 20th, 2018. See details here.

My work is mainly focusing on three areas:
Perception Based Vision and Learning,
Physics Based Vision and
3D geometry.

 

Perception Based Vision and Learning

Perception

Perceptual based vision learning aiming to model and understanding human perception. And later propose computer vision and machine learning algorithms which incorporates such understanding. Specifically, I have been working on the topics: Prothetic vision, decolourization, saliency and manifold learning. (See research and projects)

 

 

Physics Based Vision

Liquid

Liquid optics is extremely challenging because it is transparent and non-rigid. The transparency means its appearance is totally determined by its environment. The non-rigidity means its shape is also highly dependent on the environment. Specifically, my research focus on rain and water drops. (See research and projects)

 

 

Non-rigid 3D geometry

3D

A few researches on modeling the non-rigidity of 3D objects. (See research and projects)

See up-to-date list and download pdf: http://users.cecs.anu.edu.au/~shaodi.you/

 

[16] Shaodi You, Yasuyuki Matsushita, Sudipta Sinha, Yusuke Bou and Katsushi Ikeuchi, Multi-view Rectification of Folded Documents. IEEE TPAMI, Accepted, DOI: 10.1109/TPAMI.2017.2675980. 2017.
[pdf][webpage]

[15] Feng Lu, Lei He, Shaodi You, Zhixiang Hao, Identifying Surface BRDF from a Single 4D Light Field Image via Deep Neural Network, IEEE Journal on Selected Topics in Singal Processing. [pdf]

[14] Shijie Zhang, Lizhen Qu, Shaodi You, Zhenglu Yang and Jiawan Zhang, Automatic Generation of Grounded Visual Questions, International Joint Conference on Artificial Intelligence, IJCAI 2017. [pdf]

[13] Diming Zhamg, Fei Xue, Hao Huang and Shaodi You, VBMq: Pursuit Baremetal Perf ormance by Embracing Block I/O Parallelism in Virtualization, Frontier of Computer Science. Accepted.

[12] Bin Yue, Min Gui, Jiahui Guo, Zhenglu Yang, Jin-Mao Wei and Shaodi You, An Effective Framework for Question Answering over Freebase via Reconstructing Natural Sequences. WWW 2017.

[11] Yu Li, Shaodi You, Michael S. Brown, Robby T. Tan, Haze Visibility Enhancement, A Survey and Quantitative Benchmarking. Submitted to CVIU for review. (Major revision), 2016.

[10] David Feng, Nick Barnes, Shaodi You and Chris McCarthy, Local Background Enclosure for RGB-D Salient Object Detection, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2016 Spotlihgt Presentation), June 26-July 1, 2016, Las Vegas, USA.
[pdf] [webpage]

[9] Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Waterdrop Stereo, arXiv:1604.00730 [cs.CV].
[pdf]

[8] Shaodi You, Thing Locally, Fit Globally: Robust and Fast 3D Shape Matching via Adaptive Algebraic Fitting, Neural Computing, Accepted, DOI 10.1016/j.neucom.2016.06.086.
[pdf]

[7] Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Adherent Raindrop: Modeling Detection and Removal in Video, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 38, Issue 9, pp:1721-1733, 2016.
[pdf] [webpage]

[6] Shaodi You, Detection and Removal of Raindrop Images in A Video Sequence and Their Applications to Computer Vision Algorithms, Doctoral Thesis, The University of Tokyo, 2015.
[pdf]

[5] Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Raindrop Detection and Removal from Long Range Trajectory, 12th Asian Conference on Computer Vision (ACCV 2014 Oral), Nov. 3-5, 2014, Singapore
[pdf] [webpage]

[4] Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Adherent Raindrop Detection and Removal in Video,IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2013), June 25-27, 2013, ortland, Oregon, USA
[pdf] [webpage]

[3] Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi,Robust and Fast Motion Estimation for Video Completion. IAPR Machine Vision Applications (MVA 2013), May 20-23, 2013, Kyoto, Japan.
[pdf]

[2] Shaodi You and Huimin Ma, Manifold Topological Multi-resolution Analysis Method, Pattern Recognition, Volume 44, Issue 8, August 2011, Pages 1629-1648
[pdf]

[1] Xiao Yu, Huimin Ma, Shaodi You, Ze Yuan, A Solution to Efficient Viewpoint Space Partition in 3D Object Recognition,International Conference on Image and Graphic 2009 (ICIG2009), Xi'an, China
[pdf]

 

Mr Junxuan Li »

PhD Candidate

 

[FullCV.pdf]


Experience

2018.1-present

Senior Research Scientist, Data61, CSIRO, Australia (previously known as NICTA)
- Computer vision research group
- Projects: Prosthetic Vision, Digital Archiving, Non-rigid Reconstruction

 

2015.9-2018.1

Research Scientist, Data61, CSIRO, Australia (previously known as NICTA)
- Computer vision research group
- Projects: Prosthetic Vision, Digital Archiving, Non-rigid Reconstruction

 

2016.1-2017.12

 

Chair of Computer Society, IEEE ACT Section, Australia.

2015.10-present

Adjunct Lecturer, College of Engineering and Computer Science, Australian National University.
- Supervising 5 Ph.D. students, 6 master students.
- Teaching

 

2014.4-2014.10

Internship at Microsoft Development, Shinagawa, Tokyo.
- Topic: Multiview rectification rectification of folded document
- Paper submitted, mobile app prototyped
- Coworkers: Dr. Yasuyuki Matsushita, Dr. Sudipta Sinha.

 

2013.2-2013.3

Visiting Multimedia and Geometry Group, Utrecht University, The Netherlands
- Video enhancement

 

2008.1-2010.3

3D Image System Simulation Lab, Tsinghua University
- Advisor: Assoc. Prof. Huimin Ma
- Topics: 3D object modeling and recognition, manifold learning

 

 

Professional Activities

 

Teaching

2018 Computer Vision (ANU, ENGN4528, ENGN6528)
2017 Robotics (ANU, ENGN4627)
2017 Engineering Data Analysis (ANU, ENGN8735)
2017 Individual Project (ANU, ENGN4200)
2016 Robotics (ANU, ENGN4627)
2016 Document Analysis (ANU, COMP4650)
2016 Individual Project (ANU, ENGN4200)

 

Supervising

Ph.D. Students
Kaiyue Lu, ANU (primary supervisor)
Jing Zhang, ANU (primary supervisor)
Peipei Song, ANU (primary supervisor )
Changkun Ye, ANU (primary supervisor)
David Feng, ANU (with Assoc. Prof. Nick Barnes)
Ryota Yoshihashi, U Tokyo (with Assoc. Prof. Takeshi Naemura)
Xiang Wang, Tsinghua (with Assoc. Prof. Huimin Ma)
Yidong Wang, Tsinghua, (with Assoc. Prof. Huimin Ma)

Master Students
Junxuan Li, ANU
Chenyao Qian, ANU
Ziang Cheng, ANU
Jiaming Wei , Tsinghua
Seiichiro Fukuda, U Tokyo

Alumni
Kaiyue Lu, Master, ANU (continue as PhD)
Tu Tuan Trinh, Master, U Tokyo
Zhichen Zhao, Master, Tsinghua

 

Organizing

2018 DICTA General China

2018 ACCV Worshop Chair

2017 ICCV Joint Workshop: Physics Based Vision meets Deep Learning, Venice, Italy. PBDL2017

2016 - present, IEEE Computer Society, ACT Section, Australia.

2014 International Conference on 3D Vision (3DV2014). Tokyo, Japan.

 

Reviewing

IEEE Transaction on Pattern Recognition and Machine Intelligence (TPAMI)
International Journal on Computer Vision (IJCV)
IEEE Transaction on Image Processing (TIP)
ACM SIGGRAPH
Computer Vision and Pattern Recognition (CVPR)
International Computer on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)

 

Invited Talks

Smart Computational Imaging, Nanjing University, Apr. 2017

Smart Computational Imaging, Jiangnan University, Apr. 2017

A Multi-view Light Field Camera from a Single Lens, Microsoft Research Asia, Sep, 2016

Vision in Bad Weather, Peking University, Sep, 2016

Vision in Bad Weather, Nankai University, Sep, 2016

Prosthetic Vision and Artificial Vision, Microsoft Research Asia, Aug, 2016

Vision in Bad Weather, Microsoft Research Asia, Aug, 2016

Vision in Bad Weather, Tsinghua University, Aug, 2016

Vision in Bad Weather, Jiangnan University, Aug. 2016

Adherent Raindrop Detection and Removal in Video. Meeting on Image Recognition and Understanding (MIRU 2013), Japan.
 

 

 

Education

 

2012.10-2015.9

PhD of Engineering, Computer Vision Lab. The University of Tokyo, Japan.
- Full Scholarship (Mext)
- Overall GPA: 4/4 .
- Advisors: Prof. Katsushi Ikeuchi ,
Assoc. Prof. Takeshi Oishi
- Mentors: Asst. Prof. Robby T. Tan,
Asst. Prof. Rei Kawakami
- Topics: robust outdoor vision, rainy scenes, computational photometry, 3D shape modeling

 

2010.4-2012.9

Master of Engineering, Computer Vision Lab. The University of Tokyo, Japan
- Full Scholarship (Panasonic)
- Overall GPA: 3.93/4

 

2005.8-2009.7

Bachelor of Engineering, Department of Electrical Engineering, Tsinghua University
- Advanced Courses in Math and Physics (sub major)
- Recommend for direct admission (free of entrance exam)
- Overall GPA: 88.4/100 (3.71/4)

 

2002.8-2005.7

Experimental High School Attached to Beijing Normal University
- National Science Class directed by The Ministry of Education of China
- Eligible for enter any university in China without exam

 


Publications

 

2018

Xiang Wang, Shaodi You, Huimin Ma and Xi Li, Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2018. [pdf]

 

2017

Yu Li, Shaodi You, Michael Brown and Robby T. Tan, Visibility Enhancement in Scattering Media Survey and Benchmark, Computer Vision and Image Understanding (CVIU), 2017. [pdf]

 

2017

Xiang Wang, Huimin Ma, Shaodi You and Xiaozhi Chen, Edge Preserving and Multi-Scale Contextual Neural Network for Salient Object Detection, IEEE Trans. on Image Processing (TIP). [pdf]

 

2017

Zhichen Zhao, Huimin Ma, Shaodi You, Single Image Action Recognition via Sermantic Part Actions, International Conference on Computer Vision, ICCV 2017. [pdf]

 

2017

Shijie Zhang, Lizhen Qu, Shaodi You, Zhenglu Yang and Jiawan Zhang, Automatic Generation of Grounded Visual Questions, International Joint Conference on Artificial Intelligence, IJCAI 2017. [pdf]

 

2017

Feng Lu, Lei He, Shaodi You, Zhixiang Hao, Identifying Surface BRDF from a Single 4D Light Field Image via Deep Neural Network, IEEE Journal on Selected Topics in Singal Processing, Accepted. [pdf]

 

2017

Diming Zhamg, Fei Xue, Hao Huang and Shaodi You, VBMq: Pursuit Baremetal Perf ormance by Embracing Block I/O Parallelism in Virtualization, Frontier of Computer Science.  Accepted.

 

2017

Kaiyue Lu, Shaodi You, Nick Barnes, Double-Guided Filtering: Image Smoothing with Structure and Texture Guidance, The International Conference on Digital Image Computing: Techniques and Applications, DICTA 2017. Oral [pdf]

 

2017

David Feng, Shaodi You, Nick Barnes, HOSO: Histogram Of Surface Orientation for RGB-D Salient Object Detection. The International Conference on Digital Image Computing: Techniques and Applications, DICTA 2017. Best Paper. [pdf]

 

2017

Junxuan Li, Shaodi You, Antonio Robles-Kelly, Stereo Super-resolution via a Deep Convolutional Network. The International Conference on Digital Image Computing: Techniques and Applications, DICTA 2017. Oral [pdf]

 

2017

Bin Yue, Min Gui, Jiahui Guo, Zhenglu Yang, Jin-Mao Wei and Shaodi You, An Effective Framework for Question Answering over Freebase via Reconstructing Natural Sequences. WWW 2017.

 

2017

Kunming Li, Yu Li, Shaodi You and Nick Barnes, Photo-Realistic Simulation of Road Scene for Data-Driven Methods in Bad Weather, ICCV Workshop on Physics Based Vision meets Deep Learning, 2017. [pdf]

 

2017

Riku Shigematsu, David Feng, Shaodi You and Nick Barnes, Learning RGB-D Salient Object Detection using background enclosure, depth contrast, and top-down features, ICCV Workshop on Mutual Benefit of Cognitive and Computer Vision, 2017. [pdf]

 

2017

David Feng, Shaodi You and Nick Barnes, DSD: Depth Surface Descriptor for Structural Edge Detection, ICCV Workshop on Assistive Computer Vision and Robotics, 2017. [pdf]

 

2017

Changkun Ye, Huimin Ma, Xiaoqin Zhang, Kai Zhang and Shaodi You, Survival-Oriented Reinforcement Learning Model: An Effcient and Robust Deep Reinforcement Learning Algorithm for Autonomous Driving Problem, IAPR International Conference on Image and Graphics, ICIG2017.

 

2016

David Feng, Nick Barnes, Shaodi You and Chris McCarthy. Local Background Enclosure for RGB-D Salient Object Detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2016, Spotlight Presentation). [pdf] [webpage]

 

2016

Shaodi You, Think Locally, Fit Globally, Robust and Fast Surface Matching via Algebraic Surface Fitting, Neural Computing, Special Issue on Multimodal Vision, Elsevier 2016. Accepted, DOI 10.1016/j.neucom.2016.06.086. [pdf]

 

2015

Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Adherent Raindrop Modeling, Detection and Removal in Video.
- Accepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2015
- [pdf] [webpage]

 

2015

Shaodi You, Detection and Removal of Raindrop Images in A Video Sequence and Their Applications to Computer Vision Algorithms
- Doctoral Thesis, The University of Tokyo, 2015.
- [pdf]

 

2014

Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Raindrop Detection and Removal from Long Range Trajectory.
- 12th Asian Conference on Computer Vision (ACCV 2014 Oral), Nov. 3-5, 2014, Singapore
- [pdf] [webpage]

 

2013

Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Adherent Raindrop Detection and Removal in Video.
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2013), June 25-27, 2013, ortland, Oregon, USA
- [pdf] [webpage]

 

2013

Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Robust and Fast Motion Estimation for Video Completion.
- IAPR Machine Vision Applications (MVA 2013 Oral), May 20-23, 2013, Kyoto, Japan
- [pdf]

 

2011

Shaodi You and Huimin Ma, Manifold Topological Multi-Resolution Analysis Method.
- Pattern Recognition, Volume 44, Issue 8, August 2011, Pages 1629¨C1648
- [pdf]

 

2009

Shaodi You and Huimin Ma, Manifold Topological Multi-Resolution Analysis Method based on Spectral Analysis and Local Linearity.
- Bachelor Thesis, Tsinghua University, 2009
- Excellent Thesis Award

 

2009

Xiao Yu, Huimin Ma, Shaodi You and Ze Yuan, A solution for efficient viewpoint space partition in 3D object recognition.
- International Conference on Image and Graphic 2009 (ICIG2009 Oral), Xi'an, China
- [pdf]

 

 

Patents

 

Chinese Patent No. 201710799023.7

Guoxing Ma, Yu Han, Jianing Sun, Yi Zhao, Fengyu Yang, Yueqin Gu and Shaodi You, “An Automatic Surveillance System for Bracket Safety Inspection in Construction Site.

 

Chinese Patent No. 201610279988.9

A System and A Method for Automatic Inspection of Protection Equipment and Operational Capability for Workers' Safety.

 

Chinese Patent No. 201610489505.8

An Automatic System and Methodology for Dust Pollution Monitoring in Construction Site using Image Captured by UAV.

 

 


Awards and Honors

 

2017.9

Digital, National Facilities & Collections Awards 2017
Science Excellence: Vision processing for the Bionic Eye.

 

2017.8

iAWARDS 2017, Research and Development Project of the Year, National Merit Recipient: Vision Processing for Bionic Eye. Australia.

 

2017.5

iAWARDS 2017, Research and Development Project of the Year: Vision Processing for Bionic Eye. Australian Capital Territory. Australian Information Industry Association

 

2017.5

iAWARDS 2017, Consumer Markets:: Vision Processing for Bionic Eye. Australian Capital Territory. Australian Information Industry Association

 

2013.4-2015.9

 

Japanese Government (Monbunkagakusho: MEXT) Scholarship
- University referenced (Rank 1 among applicants)
- Allowance 5,328,000 JPY
- Full tuition fee coverage
- Research funding 3,000,000 JPY

 

2013.4-2015.9

Global Creative Leader, The University of Tokyo
- Research funding 2,200,000 JPY
- Allowance 4,500,000 JPY Granted (3,000,000 JPY withdrawed due to maximum income limit)

 

2013.4-2016.3

SCAT Scholarship
- Allowance 3,600,000 JPY Granted.
- Withdrawed due to maximum income limit

 

2013.4-2014.3

SEUT Doctoral Student Special Incentives Program
- Allowance 1,800,000 JPY Granted.
- Withdrawed due to maximum income limit

 

2010.4-2013.3

 

Panasonic Scholarship
- Allowance 6,120,000 JPY Granted. (900,000 JPY withdrawed due to early graduation)
- Full tuition fee coverage
- Six grants in China per year

 

2009.7

Excellent Thesis Paper, Tsinghua University
- Rank 1 / 90

 

2008.10

Scholarship for Academic Excellence(Class III), Tsinghua University

 

2006.12

Scholarship for Academic Excellence(Class II), Tsinghua University

 

2005.6

Honorable mention in 2004/2005 "First Step to Nobel Prize in Physics", Polish Academy of Science

 

2004.9

First Prize, Chinese Physics Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 

2004.9

Second Prize, Chinese Chemistry Olympic Contest (province -wide)
- Eligibility for direct college addmission without national standard exam.

 

2004.5

First Prize, Chinese Biology Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 

2003.9

Second Prize, Chinese Mathematics Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 


Skills

 

Languages

Chinese(native), English(proficient), Japanese(proficient), French(beginner)

 

Artwork

Comics creations

 

Music

Piano, Erhu(two-stringed Chinese violin)

 


Activities

 

2012.9

 

Volunteer for local rebuilidng after 2011 Japan Earthquake

2015.4-2015.9

Volunteer for disaster relief in Tokyo

 

2010.4-2015.9

Chinese Student and Scholoar Association, The University of Tokyo
- 2011-present Manager of Tennis Circle

 

2005.9-2008.9

Red Cross Society of Tsinghua University
- 2007-2008 Manager of Department of Publicity
- Excellent member award in 2007

 

2005.9-present

Art Society of Tsinghua University
- 2007-2008 Leader of Comic Team

 

Updated:  1 September 2018/Responsible Officer:  Dean, CECS/Page Contact:  CECS Marketing