Deep Learning for 3D Scene Understanding

In computer vision applications such as mobile robotics and autonomous driving, 3D scene understanding refers to the problem of inferring both the semantics and the geometry of a scene from sensor data. With the deep learning revolution, massive improvements have been made in semantic tasks – i.e. answering what we are looking at. The impact of deep learning on geometric tasks – i.e. answering where things are and what shape they have – has, however, not yet been as prominent. In this talk, some recent work on deep learning for geometric tasks will be covered. One example will be taken from work on 3D object detection carried out by Eskil and his colleagues, along with some discussions on how thinking about uncertainty and data representations can be helpful when designing machine learning models.