[03] Perception (Waabi CVPR 24 Tutorial on Self-Driving Cars)

In this session we will discuss how to build a robust 3D perception system by exploiting information from different sources, with different sensor fusion strategies. We will also talk about different output representations that have been used for perception and introduce challenges when we deploy the perception system in the real world, such as unknown object recognition, and take into account the system latency.
Speaker: Sergio Casas
---
A full day tutorial from Waabi covering all aspects of autonomous driving. Delivered at the top international computer vision conference, CVPR, this tutorial will provide the necessary background for understanding the different tasks and associated challenges, the different sensors and data sources one can use and how to exploit them, as well as how to formulate the relevant algorithmic problems such that efficient learning and inference is possible.
We begin by introducing the self-driving problem setting and a broad range of existing solutions, both top-down from a high-level perspective, as well as bottom-up from technological and algorithmic points of view. We will then extrapolate from the state of the art and discuss where the challenges and open problems are, and where we need to head towards to provide a scalable, safe and affordable self-driving solution for the future.
Since last year’s instance (waabi.ai/cvpr-2023/), countless new and promising avenues of research have started gaining traction, and we have updated our tutorial accordingly. To name a few example, this includes topics like occupancy forecasting, self-supervised learning, foundation models, the rise of Gaussian Splatting and diffusion models for simulation as well as the study of closed-loop vs. open-loop evaluation.
See the tutorial website for more information: waabi.ai/cvpr-2024/