ELLIS Unit Stuttgart - Distinguished Lecture Series - Talk by Sabine Süsstrunk

"On Generating Image and Video Hallucinations". Talk by Sabine Süsstrunk from EPFL. July 3, 2024, in person.
Abstract:
“Hallucination” is a term used in the AI community to describe the plausible falsehoods produced by deep generative neural networks. It is often considered a negative, especially in relation with large language models or medical image reconstruction. Yet, in many computational photography applications, we rely on such hallucinations to create pleasing images. It often does not matter if all (or any) information was present in the real world if the produced falsehoods are visually plausible. Starting from that premise, I will present our recent work on hallucinations in image reconstruction, semantic editing, and texture synthesis, using different generative models such as diffusion networks, neural radiance fields, and neural cellular automata. With a nod to the dangers some of these hallucinations might pose, I will also briefly discuss our work on deep fake detection.
ellis-stuttgart.eu