How Many Wings does the Giraffe Have? - Hallucinations in MLLMs

  • Home /
  • Schedule /
  • How Many Wings does the Giraffe Have? - Hallucinations in MLLMs

How Many Wings does the Giraffe Have? - Hallucinations in MLLMs

  • Emerging Technologies
    •
  • Short Talk
  • Beginner
    • Image Description

    By Johannes Kolbe

    Data Scientist

    Abstract:

    Welcome to the first Multimodal Large Language Model (MLLM) Game Show of the Universe!

    Take your seat, grab some snacks, and prepare for confused MLLMs in this light-hearted presentation. We will do our best to probe State-of-the-Art MLLMs by asking them totally legit questions like "How many wings does the giraffe have?" or "Why is there an elephant in the tree?".

    You will get to know categories of deceptive prompts, datasets, benchmarks, and evaluation metrics. We will also take a look at ways to mitigate the risks of hallucinating MLLMs. And of course, by the end, we will know which of our MLLMs is the winner of this unique and never-before-seen game show!

    So come and join us for this mind-boggling, token-skewing, Neural-Network-breaking presentation!

    There is no previous knowledge required, listeners of any skill level are welcome. By attending this talk, you'll gain a better understanding of the challenges and limitations of MLLMs, as well as practical insights into how to evaluate and improve their performance.

    Here is the approximate schedule: 5 min - What are MLLMs? 5 min - Introducing the Game Show and categories of hallucinations 10 min - Probing the MLLMs 5 min - Mitigating Hallucinations risks 5 min - Closing Thoughts, Game Show Goodbye

    GO BACK

    Other Talks

    Image Description