Webinar "UI-based AI agents - Why and How?"

Video of the webinar "UI-based AI agents - Why and How?" on 14.06.2024
Speaker - Tobias Norlund / Research Scientist
AI systems and smart assistants are set to disrupt the way we work and get things done. In the future, these systems will not just be able to answer questions or draft emails, but also take action and execute tasks on our behalf.
In this talk, I will present a novel AI model that takes a step in this direction, UI-Act. UI-Act is a Transformer model, much like a LLM, that however takes pixel-based screen input and outputs mouse actions (clicks), instead of textual tokens. This makes the model capable to learn and execute literally any tasks on a computer. I will showcase this through a demo and argue for why I think this will become the next big AI breakthrough in the coming years.
What is an AI agent?
How to design agents?
Designing agents towards generality
UI-based agents for assisting knowledge work
👇👇👇👇👇👇👇👇👇👇👇👇👇👇👇👇👇👇👇
🚀Be part of the Community of Great Devs!
Join a community with zero bureaucracy and led by one mantra - common sense.
We have the best job opportunities, activities, webinars, and moooore!
Interested? Just fill out the form on the website - developersshore.com/community/
☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️☝️
Explore Our Job Opportunites - developersshore.com/career/
Follow Us!
Linkedin - bit.ly/DevShore-in
Facebook - bit.ly/DevShore-FB