Bots testing bots: from manual to automated testing for conversational AI

These are recordings from the Austin Automation Professionals meetup that I organize with some cool people.
Testing is a crucial enabler for the success of chatbots and voice assistants. Doing it manually requires enormous time and effort. As DevOps and furthermore AIOps grow in importance, automated testing will remain critical to ensure that bots actually do what their designers intend.
Unlike traditional software where the application follows a predefined flow, a chatbot runs without any restrictions. Talking to a chatbot has no barriers. Combining this with an unpredictable user behaviour, it becomes utmost difficult to verify the correctness of conversational AI. Training data and test sets are infinitely large. In fact, quantity plays a mature role in quality assurance for bots but makes it impossible to test manually.
We will tackle the main questions arising: "Why are bots failing", "What and how should you test?" and of course mainly "How can we automate the testing and training".
In addition, you will get hands-on experience in running your first automated tests using Botium.
Christoph Börner
www.botium.ai/
Austin Automation Professionals Meetup information:
www.meetup.com/Austin-Automat...