Events Add an event Speakers Talks Collections Sign out
 
Duration 17:36
16+
Play
Video

How to Effectively Test Your Chatbot | Rasa Summit

Soumya Mukherjee
Director QA, DevOps & AIML at APTY.IO
  • Video
  • Table of contents
  • Video
Rasa Summit 2021
February 12, 2021, Online, USA
Rasa Summit 2021
Request Q&A
Video
How to Effectively Test Your Chatbot | Rasa Summit
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Add to favorites
361
I like 0
I dislike 0
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
  • Description
  • Transcript
  • Discussion

About speaker

Soumya Mukherjee
Director QA, DevOps & AIML at APTY.IO

About the talk

QA has always been under-rated and thus it is important to consider this equally important as the Dev. If we look at the Chatbot QA, it had been considered as a highly challenging work specially when you do not know where your bot may break while you sequentially will be only running your flow (stories). Most of the companies / tools only check the flow which are coded in a fixed format which often breaks while testing. There may be cases where bot are migrated to new version and it breaks. The presentation will discuss the possibilities to test the bots by helping folks to create their coverage matrix for your stories, efficiently looking at the logs and mine information and most importantly what to test and which components to test.

Presented by Director QA, DevOps & AIML at APTY.IO, Soumya Mukherjee at the 2021 Rasa Summit https://rasa.com/summit/

- Learn more about Rasa: [https://rasa.com​](https://www.youtube.com/redirect?even...​)

- Rasa documentation: [http://rasa.com/docs​](https://www.youtube.com/redirect?even...​)

- Join the Rasa Community: [https://forum.rasa.com​](https://www.youtube.com/redirect?even...​)

- Twitter: [https://twitter.com/Rasa_HQ​](https://www.youtube.com/redirect?even...​)

- Facebook: [https://www.facebook.com/RasaHQ​](https://www.youtube.com/redirect?even...​)

- Linkedin: [https://www.linkedin.com/company/rasa​](https://www.youtube.com/redirect?even...​)

#conversationalai #aichatbots #nlp

Share

Hi guys, welcome to buy professional Milky Way and I were talking and a half years of experience into a few has been not in the Limelight until 2018 when they came on board and then be actually tested the first picture. When we migrated I love slow in the stories, 2020 Journey for me started. How are we right now? Doing the freeway? This is from the experience that I've got into until something in British companies and working on the chakra forms and the second phase will see the water

issues in. And then the third one is stuck. How we can effectively Desitin? What two things that I bought for the. When I say manhole, you know, it's really really complex. Is it supposed to rain in August Lee? Just understands what section is so small dogs and then polbox checks and also check the integration, start the JavaScript And then some of the companies which have seen is that they say they don't believe in you. What are the interesting fact that I've seen into it is in their testing? Most of the time

they were changing it once or twice and then they would just give us that are being trained by the engineers. I'm so, how are they behaving while we are conversing with the bartender? What are the stats of elephants? Technical Theatre. Infantilism. What's the result? Is that most of the time 90% of the time break time. Most of the time you can look at the parts that are there in the market. There's a page on that continuously evolving and sori's Realty. In the problem

that can be you may end up not having the right stuff. What are the important things? And the issue is that there is no 2 - $1,000 and then somehow you never know what that means. You're cleaning data, may not correspondent continues to is, it's alive, is that I've seen where they know the production data is never brought took away and was never been trained. And that's the reason, you know, if the stories are changing it doesn't match up. In the in the actual conditions, these are part and parcel when it can create stories with with the

actual conditions if I'm available, very easy, portability moving from one platform to another and then tinkle. I have to be in control condition. Wherein we were following simple State transition, way of managing our checks, but then we did not want to go and check on drugs or any other side because of the reason that are underlined to complex, There are no centralized dashboards available right now, there are tools which are coming up with this. They say that they

have their own platform to support. There is nothing for dessert. If I'm using resign from using any other provider, I will not be able to check unify the results in both teams stand for that's missing. Actually doesn't tell me that, you know how, how many intense advanced than most dogs have been identified. There's no easy way to reset the PIN for to text the problem, with the key waste of money to bet in The avitus Things become difficult because there is no standard way of turning available. And if so,

when you're working with multiple sections, better than one language is an English language arts There is one more problem that we have seen in the freeways that if you have a high confidence core team for multiple in 10, my wife is feeling how to make your best effective exchange questions, digression, digression State Less Conversation to what we do. And then what we do is we try to see you know how they are performing. At least, I can send them find him. Be also have seen that, you know, you

need to map your entities properly for comments in that looks like if I'm paying the fee for a bus, I know I'm being a Martin Sheen. Okay. And if I do not have four entities for what sizes, I mentioned it like a then we could always a map to my Fusion fees. Even if I saw that is where you need to have your utilities to turn off location. Automotive test to shoukanjuu mall, stories and run them, each time part of the regression. So what we do is Vitamin B used to extract all the stories and

then try to automate it. So you basically use the data and then if you'll be small, Excelsior Springs to be also understand how to properly store used to have a flu Stories about exactly within 40 in for a new tattoo. And, you know, they are not able to talk about things that people have a story in which each and then, you know, and are to do manual testing. Today, please remind me to use a bottom of the ocean for dr. Mark matching an easy way. Other than that,

we need to have a centralized exporting, which actually gives us the country. Also gives us the value for humidity, like, for this week. And one of the important thing that we have seen is gloss. One edition is one of the coolest way to actually make it is important to have all the permutation and combination of the day, we always believed in. I have to do this again. We need to also check the integration across platforms. One of the important thing which is needs to be done and

North. Before she died on board on what server and then start talking with our bought one. That's 10 in extreme conditions. How was your body of the three? Most important that we should probably also been secretly testing wedding. We need to check VPN connection because one of the one of the things that is the most what is also. I'll be also need to quickly check the time typing speed between two Automation and that is why Please check if the vortex companies. Some other people's roof rack. What is the activity? Volume

retention rate of your possessions Town conversation, then, identified and then things a feedback. This is one of the most important thing is that after this one actually check where the user is good for using each month. What is going to bang 551 position? And then if it is, not then, Intelligent dogs, having sex at all. These are some ways that basically what she wear and information.

Cackle comments for the website

Buy this talk

Access to the talk “How to Effectively Test Your Chatbot | Rasa Summit”
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free

Ticket

Get access to all videos “Rasa Summit 2021”
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Ticket

Interested in topic “Artificial Intelligence and Machine Learning”?

You might be interested in videos from this event

October 7 - 20, 2020
Online, Mountain View
19
5.41 K
google, googledevs, it, machinelearning, mlsummit, network, platform, tensorflow, tfx

Similar talks

Evgeniia Razumovskaia
Machine Learning Research Intern at Rasa
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Alan Nichol
Co-founder & CTO at Rasa
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free
Hans Van Dam
Co-founder and CEO at Conversation Design Institute
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free

Buy this video

Video

Access to the talk “How to Effectively Test Your Chatbot | Rasa Summit”
Available
In cart
Free
Free
Free
Free
Free
Free
Free
Free

Conference Cast

With ConferenceCast.tv, you get access to our library of the world's best conference talks.

Conference Cast
742 conferences
30258 speakers
11303 hours of content