Just explored the top 10 AI-powered software testing tools, and they’re impressive! SmthOS makes integrating these tools into your testing workflows much easier and more efficient. #SoftwareTesting #AITools #smthOS
Hi Yvonne, I tried many of them in trial versions to see what they can do. Looks promising what they offer. However, I haven't used any of the tools yet in a development team.
Great video , but all these tools focus on creating automated scripts or run tests using ai. Is there a tool that can generate manual scenarios to ensure sufficient test coverages ?
Hi, yes for example Tricentis Test Management for JIRA can generate test cases based on your requirements. I made a video about it here: ua-cam.com/video/R9K0EhHIK8s/v-deo.html
Hi, I have done already several videos on my channel regarding the AI features: - Testrigor with prompt engineering and generating of complete test scripts - Katalon with code explanation and code generation - Testim with smart locators - Virtuoso with self healing and more to come :).
Hi, I haven't heard about any tool with AI to read SRS data to generate the test cases. Are you able to read the SRS data with an own script and then send them to an LLM to generate the test cases?
Hey Daniel, I see that most tools is based on no or low code automation capabilities. Do you think that no or low code is a goes to strategy regarding test automation or it is just for specific cases ?
Hi Antonio, This is hard to say. For the tools I mentioned in the video the low code option is a good one. Many companies already over AI integration also on code level. Take your time to investigate which tools work best for you and your setup. Also important to keep in mind, who is going to use the tools to automate. In case it’s less technical people, the low code tools are a great option.
Thanks Daniel , I think you missed the second to last tool in the thumbnails...How are those tools adopted in e.g Germany, are companies quickly moving to try those out?
Hi SongForTin, not sure what you mean by missing tools in the thumbnails :). I see many companies at least checking the tools for their AI power. So there is a movement, but still many companies are skeptical. Have you noticed something different in your area?
@@DanielKnott Hi I think there were timestamps and the second to last tool ACCELQ didn't have one. Regarding the companies I don't know since I am just starting out my test career.
Hi, I used gpt directly to generate test data. Before I gave it some context. So far I haven't used a tool for test data generation, also haven't seen one yet.
Hii , hope you are doing well .I need a help from you Right now i have 1.5 years of testing experience in selenium Java and manual testing. I would like to learn any AI powered automation testing tools Could you please suggest any
Hi, the mention tools are worth checking. Also please take a look at the videos about testRigor, Katalon and virtuoso. They all show the first AI features in testing.
Hi, well it depends on the use case. For visual comparison I would go for Applitools. Testims offers great set of features for mobile, where as virtuoso is good for web. Stay tuned, there are more AI videos coming in the next weeks. Also in depth showcases of tools :).
Hi Sandesh, take a look at this video ua-cam.com/video/vVrNlKLcFNc/v-deo.htmlsi=oLKhCL_6SAXe5o5G regarding the open source tools. However there are no AI tools included.
yes katalon is one tool including AI features. I missed katalon when I recorded the video. Check my video from last week, where I was showing the AI features of katalon :)
Hi, The tools will have a positive impact on testing. They will help us work more efficient while at the same time provide more insights into the tech we test. You should learn about prompt engineering, LLMs and the tools that matter for your work.
Hey, I have one question like ai and ml has been introduced . How it will going to impact the role of a tester? How one can prepare or say upskill ...as it's the need of the hour. Thanks
Hi, first of all you don't need to be afraid of AI. See the many wrong replies from AI. We as testers have to learn to understand large data models. Get more into reading code and to understand patterns. At the same time AI will bring lots of interesting opportunities. For example we can use AI powered tools that will help us with testing. Taking over simple testing tasks and give us more time to work with the team to establish a quality mindset and to focus on the hard challenges. Hope that helps a bit.
Good overview! It would have been nice, if you had mentioned, if they are commercial tools, but as far as I can see, they all are, isn't it? And you missed testresults. ;-)
Hi @dirkh772, I got an answer to your comment from Katalon, please take a look: "Hi Dirk, Thank you for watching the video and for your insightful questions! We appreciate your interest in Katalon Studio's new Al features. Regarding your concern about sending sensitive code/data to GPT: Katalon Studioassist leverages OpenAl's GPT models to generate test scripts. According to OpenAl's API data usage policies: openai.com/policies/api-data-usage-policies, they will not use data submitted by customers via your API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data." Rest assured, Katalon does not opt-in to share data to train PT models, ensuring that your data remains confidential and secure. About your question on code generation and details of the identifiers: at present, Studioassist does not leverage your existing test artifacts (other test cases, variables, etc.) in code generation, even if they existed before September 2021. You're correct that GPT's knowledge cut-off was in September 2021. Therefore, the generated code will not include the latest Katalon keywords that were released after that date. This is a known limitation. However, we are actively working on improving this aspect, and the ability to include new keywords will be part of future releases. If you have further questions or concerns, please don't hesitate to reach out. Your feedback is valuable to us as we continue to enhance Katalon Studio. Best, Mai Le Senior Product Manager Katalon Team"
Hi @SPaul-wu8fz, I think you need to implement that on your own. You can get access to the openAI API, with that you can code the things you want to have no matter which testing tool you are using. What do you have in mind? You want to share it with us?
Hi, thanks for the comment? What do you mean by your comment? I think that the AI tools covered in the videos is not complete. I am already working on new videos in that space! Stay tuned
@@DanielKnott I am actually in IT industry, working for Insurance company as a Manual tester, But at present I am learning Core java and Selenium to Move to automation Testing so Industry is not a barrier for me, I can move to any so I just wanna know which is a widely used tool, I really new in this field!
I would recommend you to get into automation first. Learn about selenium and other tools. This is a solid skill which will remain important the next years. The AI features in the tools used need some more iterations to get better and better to help us as tester get better in our daily work.
Hi, good question. The tools that I have listed do not support any a11y testing. But, I can think of support of AI to check for a11y in the near future. Do you know any a11y tool in that direction?
In this video I gave an overview (not complete one) about the testing tools that are using AI. I have more ideas on my video list about AI and tooling.
Thanks for this video Daniel. Its exactly what I was looking for
Hey are you learning any AI tool that's related to Testing??
Just explored the top 10 AI-powered software testing tools, and they’re impressive! SmthOS makes integrating these tools into your testing workflows much easier and more efficient. #SoftwareTesting #AITools #smthOS
Thanks for your comment. Never heard about SmthOS. Need to check it out. You have some further information on it?
Thanks for the overview! Do you have a favorite tool amongst these ten? Or do you actually use one (ore more) of the tools you mentioned?
Hi Yvonne, I tried many of them in trial versions to see what they can do. Looks promising what they offer. However, I haven't used any of the tools yet in a development team.
Really informative but would have much better if you would have mentioned which one is open source
well non of them is. So far I don't know any open source AI testing solution.
Great video , but all these tools focus on creating automated scripts or run tests using ai. Is there a tool that can generate manual scenarios to ensure sufficient test coverages ?
Hi, yes for example Tricentis Test Management for JIRA can generate test cases based on your requirements. I made a video about it here: ua-cam.com/video/R9K0EhHIK8s/v-deo.html
Hi @@DanielKnott, it's really a super awesome video, just wanted to know if there is any tool for Rally for Test Management?
Hi, what do you mean by „Rally“ here?
I guess he meant tally
@@DanielKnott Rally is another Project management tool. Just like Jira. But not as popular.
Hi Daniel, Do we have any open source testing tools with AI capabilities ?
Hi, unfortunately I don't know of any open source AI tool.
Thanks a lot Daniel. All the mentioned tools are only paid tools??
Hi, askui is partially free, but the rest of the tools are paid ones. But all of them offer free trials to see if they fit your needs.
Thanks, Videio is very Informative for me
Glad you liked it
Thanks for the great recommendations!
Glad you like the video. Which tool are you using?
@@DanielKnott I tried few of them, but Applitools caught my attention :)
Daniel can you please do some hands on videos and show how you can use these tools
Hi,
I have done already several videos on my channel regarding the AI features:
- Testrigor with prompt engineering and generating of complete test scripts
- Katalon with code explanation and code generation
- Testim with smart locators
- Virtuoso with self healing
and more to come :).
Great I need tool to read SRS and generate Test cases and integrate with CI\ CD
@DanielKnott
Hi, I haven't heard about any tool with AI to read SRS data to generate the test cases. Are you able to read the SRS data with an own script and then send them to an LLM to generate the test cases?
Hey Daniel, I see that most tools is based on no or low code automation capabilities. Do you think that no or low code is a goes to strategy regarding test automation or it is just for specific cases ?
Hi Antonio,
This is hard to say. For the tools I mentioned in the video the low code option is a good one. Many companies already over AI integration also on code level.
Take your time to investigate which tools work best for you and your setup. Also important to keep in mind, who is going to use the tools to automate. In case it’s less technical people, the low code tools are a great option.
@@DanielKnott thank you so much mate .
You are welcome.
Thanks Daniel , I think you missed the second to last tool in the thumbnails...How are those tools adopted in e.g Germany, are companies quickly moving to try those out?
Hi SongForTin,
not sure what you mean by missing tools in the thumbnails :). I see many companies at least checking the tools for their AI power. So there is a movement, but still many companies are skeptical.
Have you noticed something different in your area?
@@DanielKnott Hi I think there were timestamps and the second to last tool ACCELQ didn't have one. Regarding the companies I don't know since I am just starting out my test career.
ah these we added by YT automatically. Maybe there is a bug ;)
Keysight Eggplant is not on the list?
No. When I created that video it wasn’t on my radar. Is it worth checking?
Hi Daniel. Thanks for this. Is there any AI tools for data testing for eg. Synthrletuc or training data for AI projects? Any leads will be useful
Meant synthetic data or training data
Hi, I used gpt directly to generate test data. Before I gave it some context.
So far I haven't used a tool for test data generation, also haven't seen one yet.
most of them do not publish price. „Request Quote“ sounds expensive
Give them a try. Most of them offer 14 - 30 days trial. They have individual packages depending on your needs.
If the price is too high, a trial would be kind of waste of time ;)
True. Maybe send them a message upfront and ask about ranges :)
Hii , hope you are doing well .I need a help from you
Right now i have 1.5 years of testing experience in selenium Java and manual testing.
I would like to learn any AI powered automation testing tools
Could you please suggest any
Hi,
the mention tools are worth checking. Also please take a look at the videos about testRigor, Katalon and virtuoso. They all show the first AI features in testing.
Which tool do you recommend it from this ten?
Hi,
well it depends on the use case. For visual comparison I would go for Applitools. Testims offers great set of features for mobile, where as virtuoso is good for web.
Stay tuned, there are more AI videos coming in the next weeks. Also in depth showcases of tools :).
Hi , Is there ai based performance testing tool ?
Hi, I haven’t heard of any tool so far. But I think it’s a matter of time.
Hi Daniel, can please make a vedio on open source tools available for testing and if possible cover ai tools in this also
Hi Sandesh, take a look at this video ua-cam.com/video/vVrNlKLcFNc/v-deo.htmlsi=oLKhCL_6SAXe5o5G regarding the open source tools. However there are no AI tools included.
@DanielKnott thanks man.
Please make a vedio on AI tools also 😊
I am already preparing one. Coming soon@@sandeshprabhu8047
katalon?
yes katalon is one tool including AI features. I missed katalon when I recorded the video. Check my video from last week, where I was showing the AI features of katalon :)
@@DanielKnott Great! I’ll surely check it out.
TestIm
Aplitools
AskUi
Virtuous
Mabl
Qyrus
Aqua ALM
Perfecto scriptless
AccelQ
Functionize
Hi, thanks for your answer. You mention some great tools! Some of them I already covered in my videos. There is more to come!
Hi Thanks for the video..
So what would be the impact of these toolsbon Testing ?
Being a QA one should start learning/adapting these tools?
Hi,
The tools will have a positive impact on testing. They will help us work more efficient while at the same time provide more insights into the tech we test.
You should learn about prompt engineering, LLMs and the tools that matter for your work.
Hey,
I have one question like ai and ml has been introduced .
How it will going to impact the role of a tester?
How one can prepare or say upskill ...as it's the need of the hour.
Thanks
Hi,
first of all you don't need to be afraid of AI. See the many wrong replies from AI. We as testers have to learn to understand large data models. Get more into reading code and to understand patterns.
At the same time AI will bring lots of interesting opportunities. For example we can use AI powered tools that will help us with testing. Taking over simple testing tasks and give us more time to work with the team to establish a quality mindset and to focus on the hard challenges.
Hope that helps a bit.
@danielknott out if these which one you will suggest
Depending on your use case and product you want to test, I recommend to take a look at testim, askui, testRigor, virtuoso.
TestRigor is also quite interesting, it seems.
Thanks for the hint @Dan, I will take a look at TestRigor.
Thank you, great insight
Glad you like the video. Are you using already AI tools in your job?
Thank you
Have a great day
What tool will best suited for Infrastructure testing
I haven’t used any tools for this area yet.
Please suggest AI tool for Data driven testing with excel+python
Hi, I have no tool in mind specifically for excel and python sorry
Good Informative. Can you Suggest which is Best?
Thanks for your comment. The tools offer different set of features for different purposes. What task you want to solve with AI assisted testing tool?
Thanks, Daniel, which one would you recommend for mobile testing?
Well, the tools offer different aspects. What is your goal when testing a mobile app with AI? Anything specific in mind?
Good overview! It would have been nice, if you had mentioned, if they are commercial tools, but as far as I can see, they all are, isn't it?
And you missed testresults. ;-)
Hi @Dirk Hartung, yes you are right, I missed the info about the pricing. And yes I do missed testresults 😌 and I bet I missed many more tools.
Hi @dirkh772,
I got an answer to your comment from Katalon, please take a look:
"Hi Dirk,
Thank you for watching the video and for your insightful questions! We appreciate your interest in Katalon Studio's new Al features.
Regarding your concern about sending sensitive code/data to GPT: Katalon Studioassist leverages OpenAl's GPT models to generate test scripts. According to OpenAl's API data usage policies: openai.com/policies/api-data-usage-policies, they will not use data submitted by customers via your API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data." Rest assured, Katalon does not opt-in to share data to train PT models, ensuring that your data remains confidential and secure.
About your question on code generation and details of the identifiers: at present, Studioassist does not leverage your existing test artifacts (other test cases, variables, etc.) in code generation, even if they existed before September 2021. You're correct that GPT's knowledge cut-off was in September 2021. Therefore, the generated code will not include the latest Katalon keywords that were released after that date. This is a known limitation. However, we are actively working on improving this aspect, and the ability to include new keywords will be part of future releases.
If you have further questions or concerns, please don't hesitate to reach out. Your feedback is valuable to us as we continue to enhance Katalon Studio.
Best, Mai Le Senior Product Manager Katalon Team"
Thanks
nice video. you look like superman
Thank you. I am on my software testing mission to help the testing community learn and grow 🤩
Please mention some good AI tool for API testing
Hi,
Added this to my video list. Have a great day!
is there any way to integrate AI with selenium webdriver using Java and testng?
Hi @SPaul-wu8fz,
I think you need to implement that on your own. You can get access to the openAI API, with that you can code the things you want to have no matter which testing tool you are using.
What do you have in mind? You want to share it with us?
Are you working on any AI powered tools ?
practical can u update a video
Hi, thanks for the comment? What do you mean by your comment? I think that the AI tools covered in the videos is not complete. I am already working on new videos in that space! Stay tuned
Hi Daniel, thanks for the tools, but can you suggest me which is in demand tool for the AI testing jobs?}
Thanks in advance!
Hi,
that is difficult to say without knowing in which industry, domain you are working in. Can you share some more information, please?
@@DanielKnott I am actually in IT industry, working for Insurance company as a Manual tester, But at present I am learning Core java and Selenium to Move to automation Testing so Industry is not a barrier for me, I can move to any so I just wanna know which is a widely used tool, I really new in this field!
I would recommend you to get into automation first. Learn about selenium and other tools. This is a solid skill which will remain important the next years. The AI features in the tools used need some more iterations to get better and better to help us as tester get better in our daily work.
@@DanielKnott Ok ok, Thank you for the reply Daniel ❤️🙏
@@rudrabhatt2065 You are welcome
Nice review, i will try this tools with my guys from QA department. I'll come back with my feedback in a month)
This would be really cool!
Aaaand?
@@orcsword😅😅😅😅😅😅hi 😅😅😊😅😅😅😅k😅😅😅😅😅😊😅😅😅😊😊😅😊😅😅😅😅😅😅😊😅😅😊😊
8 months over so far , what a commitment, I think he shifted his address in the QA department permanently 😂
Nice video and tips, Daniel! I'll definitely take a look at this tools! Thanks again for sharing it :)
You are welcome! Let me know if you find other tools powered with AI!
Thank for this review Daniel, totally worth checking these tools out!
Absolutely Polina. It's really cool to see so many tools now adding AI features. It will help us in our daily work. What tools are you using?
Thanks for sharing. How would I use these tools to carry out accessibility testing?
Hi, good question. The tools that I have listed do not support any a11y testing. But, I can think of support of AI to check for a11y in the near future. Do you know any a11y tool in that direction?
no offense but if your specialty is software testing, why aren't you telling us what works for you
In this video I gave an overview (not complete one) about the testing tools that are using AI. I have more ideas on my video list about AI and tooling.