Seamless Software Testing with Supercharged AI - Katalon & The Power of openAI

[@nationalfinancialadvisors7709]

I'm a big fan of using AI in software testing and I'm glad to see that Katalon is embracing this technology. The features you demonstrated in the video look very promising and I'm excited to try them out myself and my team. Thanks for this Daniel.

[@DanielKnott]

You are welcome! What tools are you using or consider using?

[@nationalfinancialadvisors7709]

@@DanielKnott Considering to use Katalon. Any recommendations?

[@DanielKnott]

@@nationalfinancialadvisors7709give it a try. you can download and try it out if it fits your needs. I can recommend it when you want to generate code and test cases.

[@dirkh772]

Great video, thanks for the overview of these cool features! Two points: 1. I guess you need to be careful to send code / data to GPT as GPT may learn from your code, which you may not want when it is sensitive code. Or does Katalon ensure, that this is not used by the LLM to learn from? 2. On the StudioAssist preferences for GPT it showed, that it is using gpt-3.5-turbo. But gpt-3.5 is not able to browse the internet. So where does the code generation get the details of the identifiers get from? Would it work with a page, which was just developed and did not exist in 2021?

[@DanielKnott]

Hi Dirk, thanks for your comment, and I am glad you like the video. I totally agree with your first point. I forgot to add this to the video. Companies must be aware of this case and must consider themselves if they want to use such a feature or not. To your second point, I don't know the details on the implemented features, what is used and generated by chatGPT and what parts are own ML implementations. Maybe I should try to see what happens with a page beyond 2021 ;).

[@DanielKnott]

Hi Dirk, I got an answer to your questions from Katalon, please have a look: "Hi Dirk, Thank you for watching the video and for your insightful questions! We appreciate your interest in Katalon Studio's new Al features. Regarding your concern about sending sensitive code/data to GPT: Katalon Studioassist leverages OpenAl's GPT models to generate test scripts. According to OpenAl's API data usage policies: openai.com/policies/api-data-usage-policies, they will not use data submitted by customers via your API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data." Rest assured, Katalon does not opt-in to share data to train PT models, ensuring that your data remains confidential and secure. About your question on code generation and details of the identifiers: at present, Studioassist does not leverage your existing test artifacts (other test cases, variables, etc.) in code generation, even if they existed before September 2021. You're correct that GPT's knowledge cut-off was in September 2021. Therefore, the generated code will not include the latest Katalon keywords that were released after that date. This is a known limitation. However, we are actively working on improving this aspect, and the ability to include new keywords will be part of future releases. If you have further questions or concerns, please don't hesitate to reach out. Your feedback is valuable to us as we continue to enhance Katalon Studio. Best, Mai Le Senior Product Manager Katalon Team"

[@dirkh772]

@@DanielKnottHi Daniel, great, thanks for following up, this is interesting!👍

[@bandutube]

This is a great video, a lot of very important information is shared. Thanks. In my case, OpenAi does not consider Custom Keywords, even though it's a paid version

[@KamluKumar-tc1np]

Video 📸📸📸📸