Write Playwright Tests in Seconds with ChatGPT!?

[@andersonmann]

Very helpful. Greetings from Brazil

[@TestingMatters]

If the complete code, incorporating validation and data flows, is available and provided to the LLM with a suitable prompt, success is almost certain. The LLM can generate Page Objects and a comprehensive set of positive and negative tests. From my experiments, Claude 3.5 has shown excellent capability in creating quality Playwright artifacts, but the results rely heavily on the context and the clarity of the prompt (e.g., specifying locator preferences). The challenge becomes apparent with component-based frameworks like React and Angular, where validation logic and data flows might be scattered across components or APIs. Without clear business rules or fully accessible code, it often feels like a game of peek-a-boo, leaving QA to ask the eternal question: “Show me the requirements!”

[@ChecklyHQ]

Yeah, that's right and thanks for the comment. I would be very keen on seeing a prompt that works well for you.

[@gdd546]

i also have tried this as I was learning playwright automation. i'd gather all the locators and test files 'd need updating, and then write specific prompts. i was surprised when i was given a code that worked fully, along with each test file updated correctly with the new page objects and methods. at first my prompts weren't so good, but then i realised i'd need to be more specific with locators and test files. i work with a fully developed framework already, so theres alot of files that talk to each other

[@kapilkapoor7191]

Honestly I loved the content.

[@ChecklyHQ]

Thank you! Glad it was valuable! 🦝

[@Muhammad55597]

the best content for playwright 👌

[@manuQAE]

Very Cool! the best content for Playwright!

[@ChecklyHQ]

Thank you! Great to see that you're still following along. 💙

[@ppp.1334]

Cool, But what happend when you have more complex issue With more files Like passing context etc - I have problem too keep browser connections When one test finishes and another should be run the same session, Any suggestions?

[@alejandrosejas]

great content, perhaps you could showcase how, codegen generated code can then be updated to use POM and omit clicks() etc using CursorAI

[@ChecklyHQ]

Yes! This is only part one of a planned series. Cursor and Copilot are next. And I'm very grateful for every suggestion. Thank you! 🦝

[@alejandrosejas]

@@ChecklyHQ@ChecklyHQ, we are very grateful that you and your team keep releasing this quality of content! It is really useful, and I've learned a lot from your videos. Please keep them coming! 🎭

[@ChecklyHQ]

Thanks for the kind words! 💙 Happy the videos are valuable.

[@og4789]

Very impressive, Thank you for your efforts!

[@ChecklyHQ]

My pleasure! 🦝

[@og4789]

Do you know the command for codegen in case of using .env files?

[@ChecklyHQ]

@@og4789 I'm not sure I understand. How do .env files relate to codegen?

[@og4789]

So baseURL from env variables I have to type always manually into npx playwright codegen command right?

[@ChecklyHQ]

Yes I think so. :)

[@sen86sen]

have you tried with snapshots feature which is released today ??

[@ChecklyHQ]

I haven't checked the new feature yet, but I might play around with it next week. :)

[@sen86sen]

@ thanks for your reply

[@alexanderkomanov4151]

Thanks for your video. What about searchgpt, that can access the web. Or maybe perplexity, that also can go to the web sources.

[@ChecklyHQ]

I haven't used any of these but I'll put them on the list for possible future videos. Thank you! 🦝

[@tririfandani1876]

Nice video Stefan! you should try using the new claude computer use API, it will opens up a lot more possibilities, for example I think we can omit the html/css/js context to the prompt

[@ChecklyHQ]

Great idea! I'll put it on the list because I'm planning a series and this video is only part 1. 🫣 Thank you!

[@Kabbinj]

First mistake was to use gpt4, instead of o1. It would probably have been able to do more with less. Anyways, you do not use chatgpt for this, and you mention, you need custom built in tools that can on their own, in an iterative fashion, fetch the data they need to keep writing the test.

[@ChecklyHQ]

Thanks for the tip. I just played with o1 a little bit and I couldn't find a real improvement. Without enough context, they both fail to generate good code, and with enough context, roles and rules, they both succeed. > you do not use chatgpt for this I 100% agree with you; I took this example as the kick-off, because I've literally seen these instructions in some docs: "To get started with Playwright, head over to ChatGPT and tell it what it should do"... And I'm not kidding. 🫣

[@aidoka2000]

Tabnine ai extension can help as well

[@ChecklyHQ]

Thank you! I'll check it out!