Test Driven PROMPT Engineering: Using Promptfoo to COMPARE Prompts, LLMs, and Providers.

[@timkoehler86]

Thank you! Really good video and I also love that you do not just show their docs, but take the time to create and show actual examples.

[@HerroEverynyan]

This video is ridiculously insightful. You've explained everything in such a lucid manner, and your video is so well structured - after explaining something it's like you were addressing the next question that popped in my head. Fantastic job!

[@s_streichsbier]

Perfect, was looking for exactly this. Thanks for sharing!

[@judymou4611]

love the insights related to gpt3 vs 4 comparison, and the message around how testing saves time!

[@vazquezsebastian9764]

Thank you !! Great video and content, clearly gonna try and implement in my processes. If you like it keep up the good work

[@gigglesmclovin]

I don't even need to know what this video is about to know that I need to watch it.

[@cutmasta-kun]

Wait. I can only test prompts against barebone models? How would I test an agent? Something, that can be executed and returns a response?

[@macoson]

You said that in case of recognizing NLQ gpt3.5-turbo is 10 x faster and 4 x cheaper than gpt4. It is actually 40 times cheaper as gpt 3.5 is 10 times cheaper per 1000k tokens

[@fire17102]

Exactly

[@fire17102]

Thanks for the lesson Andy, though after the ttydb project i was sure this will showcase how to automate prompt optimization ontop of promptfoo. Like ttydb, i believe we can make an agenticFoo that constantly and consistently improves prompts through out any project. What do you think? Meanwhile all the best ❤

[@SynonAnon-vi1ql]

Hi @IndydevDan, I have been enjoying your autogen tutorials and experimenting. But suddenly I came to know about Langchain. Call me novice but what's the difference between these two?

[@mikew2883]

Steller video! 👍

[@Jeganbaskaran]

I dont know how we can use it in the real time... can't make everytime assert for every usecase and different set of prompt and requirement?

[@jaysonp9426]

This title is anti click bait