EP 18: How to Use the AI Task | Prompting & Conversational Memory

In this week's stream, Robert demonstrates how to prompt the AI task and enable long-term or conversational memory in your chatbot.
This was originally streamed on our Discord server on October 31st, 2023.
🤖 Try Botpress now for free: hubs.la/Q01Lf4-J0
🔔 Subscribe for more Botpress tips, tutorials and features: hubs.la/Q01Lf74q0
-------------
👉 Follow Botpress on LinkedIn: hubs.la/Q01Lf6Wm0
👉 Find us on Twitter: hubs.la/Q01Lf6Y70
👉 Join the conversation on our Discord server: hubs.la/Q01Lf6V-0
About Botpress:
Botpress is a user-friendly platform that empowers individuals and teams of all sizes to design, build, and deploy AI-powered chatbots for various applications. As a pioneer in the chatbot industry, we embrace the power of large language models (LLM) and generative AI to create personalized, engaging chatbot experiences for any purpose. Available in 100+ languages and with a GPT-native suite of tools to help you unlock your creativity, Botpress supports you in achieving your goals and transforming the way you communicate.

[@HarpaAI]

🎯 Key Takeaways for quick navigation: 00:00 🎃 *Introduction and Halloween Greetings* - Robert greets the audience and mentions Halloween. - He considers wearing a costume but decides against it. - Introduces the main topic of the stream. 02:04 🧠 *Understanding Conversational Memory* - Explains the concept of conversational memory. - Gives an example of how humans use conversational memory. - Highlights the limitations of chatbots in retaining conversation context. 03:52 🛠️ *Botpress and Conversational Memory* - Discusses how Botpress integrates conversational memory features. - Mentions accessing conversational history through agents. - Explains the role of summary agents in capturing conversation context. 05:31 📜 *Working with Summary Agents* - Explores the summary agent's role in enabling conversational memory. - Highlights the importance of exposing variables for context. - Discusses the use of transcript and summary variables in conversations. 08:57 🧩 *Crafting Specific AI Task Instructions* - Details the importance of specific instructions in AI tasks. - Explains the purpose of clear and unambiguous prompts. - Emphasizes predictability in AI model behavior for different use cases. 14:10 🤖 *Configuring the AI Task Input* - Describes the AI task input and its role in guiding the AI's response. - Discusses the need for clarity in specifying the assistant's role and responsibilities. - Emphasizes the importance of being explicit in AI task instructions. 19:05 🤖 *Setting up the AI task and providing initial information* - How to configure the AI task and provide initial information. - Start with the transcript as a source for the AI. - Encourage experimentation with different sources like conversation summaries. 20:00 🧠 *Understanding AI task setup and variables* - Explaining the purpose of variables like "event.preview" and "workflow.response" in the AI task setup. - How to store and access information in variables. - The importance of understanding and configuring the AI task correctly. 21:27 🔄 *Creating a conversational loop and capturing user data* - Setting up a loop in the AI task to engage in a back-and-forth conversation with users. - Capturing user data using capture cards and looping through conversations. - Addressing the possibility of collecting user profile data through the AI task. 23:58 ⚙️ *Configuring transitions for conversational loops* - Adding transitions to create a continuous conversation loop. - Explaining the importance of transitions in maintaining the flow of conversation. - Ensuring the AI task continues to engage with users in the loop. 25:45 🌐 *Setting up user prompts and handling context* - Using prompts to guide user responses and maintain context in the conversation. - Demonstrating how context helps the AI task understand and respond to user queries. - Highlighting the importance of meaningful user prompts for better interactions. 29:13 🛑 *Allowing users to end the conversation* - Setting up an intent to allow users to end the conversation when they choose. - Explaining the purpose of the "end conversation" intent. - Demonstrating how users can trigger the intent to exit the conversation loop. 34:43 💬 *Handling user input and validating user interactions* - Discussing how to handle user input in a conversational context. - Addressing user questions and interactions within the conversation loop. - Exploring options for validating and responding to user queries effectively. Made with HARPA AI

[@andydataguy]

I'm freeeeee! Bout to binge watch TF out of the botpress series 😁

[@KhadeBelgrave]

Ok but what are the best uses cases for AI Tasks and AI generate text, as in this specific use case there can be some overlap. So when should you use either?

[@eyoo369]

This conversational memory often gets stuck in a loop. It would be nice to have a way to clear the Transcript variable completely as a card action. I tried creating a expression card that checks if "/end" is typed as message and then send it straight to the End node. But doesn't seem to wipe the conversational memory / transcript. Very cool feature but still buggy and practically unusable

[@user-vs5gr5dv7n]

Hi. Thank you, it's very important manual. By the way, how can I use GPT-4 model? Is this possible in cloud version or I should deploy the Botpress on my server?

[@KaranThukral15]

Can you use AI task card to ask questions back to knowledge base? say I am trying to understand the question of the user and identify the "product" from the knowledge base, and ask questions about that identified product back to knowledge base. The use case is that we want to inform the user about the ingredients in the "product", and most importantly let them know about the potential allergies. even though the user never asked about the allergens

[@IsotonikStudios]

Exactly what I need to! Robert said there was a video that covered this, would be great if other videos referred in these episodes were referenced in the description, unfortunately I can never join the discord sessions where I'm assuming they get shared in the chat?!

[@Botpress]

You can use the AI Task to manipulate answers from knowledge base queries. The referenced video is here: kzbin.info/www/bejne/sGXHfZaLm6trmpI Happy bot building \o/

[@IsotonikStudios]

@@Botpress that doesn’t really answer the question, you’re just manipulating a knowledgebase response, the question was regarding creating a conversational memory, but using that with the knowledge base.

[@Botpress]

@@IsotonikStudios The conversational memory, as described here, is created regardless, because the transcript is always being updated with messages being sent to and from your bot.

[@marcometelli8455]

@@Botpress Yeah Robert, the conversational memory is by default provided by botpress for knowledgebase agent in the "provide context to KBs" section in the agent configuration, what i really wonder is instead of get the reply from kb agent and then manipulate it with AI task, can we treat the "provide context to kbs" section as a folder where we give istructions to the kb agent? Like a preprompt folder, for example tomake the kb agent more professional, or more friendly ecc with native replies it gives? Or we must need to manipulate it with ai task card?

[@javieramunoz5742]

How can I do this but interact with the KB and not respond to random stuff?

[@marpertube]

Please use dark mode ❤

[@Botpress]

Controversial 👀

[@monorello]

❤🎉