Mastering Generative Answers in Copilot Studio

Generative answers is one of the most powerful features available in Copilot Studio, enabling you to create an instant AI bot to search and access to your business data - but so many users get stuck with less than impressive results when they plug in a website, document or SharePoint site for the first time. This video full of real life hit and miss examples will get you over that hurdle to help you understand what you can achieve with generative answers, as well as what's not possible, and why, and equip you with the skills to get the most out of it.
0:00 - Generative Answers in Copilot Studio
1:29 - How generative answers works
3:49 - Conversation boosting topic
5:31 - Limitations and options
7:13 - Public Data - Website
8:52 - Content moderation
9:54 - Error message - I'm sorry I can't help with that
12:36 - Uploading documents
14:18 - SharePoint and OneDrive
17:05 - Custom instructions
20:55 - Prompting
23:38 - Multi turn conversations
24:46 - What matters the most to optimize generative answers
-----------------------------------------------------
Connect with me:
☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie
🦉 Learn more about AI: aka.ms/learnwithlisa
🖇 LinkedIn: / lisa-crosbie
📼 TikTok: / lisa.crosbie
🐦 X (Twitter): / lisacrosbie
📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps / microsoft-power-platfo...

[@LisaCrosbie]

Connect with me: ☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie 🦉 Learn more about AI: aka.ms/learnwithlisa 🖇 LinkedIn: www.linkedin.com/in/lisa-crosbie/ 📼 TikTok: www.tiktok.com/@lisa.crosbie 🐦 X (Twitter): twitter.com/LisaCrosbie 📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps www.linkedin.com/learning/microsoft-power-platform-fundamentals-pl-900-cert-prep-power-apps/

[@user-xz6uq9tq1o]

** Don't include query strings, more than two levels of depth, or the character "." in your URL. ** Hi Lisa, Can we use more than 2 levels of depth, if we take the Microsoft Copilot Studio subscription?

[@ArafatTehsin]

Top video on this topic so far, Lisa. Once again 💯

[@TomFrost33]

Thank you Lisa. I appreciate your style and approach.

[@EquityEd]

Another great and informative video, I am really getting into Copilot as a result of your videos, I can see what an amazing benefit it can be for any sized organisation. Keep up the wonderful work! I always look forward to your new releases. Also, as a fellow Australian, so good to hear an Australian accent on KZbin, as well as the familiar cultural nuances and humour in your discussions.

[@BizzInnovate]

Hi Lisa.Thanks for sharing Crisp and clear stuff. I will be happy to see video on "Create conversational plugins for Microsoft Copilot (preview)"

[@DeployJeremy]

Great video. Retrieval is key in all of these scenarios, and the system prompt is also part of prompt augmentation. Nice explanations.

[@andrewgrischenko]

This is so helpful, thank you, Lisa!

[@DanielChristian19]

Great video. I loved how you said, "...sometimes the experiences are a bit MEH"...NAILED IT!

[@LisaCrosbie]

Haha, thanks ☺️

[@dynamics365series2]

@@LisaCrosbie I did not see how to enable Generative AI option in my copilot studio

[@andgo-fabian]

Hi Lisa, thank you for the video! I wonder, what would be the difference between using sharepoint with our documents compared to preparing a vector store using AI Search as you showed in one of your previous videos?

[@02bradnocks]

great video, thank you!

[@jatinparmar852]

Hi Lisa, thank you for the video. I was wondering is it possible to get prompt suggestions from the response provided by the bot? So that the user do not have to think about their next prompts

[@joernbuelow1498]

Thank you Lisa for your very helpful insigths. When it comes to Prompting I wonder if it wouldn't be helpfull to wrap the user input (variable) in a prompt context a bit simillar zu "Custom Instructions" bevor sending to the Generative AI? This could be based on the topic. Could that make sense?

[@wmbassyouni]

Thank you for this video, one of the best on the topic. I have been trying to get up to speed on copilot studio for implementing at my organization. I am struggling with is how to have the Copilots setup through studio actually default to the knowledge contained within the GPT model if its not available in the documents or public websites. Instead, it seems the copilots are devoid of any knowledge unless sources are added even though the 3.5 model is a vast repository of human knowledge.

[@prasadathalye1243]

HI Lisa, What service or solution is responsible to maintain the conversation context? For SharePoint data source, does it use Graph API to index the content?

[@alexchandler6122]

Great video! I'm actually trying to build something like this and targeting the first response to be using generative AI and if that doesn't sufficiently answer the user's questions, I then want to use power automate to prompt several options to choose to provide a link to a sharepoint page where to find more information. Any ideas how to do this?

[@pramodagarwal1990]

can I remove references? if yes. How?

[@seedon2180]

Glad to Watch your video! I'm from South Korea user, if you don't mind, I want some Eng subtitle for foreign subscriber :)

[@guyisashar3969]

Hi great video, I have question regarding the generative answers, is it possible to use generative answers for searching data inside video files or stream, or in transcripts that are stored in SharePoint? the main idea is to give a time stamp of some topic that is explained in the video

[@markshark337]

Is there any comprehensive comparison between uploading a document through dra&drop option and connecting do document library ? I read somwhere that "when connecting copilot studio created chatbot to share point site SharePoint doesn't index / vectorize / chunk the data". I Actually get very good results when uloading the documents locally. Do you have any good info or links on that ? And of copurse, thank you for your remarkable contribution in understanding these new solutions.

[@jaspersiegmund]

Great video! I've been playing around a bit, I'm not sure whether Copilot actually does multi-turn conversations. It seems like with each pass of a topic it rewinds and starts from scratch again, unlike something like ChatGPT technology which will 'remember' things because it's fed the entire conversation on each new message within that conversation. I've built some bots based on the bot framework (which seems to be the underlying tech here) before, calling out to an LLM just seems to be an add-on to that technology right now, calling out to it when you reach that card, but only providing the context and prompt you enter into the card and not the rest of the conversation. I suspect the example where you made it work was just luck where the LLM understood the prompt enough to give you a fitting answer. I really love where this is going, but at the same time we're definitely not there yet. We would really need the LLM to have the entire conversation as context in order to provide more powerful ways of interacting with it.

[@LisaCrosbie]

It does actually keep the context up to 10 turns. It had been a bit glitchy but I’ve done plenty of examples where it works. When it generates and answer ask a follow up question without the full context. I’m seeing improvements in what it can do all the time, there is a lot of development still going on.

[@jaspersiegmund]

@@LisaCrosbie oh! That's different than my experience but indeed, still a lot of development going on so that might be the cause. Thanks for the info!

[@pramodagarwal1990]

When I added additional phrases along with unknown intent in conversation booster, Copilot Studio Bot stopped responding to my questions which it was answering before.

[@ram04199]

Hi Lisa, I've created a bot in Copilot Studio and provided some documents as data and enabled the "Boost conversational coverage with generative answers". After publishing the bot, the bot is working fine with the generative answers in the Demo website, but when i tried to chat with the bot in the MS Teams, then it throws the error: "Sorry, something unexpected happened. We're looking into it. Error code: System Error." Though I enabled the authentication to Teams only, then also getting the same error. The Bot is working fine with the Topics, but somehow it is not working for "Boost conversational coverage with generative answers" in the MS Teams.

[@rebeckarickne314]

Hi Lisa! Great video as always. I have a question about Project Operatios and would be super greatful for a tutorial and/or suggestions. PO is a great module for handling projects and within the project itself one has a good overview of the project tasks for that project, but there is no good way to get an overview over all your projects, as one could if using MS Roadmaps. I am very surprised MS released PO without a complete project management tool and our organization will not have the features we need without that MS Roadmaps timeline overview of many projects. I have been in touch with Microsoft trying to get information, but unfortunately this functionality will not be available for at least 1-2 years. Do you have any thougts or workarounds to share? Is there any way you would be able to discuss this issue? Thanks a lot! And thank you so much for always providing valuable insights! /Rebecka

[@LisaCrosbie]

I don’t work with Project Operations and I have a super long video list in the areas I do cover so it’s not something I’m likely to get to. You might like to try the community forums. All the best.

[@rebeckarickne314]

@@LisaCrosbie Ok, thanks for the information. Keep up the great work!

[@ahmadbarbar9638]

Thanks for the amazing clear video. some times the same question you ask, first it gives you sorry i can not help then if i close and open a new session it gives you the anwser! is it normal!🙃

[@LisaCrosbie]

yes, that can happen sometimes

[@AngeloQueiroz-dy6tr]

I'm building a bot in copilot studio, it is working with generative answer based on an uploaded document. This is a FAQ document and has several hyperlinks important to share with the user, but the bot doesn't pass them along in his answers. To clarify, I don't mind the citation format, what I'm looking for is configuring the bot to always send the relevant hyperlinks from the document, in the answer to the user. Through customization I managed to pass some of the links, but it has not been consistent. I don't know if I'm using the wrong wording, the wrong tool, or if it isn't even possible to control and the bot just does as it feels like at the time =P.

[@Sreeja-nw2ye]

Hello Sir, I have been facing the same problem. Did you find any solution to this?

[@analyticsintell5972]

Can Copilot Studio able to read a document with images and shapes?

[@LontraD-gy6gj]

@LisaCrosbie Hello , when you use the Ia generative it goes to the MS team authentication, and the data qhen search works. and When you select the SSO as manual manual authentication when ask a question it does not work, anyone know how to fix it?

[@digitalkmultimedia]

Uploading a Data File is a real business use case. It needs it's own video to focus on richer details, pros, cons, trouble shoot. Imagine Having multiple sets of related sources of information exported into one document, upload it to Copilot and you have a dedicated chat bot with no training for stakeholders.

[@57wanderfol57]

Hi, how can end users use this application? for example, can we add this bot as a tab to a Teams?

[@LisaCrosbie]

Yes, you publish your Copilot wherever you want it - Teams, website, lots of other options.

[@koradakomalatha5685]

Is it possible to create reports using copilot

[@LisaCrosbie]

Copilot Studio isn’t a reporting tool so it depends on your scenario and what you are trying to achieve. Most likely look at Copilot in Power BI or Fabric.

[@DavidWhite-ci2tc]

Hi Lisa, great video but frustratingly you do no clearly explain your steps clearly You should explain clearly how you got SharePoint working- I got copilot studio to point at the SharePoint directory but received an authority not implemented You didn’t show that just jumped to a result I’ve noticed you have done this before in your videos Can you please show all steps otherwise it’s a bit useless Thanks David

[@LisaCrosbie]

That will be a whole other video; it’s still on my list.

[@DavidWhite-ci2tc]

@@LisaCrosbie looking forward to it, thanks David