Mastering Generative Answers in Copilot Studio

[@LisaCrosbie]

Connect with me: ☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie 🦉 Learn more about AI: aka.ms/learnwithlisa 🖇 LinkedIn: www.linkedin.com/in/lisa-crosbie/ 📼 TikTok: www.tiktok.com/@lisa.crosbie 🐦 X (Twitter): twitter.com/LisaCrosbie 📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps www.linkedin.com/learning/microsoft-power-platform-fundamentals-pl-900-cert-prep-power-apps/

[@FullStackDeveloper-q2o]

** Don't include query strings, more than two levels of depth, or the character "." in your URL. ** Hi Lisa, Can we use more than 2 levels of depth, if we take the Microsoft Copilot Studio subscription?

[@nicolaiknigge-lundgren7886]

Nice work, Lisa. I think you explained it in depth so that most people can advance on their journey forward

[@EquityEd]

Another great and informative video, I am really getting into Copilot as a result of your videos, I can see what an amazing benefit it can be for any sized organisation. Keep up the wonderful work! I always look forward to your new releases. Also, as a fellow Australian, so good to hear an Australian accent on KZbin, as well as the familiar cultural nuances and humour in your discussions.

[@DanielChristian19]

Great video. I loved how you said, "...sometimes the experiences are a bit MEH"...NAILED IT!

[@LisaCrosbie]

Haha, thanks ☺️

[@dynamics365series2]

@@LisaCrosbie I did not see how to enable Generative AI option in my copilot studio

[@ArafatTehsin]

Top video on this topic so far, Lisa. Once again 💯

[@TomFrost33]

Thank you Lisa. I appreciate your style and approach.

[@DeployJeremy]

Great video. Retrieval is key in all of these scenarios, and the system prompt is also part of prompt augmentation. Nice explanations.

[@BizzInnovate]

Hi Lisa.Thanks for sharing Crisp and clear stuff. I will be happy to see video on "Create conversational plugins for Microsoft Copilot (preview)"

[@andgo-fabian]

Hi Lisa, thank you for the video! I wonder, what would be the difference between using sharepoint with our documents compared to preparing a vector store using AI Search as you showed in one of your previous videos?

[@qr93sl52]

I wonder when ask the end user the citation in SharePoint appear other pdf no have related it?

[@kadinamkulam]

following ur video, at 18:32.. I am using the below instruction. but it is not generating the answer .. always comes as empty.. what is wrong i am doing here??Please share your thoughts on this? ---- Create generative answers Content Moderation : high Prompt as below You are an assistant that analyzes data and answers questions. Use the provided data to answer the user's question accurately and concisely. Question: Activity.Text   Data: {Response.DATA}  Please answer the question based on this data. ----

[@AngeloQueiroz-dy6tr]

I'm building a bot in copilot studio, it is working with generative answer based on an uploaded document. This is a FAQ document and has several hyperlinks important to share with the user, but the bot doesn't pass them along in his answers. To clarify, I don't mind the citation format, what I'm looking for is configuring the bot to always send the relevant hyperlinks from the document, in the answer to the user. Through customization I managed to pass some of the links, but it has not been consistent. I don't know if I'm using the wrong wording, the wrong tool, or if it isn't even possible to control and the bot just does as it feels like at the time =P.

[@Sreeja-nw2ye]

Hello Sir, I have been facing the same problem. Did you find any solution to this?

[@jatinparmar852]

Hi Lisa, thank you for the video. I was wondering is it possible to get prompt suggestions from the response provided by the bot? So that the user do not have to think about their next prompts

[@ksperder4035]

Hi Lisa! Thanks a lot for this video :) I'm trying to create a bot to consult procedure documents. The generative answers sometimes brings back the information with errors (such as an 11 instead a 21 and so), and also the referenced documents links downloads the files instead of opening in a browser tab from SharePoint. I could't find any information regarding these issues. Do do you have any advice? Thanks in advance!

[@johng5295]

Awesome. Great content. Thanks a million.

[@pramodagarwal1990]

can I remove references? if yes. How?

[@akakikk]

Any luck, please share if anyone done this

[@wmbassyouni]

Thank you for this video, one of the best on the topic. I have been trying to get up to speed on copilot studio for implementing at my organization. I am struggling with is how to have the Copilots setup through studio actually default to the knowledge contained within the GPT model if its not available in the documents or public websites. Instead, it seems the copilots are devoid of any knowledge unless sources are added even though the 3.5 model is a vast repository of human knowledge.

[@guyisashar3969]

Hi great video, I have question regarding the generative answers, is it possible to use generative answers for searching data inside video files or stream, or in transcripts that are stored in SharePoint? the main idea is to give a time stamp of some topic that is explained in the video

[@alexchandler6122]

Great video! I'm actually trying to build something like this and targeting the first response to be using generative AI and if that doesn't sufficiently answer the user's questions, I then want to use power automate to prompt several options to choose to provide a link to a sharepoint page where to find more information. Any ideas how to do this?

[@jaspersiegmund]

Great video! I've been playing around a bit, I'm not sure whether Copilot actually does multi-turn conversations. It seems like with each pass of a topic it rewinds and starts from scratch again, unlike something like ChatGPT technology which will 'remember' things because it's fed the entire conversation on each new message within that conversation. I've built some bots based on the bot framework (which seems to be the underlying tech here) before, calling out to an LLM just seems to be an add-on to that technology right now, calling out to it when you reach that card, but only providing the context and prompt you enter into the card and not the rest of the conversation. I suspect the example where you made it work was just luck where the LLM understood the prompt enough to give you a fitting answer. I really love where this is going, but at the same time we're definitely not there yet. We would really need the LLM to have the entire conversation as context in order to provide more powerful ways of interacting with it.

[@LisaCrosbie]

It does actually keep the context up to 10 turns. It had been a bit glitchy but I’ve done plenty of examples where it works. When it generates and answer ask a follow up question without the full context. I’m seeing improvements in what it can do all the time, there is a lot of development still going on.

[@jaspersiegmund]

@@LisaCrosbie oh! That's different than my experience but indeed, still a lot of development going on so that might be the cause. Thanks for the info!

[@LisaCrosbie]

Yes they are upgrading the LLM underneath which makes a huge improvement and more to come there. Stick with it.

[@ram04199]

Hi Lisa, I've created a bot in Copilot Studio and provided some documents as data and enabled the "Boost conversational coverage with generative answers". After publishing the bot, the bot is working fine with the generative answers in the Demo website, but when i tried to chat with the bot in the MS Teams, then it throws the error: "Sorry, something unexpected happened. We're looking into it. Error code: System Error." Though I enabled the authentication to Teams only, then also getting the same error. The Bot is working fine with the Topics, but somehow it is not working for "Boost conversational coverage with generative answers" in the MS Teams.

[@andrewgrischenko]

This is so helpful, thank you, Lisa!

[@kurtmartinsen3151]

That was a fantastic video. Thank you I hope to hear more updates.

[@markshark337]

Is there any comprehensive comparison between uploading a document through dra&drop option and connecting do document library ? I read somwhere that "when connecting copilot studio created chatbot to share point site SharePoint doesn't index / vectorize / chunk the data". I Actually get very good results when uloading the documents locally. Do you have any good info or links on that ? And of copurse, thank you for your remarkable contribution in understanding these new solutions.

[@joernbuelow1498]

Thank you Lisa for your very helpful insigths. When it comes to Prompting I wonder if it wouldn't be helpfull to wrap the user input (variable) in a prompt context a bit simillar zu "Custom Instructions" bevor sending to the Generative AI? This could be based on the topic. Could that make sense?

[@LontraD-gy6gj]

@LisaCrosbie Hello , when you use the Ia generative it goes to the MS team authentication, and the data qhen search works. and When you select the SSO as manual manual authentication when ask a question it does not work, anyone know how to fix it?

[@MuthukumarDurai-m5g]

Can I configure my bot in such a way that, after the user selects a policy to update in the 'Update Policy' topic, the bot can fetch the relevant contact email from another topic that already contains this information (the 'Document Policy' topic linked to policy knowledge)? I want to avoid duplicating the information and ensure that only the email address related to the selected policy is retrieved from the other topic and used in the current conversation

[@LisaCrosbie]

Yes you should be able to do that if you use a global variable.

[@vkkpp]

This is awesome Lisa, Will you be able to help how to integrate this with teams.

[@pramodagarwal1990]

When I added additional phrases along with unknown intent in conversation booster, Copilot Studio Bot stopped responding to my questions which it was answering before.

[@seedon2180]

Glad to Watch your video! I'm from South Korea user, if you don't mind, I want some Eng subtitle for foreign subscriber :)

[@ahmadbarbar9638]

Thanks for the amazing clear video. some times the same question you ask, first it gives you sorry i can not help then if i close and open a new session it gives you the anwser! is it normal!🙃

[@LisaCrosbie]

yes, that can happen sometimes

[@prasadathalye1243]

HI Lisa, What service or solution is responsible to maintain the conversation context? For SharePoint data source, does it use Graph API to index the content?

[@dynamics365series2]

yes

[@dynamics365series2]

you need to configure authentication and add you sharepoint scopes i.e Sites.Read.All etc

[@57wanderfol57]

Hi, how can end users use this application? for example, can we add this bot as a tab to a Teams?

[@LisaCrosbie]

Yes, you publish your Copilot wherever you want it - Teams, website, lots of other options.

[@digitalkmultimedia]

Uploading a Data File is a real business use case. It needs it's own video to focus on richer details, pros, cons, trouble shoot. Imagine Having multiple sets of related sources of information exported into one document, upload it to Copilot and you have a dedicated chat bot with no training for stakeholders.

[@analyticsintell5972]

Can Copilot Studio able to read a document with images and shapes?

[@LisaCrosbie]

It doesn’t yet read images but it was announced on the roadmap at Build that it will understand an image pasted into chat and the new multimodal LLMs can do a lot more so I’d say “not yet”.

[@koradakomalatha5685]

Is it possible to create reports using copilot

[@LisaCrosbie]

Copilot Studio isn’t a reporting tool so it depends on your scenario and what you are trying to achieve. Most likely look at Copilot in Power BI or Fabric.

[@rebeckarickne314]

Hi Lisa! Great video as always. I have a question about Project Operatios and would be super greatful for a tutorial and/or suggestions. PO is a great module for handling projects and within the project itself one has a good overview of the project tasks for that project, but there is no good way to get an overview over all your projects, as one could if using MS Roadmaps. I am very surprised MS released PO without a complete project management tool and our organization will not have the features we need without that MS Roadmaps timeline overview of many projects. I have been in touch with Microsoft trying to get information, but unfortunately this functionality will not be available for at least 1-2 years. Do you have any thougts or workarounds to share? Is there any way you would be able to discuss this issue? Thanks a lot! And thank you so much for always providing valuable insights! /Rebecka

[@LisaCrosbie]

I don’t work with Project Operations and I have a super long video list in the areas I do cover so it’s not something I’m likely to get to. You might like to try the community forums. All the best.

[@rebeckarickne314]

@@LisaCrosbie Ok, thanks for the information. Keep up the great work!

[@02bradnocks]

great video, thank you!

[@DavidWhite-ci2tc]

Hi Lisa, great video but frustratingly you do no clearly explain your steps clearly You should explain clearly how you got SharePoint working- I got copilot studio to point at the SharePoint directory but received an authority not implemented You didn’t show that just jumped to a result I’ve noticed you have done this before in your videos Can you please show all steps otherwise it’s a bit useless Thanks David

[@LisaCrosbie]

That will be a whole other video; it’s still on my list.

[@DavidWhite-ci2tc]

@@LisaCrosbie looking forward to it, thanks David