How Microsoft Copilot for Microsoft 365 works

Get an inside look at how large language models (LLMs) work when you connect them to the data in your organization. See what makes this possible and how the process respects your privacy to keep data safe with Copilot for Microsoft 365. The LLM for Copilot for Microsoft 365 is hosted in the Microsoft Cloud and is not trained on your organizational data. Copilot automatically inherits your organization’s security, compliance, and privacy policies for Microsoft 365.
Join Mary David Pasch to go inside the mechanics of AI-powered Copilot capabilities, what they do and how they work.
► QUICK LINKS:
00:00 - Introduction
01:11 - Large Language Models (LLMs)
02:19 - Write prompts to include additional info
04:04 - Core components of Copilot
06:31 - Generating content
07:48 - Wrap up
► Link References:
For more on how Microsoft operates its AI services, check out aka.ms/MicrosoftResponsibleAI
► Unfamiliar with Microsoft Mechanics?
As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.
• Subscribe to our KZbin: / microsoftmechanicsseries
• Talk with other IT Pros, join us on the Microsoft Tech Community: techcommunity.microsoft.com/t...
• Watch or listen from anywhere, subscribe to our podcast: microsoftmechanics.libsyn.com...
► Keep getting this insider knowledge, join us on social:
• Follow us on Twitter: / msftmechanics
• Share knowledge on LinkedIn: / microsoft-mechanics
• Enjoy us on Instagram: / msftmechanics
• Loosen up with us on TikTok: / msftmechanics
#Copilot #OpenAI #Microsoft365 #Microsoft365Copilot #gpt #chatgpt

[@MSFTMechanics]

For more Microsoft 365 Copilot news, capabilities across more apps, and details on the Microsoft 365 Copilot Early Access Program, check out www.microsoft.com/en-us/microsoft-365/blog/2023/05/09/introducing-the-microsoft-365-copilot-early-access-program-and-new-capabilities-in-copilot/

[@TeamWesternProductions]

How to get access to this?

[@GoogleOns-ys9ms]

❤🎉❤ 0:35

[@christiancook6742]

I appreciate the approach of "copilot," acting more as a teacher and a tool for inspiration. As a teacher myself, it is lovely to see the methods we use in the classroom being applied here as a teaching method rather than a means to shortcut the work. I have used chat GPT for a while now, and this is far more valuable as an application because it does not give me exactly what I ask for; instead, it encourages me to create it myself. The ability to change the settings of the copilot is also beneficial, as it allows me to learn from its suggestions rather than regurgitate them. Thank you, Copilot team, for making a better AI tool that respects the artists in the world while still providing assets that can help improve talent.

[@oboochin3469]

Really interested in the full architecture( more detailed map ) of Microsoft Copilot, such an amazing engineering project.

[@Silent1Majority]

Outstanding breakdown. Thank you.

[@MSFTMechanics]

Glad you liked it. Thank you for taking the time to comment

[@udaracperera]

Copilot is the time waste killer. Productivity... Productivity without boring tasks lets us focus on improvements.

[@epictetus8028]

Nah - it'll just make us lazy and dumb(er). The time saved won't be put to better use, it'll just be gaps in someone's day. People are inherently lazy.

[@bhanu_chintha]

This is a very good explanation for kick start into MS Copilot

[@albertkwan4261]

Awesome clear explanation!

[@MSFTMechanics]

Thanks for taking the time to comment. Glad it helped.

[@tristanchef1]

Now release the preview to the 365 public ww. We need to test this.

[@MSFTMechanics]

Thanks for your comment. We're working on it and recently published details on the Copilot Early Access Program www.microsoft.com/en-us/microsoft-365/blog/2023/05/09/introducing-the-microsoft-365-copilot-early-access-program-and-new-capabilities-in-copilot/

[@TheTanimou]

Good point

[@issiewizzie]

very clear explanation ...kudos

[@MSFTMechanics]

Thank you

[@peterleodis3298]

Great video, thank you!

[@Rogue-Bull]

Will this feature be available for non-enterprise 365 in future?

[@myusrngml]

When do these m365 copilot experiences show up in my m365 productivity application suite that my company has an e5 license for?

[@sialmoe]

Sick!!! So informative

[@MSFTMechanics]

Thanks for commenting. Glad you found it informative.

[@herp_derpingson]

@@MSFTMechanics You sound like ChatGPT :O

[@grownmanlookingatsportscar194]

Will it be able to process/read pdfs on our SharePoint site? And, if so, how will it process tens of thousands of files? Thanks

[@francescobedinijacobini]

This is great! I just hope we don’t end up relying too much on AI.

[@MSFTMechanics]

Glad you liked it. Copilot will provide a great starting point with source citations to save you a lot of time.

[@kenichisegawa3981]

how frequently does the index gets updated? let's say if I updated/modified/deleted the my documents, will it updates the index immediately?

[@PemboDave]

Thanks for sharing :)

[@MSFTMechanics]

Thanks for commenting. Glad you liked it

[@MVEProducties]

Will Microsoft Co Pilot also be integrated into their Office software for macOS? Is Microsoft having discussions with Apple how to integrate their LLMs within macOS and iOS/iPadOS/watchOS etc?

[@ilhamsuhaimi]

Im using 0.5x speed to analyze this video, i need copilot directly to my brain 😅

[@zhang_han]

Is this available right now for office products?

[@matteos9783]

Hi can we know when copilot start into office? I have office 365 enable copilot in regedit but so far there isn't

[@grownmanlookingatsportscar194]

Will Dynamics data be available as part of this CoPilot release? Or plans to have it included in the future? Thanks

[@MSFTMechanics]

Thanks for your question. Yes, Dynamics 365 will also have Copilot capabilites. You can find out more in this blog: blogs.microsoft.com/blog/2023/03/06/introducing-microsoft-dynamics-365-copilot/

[@DanMacCheeseburger]

I would like to know how you can gather enough relevant data, while maintaining all proper user permissions, to generate a learning model that can actually 'learn' given all the constraints to the graph structure of available data sets. It seems to me, this will be limited to connecting existing data points and generating content in basically the same way. While I do see the potential for this to be a powerful tool, I see no other way - it would essentially require all user data to be collected to satisfy the necessary and sufficient conditions for a robust and 'creative' model.

[@TheUsamawahabkhan]

Love it, can we host isolated instance of LLM? Or fine tuning them?

[@MSFTMechanics]

That's not available with Microsoft 365 Copilot. You can check out Azure OpenAI Service for additional customizations with your own in-house developed applications.

[@TheUsamawahabkhan]

@@MSFTMechanics thank you for your reply, we are using AZ OpenAI and also Fine-tuning and user-friendly RAGs as well. Where I can find more detailed about m365 isolated orchestrator?

[@ondrejvrabel5385]

Thank you for great explanation! How does Copilot performs in other languages? Is it possible to use it in e.g. German, Czech?

[@MSFTMechanics]

Thanks for your comment. Copilot will be supported initially in English, Spanish, French, German, Italian, Japanese, Portuguese, and Simplified Chinese.

[@ondrejvrabel5385]

@@MSFTMechanics - Ok, cool, thank you very much for your reply!

[@Danninorgaard]

@@MSFTMechanics Any timeframe on additional languages?

[@ecbeljeda]

Can it read text on pdf and respond to a query asking for the documents with an asset code?

[@KarlynGR]

ChatGPT can you that with plugins already

[@tniglennede_oibftronnede_x36]

I would like to know why the different email clients best classify emails by conversation by subject (subject), but never by email address (possibly with the possibility of subsequently linking several email addresses to the same person or the same organization ). It would be much more practical to find a previous conversation with a person or from an organization, and simpler than having to go to the search bar, type the name of the person, then copy their email address, then type this address email in the search bar.

[@grownmanlookingatsportscar194]

If we have several hundred docs about the same subject (say HR benefits detailing co pay) where data changes over time how does it ‘know’ which is the most accurate? Thanks

[@MSFTMechanics]

Thanks for your comment. This is part of the retrieval process and uses semantic search. There's a great high level overview here: kzbin.info/www/bejne/gaXWh4V5qMmppbc

[@buddypetroff4352]

Shalom! I am curious about: What about the copyright the books and articles, etc? What about the legal status of the books and the articles used by the LLM? The books that are still under copyright protection require the permission of the author. How Google did obtain the permission from the right holder?

[@g.paudra8942]

Can user or admin export or download all conversation between user and copilot?

[@MSFTMechanics]

Thanks for your comment. For Business Chat as demonstrated, this appears as a chat conversation in Microsoft Teams.

[@peacejon2019]

When would this be available for licensed users.... And Security Admins

[@MSFTMechanics]

Thanks for your comment. We've recently broadened access with the Microsoft 365 Copilot Early Access Program. You can find out more here: www.microsoft.com/en-us/microsoft-365/blog/2023/05/09/introducing-the-microsoft-365-copilot-early-access-program-and-new-capabilities-in-copilot/

[@emjem99]

Just get the damn thing released!

[@ndolson]

언제 출시될까요? 올해안에 나온다고 소문이 있던데요. 생산성이 얼마나 더 좋아질까요? 회사에서 일하는 방식은 얼마나 달라질까요? When will it be released? I heard it will be released within this year. How much more productivity do you get? How different is the way you work at a company?

[@uzairelalumiere]

where can i download it? I want to use it

[@user-zy5bt6mk4f]

Or while using business and Microsoft teams can help you catch up on something you may have missed

[@humbertotoval8748]

Nice, will it also work with sharepoint?

[@MSFTMechanics]

Yes, much of the data retrieved when you use Copilot to generate content is from SharePoint.

[@Qryptic0]

How to do you get copilot?

[@azurecontentannu6399]

can you please tell me which tool you used to edit this video?

[@MSFTMechanics]

Thanks for your comment. We primarily use Adobe Creative Cloud tools for editing.

[@alfred.clement]

How do independent researchers get access to the Security Copilot ?

[@MSFTMechanics]

Thanks for your comment. We haven't done a Mechanics show on Security Copilot yet, but I'd encourage you to check out this one on Threat Intelligence in Microsoft Defender: kzbin.info/www/bejne/j5K9iH5jiJKfj6s We explain how you can access both finished and raw intelligence for cybersecurity investigation - and demonstrate how it works.

[@AndyMoserCH]

when will it finally be available for Beta-Testing?

[@matthewtull]

Can it write a lesson plan?

[@rubelainebaro7455]

where to access this?

[@angelrivera8764]

Serious question about privacy: Does have Copilot access to my local drive? Can it read my private files to generate answers? Because I don't want an AI snooping in the photos and videos that I have NOT stored in the cloud.

[@MSFTMechanics]

It does not have local file access. The one case where you could benefit from this is if your local drive is on a managed PC or Mac using Microsoft 365's OneDrive folder sync (desktop, documents, and photos folders), those locations would be available for search via OneDrive in Microsoft 365 as a cloud location.

[@angelrivera8764]

@@MSFTMechanics I don't see "benefits" on an IA looking at my private folders... just in case I will move to linux

[@Nerijus..]

still unclear how to use this Copilot..

[@brianxyz]

Will Copilot work with Power BI?

[@MSFTMechanics]

Thanks for your comment. There are lots of built-in intelligent experiences in Power BI powered by GPT. Check out this blog: powerbi.microsoft.com/en-us/blog/enabling-intelligent-experiences-with-power-bi-for-developers-data-scientists-and-data-engineers/

[@brianxyz]

@@MSFTMechanics Thanks for the link to the blog!

[@MSFTMechanics]

No worries. Power Platform actually started rolling out GPT powered capabilites quite early in 2021. Power Apps Ideas to automatically generate Power Fx is another example using GPT.

[@lefty1117]

I wonder how the security model of searchable data works

[@MSFTMechanics]

Thanks for your comment. We actually explain that in the video. Retrieval permissions and access are based on the user using Microsoft 365 Copilot; information is retrieved via the orchestration engine using the Microsoft Graph to append to a prompt as temporary information specific to that conversation, then once the conversation ends, the temporary information is also removed. The process then repeats for any new conversation.

[@sunnymittra]

Changing name of Office to Microsoft is a blunder don’t know who advised this but MS Office was the meaningful name😢😢😢

[@snapicvs]

Unfortunately I’m unable to find anything in writing from Microsoft stating that that LLMs don’t use our proprietary data for machine learning or that our data is not available to the AI outside our tenant. The assurances in this video are nice but Microsoft themselves have said no such thing in writing. If anyone has seen it, I’d love a link. The AI is promising but not worth it if our trade secrets end up in the public domain.

[@MSFTMechanics]

Thanks for your comment. Here are a few links with Microsoft's commitments in writing: learn.microsoft.com/en-us/microsoft-365-copilot/microsoft-365-copilot-privacy; techcommunity.microsoft.com/t5/microsoft-365-blog/administration-of-microsoft-365-in-the-new-era-of-ai/ba-p/3767079

[@uberseehandel]

How does an LLM know the difference between unreliable and reliable data?

[@MSFTMechanics]

Thanks for commenting and great question. That is part of the Copilot orchestration for information retrieval using semantic search. There is a great how-it-works video about that here: kzbin.info/www/bejne/gaXWh4V5qMmppbc

[@uberseehandel]

@@MSFTMechanics Thank you for responding. One of my hats says informaticist. I also come into contact with eminent researchers who use the answers from large questionnaire surveys to further our understanding of certain critical events. When I point out that any undergraduate student proffering a questionnaire as illogical as the one I have just been asked to complete would receive a C-, at best, I am airily informed that AI would fix the issues that concern me. This is a serious issue that needs to be addressed, I would rather take the specifics off-line, so you can better understand how unrealistic many people's expectations of AI are.

[@MSFTMechanics]

Thanks Robin. You might be interested in retrieval approaches and logic that we covered in a related show: kzbin.info/www/bejne/qoiVdnRqlr-Sj7M and for more details on general semantic search, check out: kzbin.info/www/bejne/mpCZi4Gvi5aArKM

[@markc6714]

At the start you said it can gather information from your files and emails. Clearly that isn't done every time you start a chat so you have to be storing something

[@MSFTMechanics]

Thanks for your comment. As demonstrated, each Copilot session or Business Chat conversation starts from scratch and information is retrieved each time on demand.

[@waynelast1685]

4:17 Don’t understand…….Is copilot using the cloud LLM or not? How can it function without it but she says copilot does not call it?

[@MSFTMechanics]

Thanks for your question. Microsoft 365 Copilot calls it's own instances of the LLM running in the Azure OpenAI Service.

[@daisyblue4073]

What if you don't want copilot To do this? Can you opt out?

[@MSFTMechanics]

Yes, Microsoft 365 Copilot is an optional addition to Microsoft 365 commercial plans

[@b.c.2177]

And where is it?? In my Office 365 it is missing!

[@marlbonoreds]

Not released yet

[@KarlynGR]

Public release when

[@empowersuite]

We're very excited about what lies ahead, thank you for sharing. 🚀 This morning we also held a webinar in German on our assessment of Copilot. For those interested: kzbin.info/www/bejne/aqi3ZoqHjLRmn8U

[@heyyojojo7939]

Wish they'd just release the damn thing. They keep announcing shit but keep it under wraps for weeks and months.

[@merlinsrobe4621]

In practice, copilot will behave like an undergraduate who writes a research paper for you, riddled with errors, and your job will be to carefully sift through and find all of those errors.

[@KarlynGR]

If you plan on using it to do all your work instead of a tool to optimize your workflow then yeah it's probably going to be like that.

[@user-kx4rs7ul1w]

🇸🇦🇸🇦🇸🇦

[@noahcasarotto-dinning1575]

Arvo's Dawn >>>> Office 365 Copilot. I'm comin Bill

[@briantep458]

will co-pilot answer all my stupid emails?

[@DanMacCheeseburger]

NO, it's using all the compute time to generate stupid emails ;)

[@robindieker6033]

The thing is - WHEN THE HECK WILL IT BE GA?!?!?

[@jackie299]

Learn to use these tools or you will be left behind. Copilot won't take your job, it will be taken by someone who knows how to effectively use it.

[@ErhardDolny]

Wenn das so toll ist sollte es doch möglich sein, Untertitel in verschieden Sprachen zu erstellen 🤔

[@MSFTMechanics]

Meinen Sie fuer dieses Video? Untertiteln auf Deutsch sollten da sein. Ich kann die deutsche Untertiteln sehen. -Jeremy

[@coom07]

Are those comments replies coming from an AI?

[@MSFTMechanics]

They are not. We read all comments and try to respond as much as possible.

[@cluelesslife]

Stop teasing with these vid's about CoPilot, just get this stuff available for the public #meneedsit #mewantsit ;-)

[@user-zy5bt6mk4f]

Or while using business and Microsoft teams can help you catch up on something you may have missed