Microsoft Copilot Pro (An HONEST Review)

There was a Super Bowl ad for Microsoft Copilot. So I wanted to see if it was any good... Let's explore.
Register for the free Nvidia GTC conference: nvda.ws/3tLZAVR
Discover More From Me:
🛠️ Explore hundreds of AI Tools: futuretools.io/
📰 Weekly Newsletter: www.futuretools.io/newsletter
😊 Discord Community: futuretools.io/discord
🐤 Follow me on Twitter: / mreflow
🧵 Follow me on Instagram: / mr.eflow
🐺 My personal blog: mattwolfe.com/ (Currently Being Overhauled)
Sponsorship/Media Inquiries: tally.so/r/nrBVlp
Mailing Address: 3755 Avocado Blvd #287, La Mesa, CA 91941
#AINews #AITools #ArtificialIntelligence
Time Stamps:
0:00 Intro
0:45 The Super Bowl Ad
1:13 Testing Super Bowl Prompts in Free Version
4:55 Microsoft Copilot Pro
6:07 Testing Super Bowl Prompts in Pro Version
9:01 Microsoft 365 With Copilot
9:17 Copilot in PowerPoint
11:41 Copilot in MS Word
13:45 Copilot in Excel
14:34 Prompting Excel Spreadsheets
15:47 Do I Recommend Upgrading To Pro?
18:00 Nvidia RTX 4080 Super Giveaway
18:45 Future Tools - Check it Out!

[@KetaFPV]

Honestly... They missed the mark by not bringing Clippy back to be Words Copilot

[@MooseyMax]

Microsoft renewed the CLIPPY trademark for the first time in a long time recently (2021) so it wouldn't surprise me if the plan is to introduce clippy back into copilot as a skin. Either that or they wanted to protect from people making a better product for office using their clippy which could get more traction.

[@charlesalliali7028]

Big time!

[@bitflorist]

thanks for not hopping on this "Shocking" AI Clickbait train and provide value.

[@stanislavteliatnikov4787]

Cough Wes Roth cough

[@Josephkerr101]

Yes seriously we need context otherwise it's just another blotch of "shocking"!

[@TheRemarkableN]

But how are we going to know if something has taken the industry BY STORM?!!

[@blisphul8084]

​@@stanislavteliatnikov4787thanks for reminding me to select "do not recommend this channel" if I see that click bait on my feed

[@r34ct4]

Matthew @@stanislavteliatnikov4787

[@Custodian123]

Microsoft's version of GPT4 has always seemed worse to me, compared to OpenAIs.

[@bigglyguy8429]

More gimped and censored, so it's just dumber.

[@othername2428]

Because it is.

[@sblowes]

It is, but it’s important to understand why: ChatGPT is fed a list of (secret) instructions before you even have a conversation with it. The instructions are what makes sure you don’t ask for copyrighted images, or plans to do something illegal, etc. Those instructions take up a portion of ChatGPT’s “memory” it has to work with. When Microsoft places an extra layer on top to get Copilot, there are a whole new set of secret instructions taking up memory space, so there’s less brain power left over for the task you want it to do. It’s why the best “custom” GPT in the paid version is the “Classic GPT” because it’s stripped out everything (like image creation, file processing, etc.) to free up as much of GPT’s brain as possible.

[@BenitoiteBaTiSi]

@@sblowes there is also thing called chatgpt jailbreak on free version i'm not sure if the prompt for it still works

[@thinkfastful]

I agree it is. Take any of the prompting techniques: One Shot, COT, Tree-of-Thought and NONE of them will work in Copilot Pro. This is frustrating for many of us who can only use MS products because of an enterprise ELA.

[@user-cr1ii4vr1l]

Copilot for Enterprise (E3) has many additional features, including using graph, as in using your own data. This vastly increases its functionality. I would be interested if you could do a deep dive into those enterprise level features and Copilot studio. I found them powerful tools.

[@R0cky0]

1:37 apparently there's more description in the original prompt if you look closely

[@StePhillips]

Was about to say the same 👍

[@marsrocket]

That’s the reply from Copilot, not the prompt. It ends with “Enjoy!” and it says “in your script”.

[@100eibbor]

...suggesting the original prompt said 'in my script' not 'in my screenplay' and there would have been a script (or some pages of a script) uploaded in the context

[@cosmicpuma]

Another great vid. I have Co-Pilot, Gemini/Bard and Chat Gpt on the home screen of my phone and found I've used Co-Pilot the most for everyday stuff and Chat GPT for more detailed requirements. I don't use Gemini much at the moment. I also think I might be stating the obvious here, but one of the reasons (besides the pro vs normal tiers) we get different answers every time we prompt is that it's 'learning' all the time. Thanks for all the work you do to always keep us in the loop Matt. Appreciated.

[@BigMTBrain]

Continuous learning may come with ChatGPT 5 level, but with level 4 Pro, what you're seeing is most likely the shift to a larger chat buffer. This means it retains more of a conversation that it can reference when continuing dialog and answering within a given topic.

[@cosmicpuma]

@@BigMTBrain I didn't know this. Thank you so much for the insight and sharing. Appreciated. 👌

[@warezit]

12:33 ... the "delete" button is for clearing the PROMPT, not clearing the content in the document 😉

[@Aireviewroom]

Great video, Thank you for taking the time to walk through the prompts and provide feedback.

[@yoshikagarner6165]

Always informative!!! Thanks, Matt! :)

[@Benchen2]

Just registered for the conference! Awesome video, as always. I'm not too thrilled about Microsoft Copilot so far either

[@drpattycakes]

Been subbed for ya for a good while and watch your vids, homeskillet! - not sure how to mark down that I registered to the GTC event but I did! Been wanting a new video card for a while - mine's literally breaking lol. Wish me luck :)

[@sisyphs]

Keep the work up Matt, we're lucky to have you update us on AI News! Just a quick tip for us geeksters, it could also be nice to have technical videos on which the future architecture for AI or microchips could lay upon etc. with papers!

[@JRLightstein]

Thanks for more great info Matt! I've only really used Co-pilot with Microsoft Word and it is kind of hit and miss for me. I would like to also use it with Outlook, but it doesn't seem to show up in my toolbar for me in Outlook even though I am subscribed to Pro and can use it in Word. Have you noticed anything with that or heard anything about that? Maybe there is a setting I am missing in Outlook? Also thanks for recommending the conference. I am all registered and looking forward to it! Thanks again!

[@jk743]

14:28 it must also be formatted as a table for it to work.

[@amilkes]

Registered, thanks for pointing out the GTC Conference Registration!

[@vineethkumar7803]

Thanks for the shout-out. Registered for GTC.

[@reezlaw]

I have registered to the GTC, how are you going to know for sure?

[@marrlfox]

Excellent video again - honest, to the point - and I registered for the GTC Virtual Conference 👍👍 Thank you, Matt!

[@MeMine-zu1mg]

Oh shit you're in La Mesa. I'm right around the corner in Del Cerro. Anyways after we register for the GTC conference then how do we let you know we registered?

[@Stormhierta]

You can see in the ad that they're using much more extensive prompts when they do fly-overs (check out the storyboarding which has the prompt at the top for a microsecond)

[@mjtech1937]

Great video. Really appreciate the review. I have a few questions, is Copilot really running GPT 4 Turbo? Is Microsoft planning to upgrade to 5 when it's available? I'm a heavy Office 365 user, but I also have an Open AI premium account. What are your thoughts?

[@louiseboyle4231]

If you actually had written a plan and script for a game in one of the other Microsoft apps, like Word, would Copilot write code for that? In your prompt you had no background game for it to write code for. I wonder if that was the problem?

[@roberthancock3539]

I registered for the nVidia conference to enter your drawing for the graphics card but I don't see any way that gets tracked and credited to you, Matt. Is there anything I'm missing here?

[@baronron85]

Same question

[@CHayaPhoto]

hey @mreflow a couple of us curious folks out here are asking how is this registration tracking going to work, how are you going to know who's clicked AND registered? And 2, is shipping outside the US possible? Tks matTe

[@seraphin01]

I didn't see the commercial but you can see on your video that for the storyboard they wrote "colorful" something something.. explains why yours are mostly monochromatic I believe

[@skierpage]

As people have explained in other comments, the user never types "colorful," that's in the text that Copilot generates along with its image.

[@zacboyles1396]

@@skierpageMatt cuts the prompt in half and ends it in an unnatural segment, I’m certain that’s why his lazy attempts were left wanting, no description or direction just read my mind machine. I typed his bird prompt into Gemini and it rendered a horror scene about Sesame Street that looked different enough they wouldn’t be get a lawsuit. Still, it was a monster looking big bird. The same prompt gave me running ostriches. There was no request other than big birds.

[@DerickKamura]

Gemini Advanced surprisingly gave me better output of images and results from the same prompts as used in the Copilot's ad! Damn!

[@zacboyles1396]

Copilot gave me better outputs than Gemini when I typed the same prompt from the ad. Not sure why Matt typed a quarter of the prompt and submitted it

[@ReidKimball]

Dude. If you ask a programmer you hired, “write code for my 3d open world game.” You’ll get the same shitty output bc that prompt is ass. The commercial is not showing how to use the Copilot.

Can you ship worldwide, or is that giveaway only for america?

[@Kezer99]

Registered for the event! Thanks for the most honest AI stuff.

[@J.erem.y]

Registered for that event, thanks for the heads up!

[@Nullzero98]

"Create a presentation about birds"... Sure, here is a presentation with a bird, a mosquito and random landscapes in it. It's like Microsoft is trying to fit a square LLM into a round AGI hole. I can just hear the MS engineers rolling their eyes alllll the way backwards into their skulls as sub-C-Suite-Middle-Manager Tom calls an all-hands meeting saying Tom: "PUT TEH A.I. ON A SPREAD POINT". Engineer: "But sir, LLMs are good at language tasks not a-..." Tom: "DO IT NAO OR REVOKE H1b viSA!!" Engineer: "Okay, but it's not going to wo-" Tom: *Already left Zoom meeting to bump his rookie numbers*

[@skierpage]

Have Copilot generate a video comic sketch from your dialogue. Comedy gold, Jerry!

[@emmanuelgoldstein3682]

Honestly, since Dave Shapiro is having his ego-stroking episode, Matt is the only watchable AI youtuber lately. (edit: AI Explained is pretty good, too)

[@GearForTheYear]

DS is great techno-philosopher but whenever he goes out of that domain I realize how little he knows what he is talking about. His presentations are now mostly just regurgitated ChatGPT vomit

[@beelikehoney]

and matthew berman!

[@beelikehoney]

@@GearForTheYearthen again you can't find new and interesting content without fucking around a bit.

[@emmanuelgoldstein3682]

@@beelikehoney Matthew Berman posted one of the "Shocking" title videos about a sponsored video just a few hours ago. It's hard to ignore that kind of stuff when you're looking for the best information.

[@GearForTheYear]

@@beelikehoney are you saying DS is a one-trick pony? I’m starting to agree.

[@mindruns2646]

Do I have to register through your link for a chance to win?

[@jonandbrooklynn6361]

10:09 when you asked for The Worlds Largest Birds and it gave you a picture of a fuxking fly ROFL i pissed myself laughing 😂😂😂🤣😂🤣😂🤣😂🤣

[@humanmerelybeing1966]

PowerPoint already had a feature to turn an outline into slides, but it basically is just dividing headings into slides and subheadings into titles, etc. But I wonder what would happen if you started with that sort of outline to generate the slides and then asked copilot to improve the design, or to add to what’s there, or even to just make the language more concise.

[@maikvanrossum]

Reminds me of Google’s preview of Gemini late 2023… now I’m looking forward to the same kind of Ad vs Reality comparison when it’s available inside Workspace, too. Was it worth the wait…?

[@phloog]

A whole ad full of people worried they won’t be able to do things that AI will end up doing instead of them. YAY!! I finally achieved something!!! I asked this AI and it did it so it’s kinda like I sorta did it!!!

[@TigerCubMedia1]

You are a legend dude seriously! Thanks for your efforts

[@IanHollis]

Cassowary's are native to Australia. They're essentially feathered dinosaurs.

[@MarkBradley]

Thank you for providing the update on Copilot and the registration link for Nvidia GTC. I'm registered.

[@xbon1]

the free ver and paid ver of dall-e are different, paid ver is landscape which can change the image substantially.

[@mshonle]

Could you try asking it to generate a storyboard with an example screenplay open in word? Maybe open in Word on the web in Edge? Just curious if it will be able to “read” the script to base the storyboards on. If it does work, maybe the same could be used to generate the slides from an outline? That definitely seems to be a use case that Microsoft would support…

[@justintelfer7784]

Exactly the add implied co pilot already had the script. Matt you need to redo the test with script to properly test this.

[@jimlynch9390]

Another valuable video. Thanks.

[@youMEtubeUK]

Not into coding etc, but trying to use Copilot in Office 365 and to be honest it's a struggle, you spend more time checking it that it becomes unproductive. Good as a spell checker, MS Teams summaries and missed emails. and okay for pictures.

[@hans6304]

Hello, may I ask which 365 subscription that you are in?

[@youMEtubeUK]

@@hans6304 Corporate office 365, when the requirement was a min of 300 users.

[@paulstimpson830]

Is there anything in the Copilot ToS that forbids trade marking what you ask it to generate? You see this with stock material all the time. I could see it being a problem if you asked it to generate the Mike's logo but someone else called Mike had already asked a similar question and trade marked similar output then they sue you

[@LewisDecodesAI]

I am making a custom Co-Pilot with custom personas for different content types so i do not have to keep prompting, I can just change between copilots and ask it for the content I want without having to specify advanced details like style, voice and literacy devices.

[@tracerman]

@1:37 - Shows a much more detailed prompt that expanded on the initial one line. I think its not a fair 1:1 unless you use the same prompt.

[@sullfolife]

dude taht moskito on the slide for the eagle cracked me up hahahahaha

[@yogendrasinh]

Thanks buddy! This is very helpful.

[@skierpage]

4:00 Mil'ics Rrupar Garage with its "Cake YIOT" sounds like a crazy reality TV mashup from the Balkans. Ask MS Copilot to generate a storyboard and video game for that!

[@GrimmjowSextaEspada]

What's the context window of Copilot in MS Word? Would it be able to manage a 150k words document?

[@play150]

also wondering

[@LanceWinder]

Registered… figure these are my bets odds ever 😂. Appreciate the honest review; I was underwhelmed as well. Maybe it’s me, but it feels as though AI went 0-1000 last year, and this year it’s been forever to get to 1001.

[@zacboyles1396]

Just avoid Matt’s mistake thinking it can read your mind and pro tip, if you don’t get what you expect, maybe try 1 more time and consider giving it a variation on your first attempt instead of pulling a Matt, giving up without even trying.

[@ismailtibba]

Thanks, Matt. They've really tweaked Copilot it's completely different now.

[@jydesign]

I love your videos Matt, but you can see more of the Dragon prompt once the images appear in the MS video and you can see the prompt was longer and included requests for color etc. So I felt like your point was a little weak by using a prompt that was clearly not an exact match to the one in the ad.

[@hope42]

I went to sign up for Register for the free Nvidia GTC conference and ran into this on the registration form: Emergency Contact* required field. Please explain! Quite odd!

[@bigglyguy8429]

Just plain spying and data gathering on you.

[@seanbrockest3888]

I asked both ChatGPT and Gemini to "write a rambling uneducated speech about a random topic that the speaker obviously has no formal knowledge of.", and hilariously they both chose a hillbilly explaining quantum mechanics. They're amazing to read. Copilot on the other hand, wrote a rather interesting speech about "quantum cheese".

[@tecnopadre]

Totally agree with you. Also you forgot to tell that Copilot pro although is faster than GPT4 on the replies you can't upload files to ask like GPT 4

[@freedom_aint_free]

The Ethanol structure is actually wrong or really odd in the chemistry Quiz: It should have been CH3-CH2-OH, the second carbon atom from the alcohol functional group (-OH) has 4 hydrogen atoms whilst the first Carbon atom has none.

[@meganeder5181]

Was looking for this comment. It drew Ethanol wrong.

[@user-tc3gq9pl6p]

it is sometimes annoying when u scroll down after searching something in microsoft edge and the copilot just opens when we dont need it

[@LucienTheLuckless]

In regards to the contest, how do you corroborate the viewers to the list of virtual attendees?

[@mikeray2318]

How do you confirm registration to win the Nvidia RTX 4080 Super Giveaway?

[@A-Gambino]

Thanks you covered all the questions I had in my head. 20 bucks doesn't seem worth it right now

[@nickgirdwood3082]

Copilot is equally as broken as ChatGPT in my experience. They both give me Python code and then proceed to criticize their code when I feed it back. ChatGPT is a little better, and it's not limited to 30 chats per conversation. It also doesn't just randomly break. But it does respond faster.

[@michaelollom9964]

Anything about the 'Create A Personalized AI Chatbot with Chat With RTX' from Nvidia?

[@miladmirmoghtadaei5038]

And how would you know if we registered for the conference?

[@goatapp8965]

In the commercials title, it says images are colorful, so I’m guessing that’s why they got color

[@humanmerelybeing1966]

As a professor, I just want to be able to more quickly and easily create or update my PowerPoints. The amount of time it takes to make slides for a lecture is absurd and sometimes takes longer than writing the lecture itself. To be fair, I try to make my slides more interesting than just words and images, for example using animations or a more dynamic text-highlights appearing behind words on the slide as I mention them in my lecture. I don’t expect Copilot to do everything for me, but just being able to prompt it to do something rather than manually doing it myself would be a huge help. Ultimately, making good slides does improve my students’ education, but it’s not the skill I went to grad school to master, and in the end the tedium just takes away from the time I have to devote to grading and giving students feedback on assignments. If AI can help me get the best of both worlds, that would really be a huge benefit for myself, my teaching, and most of all my students. On the other hand, I’ll probably have to spend more time trying to guess if students’ assignments are generated or their own words. So it’s a bit of a double edged sword.

[@skitzybaby1]

Just registered, super excited!

[@MooseyMax]

I can't see anyone else mentioning it - Copilot in Microsoft 365 (Excel) only works on Tables, not raw data. Convert the source to a table and click inside it then the button will turn on.

[@terrypower8856]

I assumed the commercial only showed the beginnings of each prompt. The rest of it could specify parameters.

[@onoff5604]

Great comparisons

[@shaundee]

Useful, thanks - going to hold off on subscribing to pro based on this until it really is helpful!

[@Arcticwhir]

literally the next couple frames of the copilot presentation shows a much longer prompt than what you put

[@rawallon]

Hey, dev here, the code shown on the comercial actually looks like it does the same thing to what the code given to you: move a character, it just go about it in a different way

[@bill2292]

So maybe do a regular feature comparing GPT and Copilot and Gemini and Llama?

[@rodneydithobane2175]

How would know we hv register?

[@holdthetruthhostage]

Waiting on Dale 3.5 - 4 & For Copilot to pilot my PC & Software

[@GhostriderBA877]

The prompts don’t work for me lol for the organic chemistry prompt it gives me websites that I can use to get a quiz. I also find it slow and lagging behind other similar tools.

[@BFCNetworks]

@matt. Would you be doing a collaboration video on Copilot and the enterprise place. I’ve done a video recently about the 5 versions of Copilot and Microsoft have over 76 products. Would be awesome to chat and discuss. BTW Excel is still in preview

[@i24p71]

I always use precise style. This way It' more precise in answers and I get results I want. During month of use I was able to automate my everyday work on excel using VBA creating macros. I'm very happy. I have office 365 subscription, and use free version of copilote and that's anough for me.

[@picksalot1]

When I've used Copilot and left it open, it seems to slow down the performance of different Browsers like Chrome or Firefox. Makes me wonder if Copilot is data mining.

[@babakbabak5329]

Interesting!

[@BhikkhuBear]

On the story board one you only did a one sentence prompt when you show the video again the used prompt in the video is way more in depth than yours. just an observation, not trying to discredit what you are saying at all.

[@gilbertng945]

Great review, thanks! Confirms my suspicions, Microsoft still has the bad habit of announcing/protraying a much better picture than the real world performance of its products…

Its seems the crew of marketing is a step ahead than the developers team at Google

[@karinkuto5540]

Wait, what are all those options under the generated image? Does it only work in the US?

[@OttoBlotto321]

I tried it from Australia and was told it couldn't generate the actual images all I got was a description of the scene. I then tried trough a VPN to the US and got 4 pictures of dragons burning stuff. I tried a couple of times most did not even have a picture of a storyboard.

[@karinkuto5540]

​@@OttoBlotto321 the web plug-in is open when you try to generate the images without the vpn right?

[@snakebyteOne]

Early days is right. MSFT doesn't want to get sued for copyright infringement, so the poor images that were generated could be a result of a very much trimmed down and non-copyrighted set of images used in their model.

[@PerfectArmonic]

Copilot doesn’t give access to the former topics. I mean they are listed on the right side of the canvas but I cannot click them 😢 Why? Could be due the fact that I’m using Firefox?

[@brandex2297]

That is correct.

[@teleshyam26]

Really nice video! i was wondering if i could help you edit your videos similler to your videos it will save your time.

[@JoePhotoByJS]

Registered and did the virtual GTC 2024 Keynote [S62542] ... and wow... the democratizing AI initiatives made me legit excited! The fact that they are focusing on ensuring diverse groups have access to AI education and tools is a game-changer that could exponentially increase our next generation of adults' intelligence, and turbocharger the pace at which we make technological breakthroughs. The AI community is legit leading the future!

[@MikeTheNABI]

Will Copilot work with Visio and Access?

[@jacquelinelmiller]

Well you didn’t get colorful storyboards because yours didn’t say to do colorful images like the ad. You can see in the screenshot you showed that they prompted for colorful storyboards.

[@emmanuelgoldstein3682]

That's not the prompt, that's the text response from the model.

[@jacquelinelmiller]

@@emmanuelgoldstein3682 I don’t think so. See timestamp 1:37

[@RJMCTV]

The mention of colourful is in copilot response, not the users prompt

[@jacquelinelmiller]

@@RJMCTV I guess what I’m saying is they prompted for colorful even if they didn’t show that. Maybe that’s what you all are saying too, but I think the first simple prompt was just dumbed down for the audience.

[@emmanuelgoldstein3682]

@@jacquelinelmiller No, that's not what we're saying. The model added the 'colorful' context itself to fill in details that were related to the original prompt. The DALL-E pre-prompt sections in gpt4 (with layers added for Bing) tell the model to expand on text details when generating images based off of limited user prompts.

[@bskee1615]

Thanks!

[@WeylandLabs]

Co Pilot = Data Brokers dream ! 😂 You'll understand why your data is important when you learn about your data !

[@donaldgarner6627]

Great vid, thank you!

[@W4RM4NTuBe]

By the response from Copilot @1:36 you can see her prompt was more detailed. Sketched in color pencil style. Spiky tail. Colorful and vibrant.

[@skierpage]

It's pretty obvious that Microsoft showed Copilot's responses to much more detail prompts after some back and forth. The text you see is not the user's prompt, it is text that Copilot generated along with its image in response.

[@W4RM4NTuBe]

@@skierpage read my comment again. I literally said, "By the response from Copilot." I do agree that the commercial is a tad misleading, especially the Mike's sign prompt. No way you get four images with the letters correct. I have had success with Copilot writing python scripts, but I believe Chat GPT is more precise in providing what is prompted.

[@irocz5150]

What I notice is the words are with a typo or with space in the word.

[@b326yr]

Still early days my foot, make it free then!!

[@brentmorris8626]

The screwed-up color in the screen is your use of Dark theme.

[@riazzcaan]

Thank you for update it works very good actually some the images are better then midjorney ,

[@DeceptiveRealities]

Moral of the story: NEVER demonstrate an LLM using prompts that are visible and then show "results" from those supposed prompts. It's almost as bad as Google faking those videos that appeared to show instantaneous responses using machine vision.

[@chanm01]

It was Chiefs vs 49ers, but every time the Chiefs did almost anything the producers cut to Taylor Swift to get her reaction so... you were half right? Anyway, these Copilot ads suffer from the same problem as last year's Gemini demos: Marketing people were allowed to setup false expectations because they didn't trust people to be smart enough to understand that what these LLMs can do today is already kinda incredible. The use cases are just a lot narrower than the ads suggest. Here are some practical ways people can use Copilot right out of the box: - a starting point for a search, when you have a problem, but you don't know exactly what search terms you should be using - generating throwaway text for social media posts