Apple AI is here and it's EPIC - ChatGPT added to Siri

Apple has finally introduced ton of new AI updates coming to iPhone, iPad and Mac. These include a brand new AI model called Apple intelligence as well as ChatGPT integration across all Apple devices.
Here is the full breakdown.
1. Apple Intelligence - New AI from Apple
Language and Text Creation:
- Creates language and text using large language models.
- Powered by brand new writing tools.
- Ability to rewrite and summarize text within Mail, Pages, and third-party apps.
Image Creation:
- Capable of creating images.
- Personalizes images using access to your photo library.
- Supports sketching, illustration, and animation.
2. Actions:
Cross-App Actions:
- Take actions across your apps.
- Example: Pull up files shared with you.
- Example: Play the podcast your wife sent the other day.
3. Personal Context:
Contextual Retrieval:
- Retrieves and analyzes context from your different apps.
4. Privacy:
On-Device Intelligence:
- Utilizes on-device intelligence.
- Employs private cloud compute.
- Models run on Apple Silicon servers designed for this purpose.
- Tries to process on-device first; if more compute is needed, it sends to the private cloud compute.
5. Siri:
5.1. Enhanced Natural Interaction:
- More natural, relevant, and personal.
- Offers Type to Siri functionality.
- Allows switching between text and voice.
5.2. On-Screen Awareness:
- Siri can see what's on your screen and use the content as needed.
5.3. Siri Actions:
- Example: "Show me my photos and make them pop."
- Example: "Add this to my note with bio."
6. App Intents:
6.1. New Framework:
- Apps can define a set of actions for Siri and Apple Intelligence to take advantage of.
6.2. Siri Updates:
- Updates coming to Mac and iPad.
7. System-Wide Writing Tools:
Capabilities:
- Rewrite text.
- Proofread documents.
- Change tone of writing.
- Summarize content.
8. Email Features:
8.1. Smart Reply:
- Offers smart replies in Mail.
8.2. Email Summarization:
- Provides email summaries at the top of your inbox.
- Allows tapping to get a summary of long emails.
- Prioritizes emails based on their context.
8.3. Notification Management:
- Prioritizes notifications and offers summaries.
- Reduces interruptions by surfacing only essential notifications.
9. AI in Messages:
Genmoji:
- Create AI-generated emojis (Genmoji) based on descriptions.
- Create Genmoji that resemble people in your contacts using your photo library.
10. Image Playground:
10.1. On-Device Image Creation:
- Create as many images as you want on-device.
- Integration within Pages, Keynote, and Numbers.
10.2. Image Playground App:
- Dedicated app for creating images.
10.3. Image Playground API:
- API available for developers.
11. Image Wand in Notes App:
Sketch to images:
- Turns sketches into images.
12. Photo Editing Updates:
12.1. Clean-Up Tool:
- Tools to improve your images.
12.2. Natural Language Search:
- Search for photos and videos using natural language.
12.3. Memory Movies:
- Create movies based on your photos and videos using prompts.
13. Notes App Enhancements:
Audio Features:
- Record and transcribe audio.
- Provides summaries of recordings.
14. ChatGPT Integrations:
14.1. Siri Integration:
- ChatGPT integrated into Siri.
14.2. Content Creation:
- Create content with ChatGPT in Pages using the compose feature.
14.3. Access and Features:
- Free access to ChatGPT.
- Paid subscribers have access to additional features on Mac.
15. Availability:
- Available this summer.
- Public beta coming in iOS 18 this fall.
Access Top Courses on ChatGPT and 50+ AI Tools on Our E-Learning Platform: bit.ly/skillleap

[@SkillLeapAI]

Access Top Courses on ChatGPT and 50+ AI Tools on Our E-Learning Platform: bit.ly/skillleap

[@mountainheight]

Now, after thousands of years, i am seriously interested in buying 1 i phone . Now it is relevant

[@dougg1075]

Things are about to get weird.

[@rickwagner144]

They want to try and keep as much of the AI processing on board the device. I’m not sure how well that’s going to work and they’re quite fuzzy about what that’s supposed to mean. It’s difficult to imagine a comprehensive LLM that can operate within a handheld device, even the most basic functions. Lately Apple has a tendency to take things other people have done tweak them and act like they’re all shiny and new on board their product.

[@paultparker]

I’m not an apple hater, but it’s worth noting that almost everything Apple has ever done was done by someone else first. Apple just made it better, and more importantly made it just work, which most tech companies don’t seem to be able to do or willing to do. Notable exceptions include the iPhone, the iTunes music store, and I believe the App Store, and possibly the Newton. Making AI usable and useful for normal people is something no company has really succeeded that so far to the best of my knowledge.

[@paultparker]

Are you keeping up with the quality of small models? They are becoming remarkably capable, by creating custom synthetic data from a more powerful model like GPT4. Presumably they can’t ever exceed the bigger models that are feeding them, but their performance is becoming much more comparable than I would have expected a year ago.

[@wildbillfrombuffalo]

​@@paultparkeramazing right? I can't remember which social media company actually released a piece of hardware that processes LLMs last year!!

[@totheknee]

You made an obviously callow comment. What's fuzzy about it? If it works in real time, they do it locally. If it takes too long, they do it on the private cloud. It honestly isn't that difficult to understand. It's like you're trying to invent a phony problem just to bash a company you don't like. And "lately?" lol, this is Apple's _entire_ MO since day one! It's why they're worth 3 trillion USD. Where the heck have you even been since 1984?

[@MindBlowingXR]

Thanks for the great video!

[@sandro-nigris]

Great video, very informative. Thanks! Checking your courses now...

[@DevonMeadows]

Super pumped for everyones bots to just be emailing each other all the time.

[@ChazW93]

Lmaoooooo

[@micbab-vg2mu]

great update -)

[@The_Big_Giant_Space_Chiken]

Great video! I´m a little confused though. I thought that Open AI (the creators of Chat GPT) were already in a partnership with Microsoft. So how is MS ok with Chat GPT now being included in all Apple products?

[@SkillLeapAI]

Yea I’m confused about that too

[@brandonreed09]

They weren't OK with it, but they don't own all of OpenAI or even the majority so they didn't have control to block it.

[@IonicTechYT]

It is not an exclusive partnership. OpenAI is very smart with how they setup all these "partnerships". None of them are exclusive. Microsoft funds them plenty and in return, they get first dibs in a lot of the newer models/features, and to some extent, request for features themselves. However, none of these models and features are exclusive to Microsoft. OpenAI is like the early internet, you want it and can pay for it, you got it.

[@ewonresi574]

​@@SkillLeapAI❤ 1:34

[@sharonb.9128]

I don’t actually think ChatGPT is fully integrated. Apple developed their own LLM and cloud servers. All the queries are on device or on Apple servers. Only when those are still not powerful enough will Siri ask the user if they want to go off device to ChatGPT.

[@johannesdolch]

I want to see the exceptions to those privacy servers. e.g. Can a court order give them access to all your private data? If they want us to take this seriously there can be ZERO exceptions for example by encrypting all data in a way that even they don't have access to it. But just on a promise to not do anything with you data? No thanks.

[@SkillLeapAI]

Maybe they will have an option to avoid the cloud and only use the on device ai capabilities

[@m12652]

Try to remember Apple is an American company and America is the reason Israel has been murdering Arabs for the last 75 years. Do you really want products from a country that lends money to terrorists like Israel on the sole condition they use it to buy American weapons to kill civilians?

[@uncletimo6059]

you already know the answer, OP

[@ChazW93]

Theres is going to be some laws in place for sure to request private data.

[@paultparker]

Are you 100% confident you are not already giving Apple a way to access your information if the government requests it? If so, then yes, you will need to turn this feature off too. Although if they truly don’t save it, and are not legally required to, then perhaps you can believe that there will never be retrospective discovery.

[@raphaelkairy]

Glad to see apple integrate AI however none of these use cases seem particularly useful to me

[@ChristopherBalbuena]

Just a hypothetical question, does Samsung will make this kind of AI tech also? Or is it being developed already?

[@SkillLeapAI]

I’m sure they are now since Apple and Google are adding all this ai to their phones

[@user-dd7pq2to3o]

Private cloud compute = opanai api key

[@ThePIASKOWSKI-iu1sl]

Question: what's about our privacy ?

[@SkillLeapAI]

I covered what they said about privacy quickly but they spent about 5 minutes discussing it. Lot of it takes place on device, and the other things that require more compute uses a private server architecture

[@ThePIASKOWSKI-iu1sl]

@@SkillLeapAI Thank you for your answer (and your video)

[@maikvanrossum]

Typical Apple introduction of some basic stuff. Yes, on device AI is great if you your (new) device is capable enough… otherwise it simply moves to the cloud, too. After that it becomes as fuzzy as all other vendors. Yes ‘free’ #Google products make use of adds, but for their business offerings through #Workspace they don’t use your data for it. Same thing as #Apple and #Microsoft promise you. Then there’s the #ChatGPT integration, which is basically the same as #Copilot or #Gemini offer, including the code word ‘free’ of charge… so if it’s Apple we tend to believe that means ‘no money is being made through this service’. But you can also use your existing ChatGPT subscription for ‘extra’ functionality, which is…? That would be more tokens, newer models, etc. so the basic integration would be the ‘free’ version, like through #Edge or #Bing, or Google Gemini standard and Search. A lot of promises and eye candy, but all promises on #privacy are still just #marketing… we’ll have to see how these are being implemented in the final releases ‘this fall’ and beyond.

[@Tech99802]

personally I don't find my interest in artificial intelligence it may interest people who work with it like companies or developers after its a chat so it makes you have an interest to discuss I prefer to spend my time outside of smartphones

[@Tech99802]

personnellement je ne trouve pas mon intérêt dans l'intelligence artificielle sa peut intéresser les personnes qui travaille avec comme les entreprises ou les développeurs après ses un chat donc il fait avoir un intérêt pour discuter je préfère plus passé mon temps en dehors des smartphone

[@jnusen]

Privacy, that is some funny excrement right there. None of these tech businesses have your privacy in mind. Invasive is the better word to use.

[@southcoastinventors6583]

Apple said we can way more invasive that windows. Think the way we want you too

[@mattesrocket]

will you be able to turn off all these functions? I don't need them, I don't want them, costs only data traffic, and/or if you have a tariff not with unlimited data all included or if you travel abroad with extra charges for data packages and you don't know, how much traffic all these functions... And does your phone work normally, if you have no internet access? I am not convinced at all, the more functions you get, the more buggs you can have and that's more stress. And how many missunderstandings will it create, if your phone summarizes your friends messages not all correct and your phone creates an "intelligent" answer and the phone of your friend will answer to this automatically... We saw in the last 20 years so many "tools" that were supposed to make our life more efficient and should save us time but in reality everything became more hectic and stressfull and many people unlearned normal communication and to work things out themselves...

[@DanD_1]

Addios privacy