Apple's new AI features Apple Intelligence will bring generative AI to the iPhone, iPad, and Mac with several new features includingadvancedLanguage comprehension and creative function.
These new system-wide writing tools in iOS18, iPadOS18, and macOS Sequoia will help users communicate more effectively by enabling them to rewrite, proofread, and summarize text in virtually any application, including Mail, Memo, Pages, and third-party apps.
Apple says.Apple Intelligence is deeply integrated into iOS18, iPadOS18, and macOS Sequoia. It leverages the power of the Apple chip to understand and create language and images, take action across apps, and draw on personal context to simplify and accelerate everyday tasks.
OpenAI and Apple announced a partnership on Monday that will see ChatGPT integrations appear in several new features of Apple Intelligence. In a new chapter of Apple innovation, Apple Intelligence will change what users can do with Apple products and what Apple products can do for them, said Apple CEO Tim Cook.
Here's what's new in Apple Intelligence.
I. Word processing functions
Apple Intelligence powers new writing tools that help you find the right words at the right time. With enhanced language features, you can summarize an entire lecture in seconds, get a shorter version of a longer group discussion, and prioritize notifications through themaximumMinimize unnecessary distractions.
Using smart writing tools
Transform the way you communicate with smart writing tools that proofread your text, rewrite different versions until the tone and wording are just right, and summarize selected text with a single tap. Writing tools can be used almost anywhere you write, including third-party apps.
Priority notification
Priority notifications are displayed at the top of the stack so you know at a glance what to look for. Notifications are summarized so you can navigate through them more quickly.
Mail Priority Messaging
Prioritized messages in emails elevate time-sensitive messages to the top of the inbox - such as invitations with today's deadline or boarding reminders for today's afternoon flights.
Tap to display a summary of a long email in the Mail app, straight to the point. You can also view email summaries directly from your inbox.
Simply tap Record in the Notes or Phone apps to record audio and transcripts, and Apple Intelligence generates a summary of your transcripts, so you can get the most important information at a glance.
Reducing interference
Reduced Interruptions is a new focus that understands what your notifications are about and shows you notifications that may need immediate attention, such as a text message about picking up your child from daycare later today.
Email Intelligent Response
Use the Intelligent Response feature in Mail to quickly draft an email response with all the right details.Apple Intelligence recognizes the questions you've been asked in an email and provides relevant options to include in your response. With just a few taps, you can send a response that includes answers to key questions.
Second, the picture creation function
Apple Intelligence lets users express themselves visually in new ways. Create fun, original images and new Genmoji that are truly your own. Use Image Wand to turn sketches into relevant images that complement your notes. And create customized memory movies based on the descriptions you provide.
Image Playground
Make fun and original images in just seconds with the Image Playground experience in the app. Create brand new images based on descriptions, suggested concepts, or even people from your photo library. You can easily adjust styles and make changes to match message threads, free-form boards, or slides in Keynote.
Experiment with different concepts and try out image styles such as animations, illustrations and sketches in the dedicated Image Playground app. Create custom images to share with friends in other apps or on social media.
Genmoji
Make brand new Genmoji directly on the keyboard to match any conversation. Provide a description to see a preview and tweak the description until it's perfect. You can even select someone from the photo gallery and create a Genmoji that resembles them.
Image Wand
Image Wand converts your sketches into relevant images in the Notes app. Use your finger or the Apple Pencil to draw a circle around your sketch, and Image Wand analyzes the content around it to create complementary visuals. You can even circle a blank space and Image Wand will use the surrounding background to create an image.
Memory Movie
Create customized memory movies of the stories you want to see right in your photos. Enter a description and Apple Intelligence finds the best matching photos and videos. Then it creates a storyline with unique chapters based on recognized themes and arranges your photos into a movie with its own narrative arc.
Search for photos and videos
Search for photos and videos in the Photos app by simply describing what you're looking for. Apple Intelligence can even find a specific moment in a video clip that matches your search description and take you directly to that moment.
AI elimination
Use the cleanup tools in the Photos app to remove distractions from your photos.Apple Intelligence recognizes background objects, so you can remove them with just a tap to get the perfect shot while preserving the original image.
Third, open siri new era
siri leverages Apple Intelligence to realize new superpowers. With a new design, richer language understanding, and ready-to-type Siri With Siri's capabilities, communicating with Siri is more natural than ever. With a sense of your personal environment, the ability to take action within and across apps, and product knowledge of your device's features and settings, Siri will be able to help you like never before.
new design
Siri features a new design that is more deeply integrated into the system experience, with an elegant glow that wraps around the edges of the screen.
text command
When you don't want to speak up, simply double-tap the bottom of your iPhone or iPad screen and you can enter text to Siri from anywhere on the system.
Richer language comprehension
Richer language understanding and enhanced voice capabilities make communicating with Siri more natural. Siri knows what you're talking about when you mention something from a previous request, such as the location of a calendar event you just created, and ask, "What's the weather like there?" Siri knows what you're talking about.
Screen Sense
Apple Intelligence gives Siri screen awareness so it can understand and act on what's on the screen. If a friend sends you their new address, you can say "Add this address to their contact card" and Siri will take care of it.
Understanding Personal Background
Knowing your personal background allows Siri to help you in ways that are unique to you. Can't remember if a friend shared that recipe with you in a note, text message or email? Need your passport number to book a flight? Siri can use its knowledge of the information on your device to help you find what you need without invading your privacy.
Seamless execution of operations
Use Siri to seamlessly perform actions within and across apps. You can make a request, such as "Send the email I drafted to April and Lilly," and Siri knows which email you're referencing and which app it's in. Siri can perform actions across apps, so after you've asked Siri to enhance a photo for you by saying Siri works across apps, so after you ask Siri to enhance a photo for you by saying "Make this photo stand out," you can ask Siri to put it in a specific note in the Notes app - without lifting a finger.
IV. Privacy and security
Apple Intelligence is designed to protect your privacy every step of the way. It's integrated into the core of your iPhone, iPad, and Mac through on-device processing. So it knows your personal information, but it doesn't collect it. With breakthrough private cloud computing, Apple Intelligence can leverage larger server-based models running on the Apple chip to handle more complex requests for you while protecting your privacy.
V. Seamless integration of ChatGPT
OpenAI's ChatGPT is integrated into Siri and the Writing tool, so you can get more expertise when you need it, without having to switch between tools.Siri can use ChatGPT to handle certain requests, including questions about photos or documents. With Compose in the Writing tool, you can create and draw original content from scratch.
You control when you use ChatGPT and your consent is sought before any of your information is shared. ChatGPT is free for anyone to access without creating an account, and ChatGPT subscribers can connect accounts to access paid features of these experiences.
VI. Devices that support Apple Intelligence
Apple Intelligence is free to use and will initially be available in U.S. English. A beta version will be available this fall. Compatible devices include.
- iPhone 15Pro MaxA17 Pro
- iPhone 15ProA17 Professional
- iPad ProM1 and higher
- iPad AirM1 and higher
- MacBook AirM1 and higher
- MacBook ProM1 and higher
- iMacM1 and higher
- Mini Mac M1 and higher
- Mac Studio M1Max and higher
- Mac ProM2super