applePlanned for the upcoming release iOS Apple introduced several AI-driven features in 18, including smart replies for messages and generative photo editing tools.
The latest report from AppleInsider revealed some details of iOS 18's highly anticipated AI features, including major upgrades to Siri, including:
-
Improved responsiveness: The new Intelligent Reply framework will significantly improve Siri’s ability to generate responses, taking into account information such as contacts, companies, calendar events, locations, dates, etc., making responses more accurate and relevant.
-
More natural voice: Improved text-to-speech capabilities will make Siri sound more natural.
-
Cross-device media control: Users can control media playback on one device through Siri on another device, such as controlling Apple TV through Apple Watch. However, it is reported that this feature will be launched later in 2024.
-
Message Summary: Users can use Siri to quickly get an overview of recent notifications.
In addition to the upgrade of Siri, iOS 18 will also introduce a series of AI-driven features for native apps:
-
Smart reply for messages/emails: The system will automatically generate text suggestions to help users quickly reply to messages and emails.
-
Transcription and summarization features for note-taking apps: New AI tools allow users to edit audio, perform voice transcription, and text summarization in note-taking apps.
-
Math Notes: Added support for math symbols and integration with the Calculator app. Math Notes can recognize math equations and provide solutions and generate charts.
-
Keyboard math prediction: When typing, the system can recognize complex math expressions and provide automatic completion suggestions, similar to the word association function in the input method.
-
Photo Cleanup: Uses generative AI to remove unwanted objects from photos. This feature will replace the current Retouch tool.
-
Generative Creation Space: This is an application that uses generative AI to create and edit images. It is currently only available for internal testing by Apple, but it hints that in the future it may allow users to generate images and share them via iMessage. This may be related to the previously rumored user-generated emoji function.
Apple will demonstrate these new AI capabilities during its WWDC keynote on June 11.