What is Apple intelligence?
Apple Intelligence is a new artificial intelligence (AI) platform designed for Apple products like iPhones, iPads, and Macs. It was announced in June 2024 at WWDC 24 [1].
Here are some key features of Apple Intelligence:
- Generative models: It uses generative models to create new content, like images and text. For instance, you can describe an image and have it created for you, or have your writing style adjusted in emails.
- Personal context: Apple Intelligence considers your personal information and habits to provide relevant suggestions and complete tasks.
- Siri enhancements: Siri, the virtual assistant, is enhanced with Apple Intelligence. Siri can now understand and respond to more complex requests and can take action based on what you’re seeing on your screen.
What will Apple intelligence do?
Apple Intelligence brings a bunch of new AI features to your Apple devices. Here are some examples of what it can do:
- Smarter Photos: No more endless scrolling! Search for photos using natural language like “beach vacation with Sarah” or “dog wearing sunglasses.”
- Writing Assistant: Stuck for words? Apple Intelligence can help you rewrite sentences, check grammar, and even summarize lengthy articles.
- Proactive Siri: Imagine Siri noticing a concert on your calendar and then asking if you want to hail a ride or order tickets.
- Fun with Images: Feeling creative? Describe an emoji using words and Apple Intelligence can create a custom emoji (Genmoji) for you.
- Siri Across Apps: Let’s say a friend texts you their new address. Siri can understand the context and offer to add it to your contacts with a simple voice command.
What are the capabilities of Apple Intelligence?
Apple Intelligence allows users to enhance their writing skills and communicate more effectively. Apple is introducing systemwide Writing Tools integrated into iOS 18, iPadOS 18 and macOS Sequoia. These tools will enable users to write, edit, proofread, and summarize text in various applications such as Notes, Pages, Emails, and third-party apps. However, no matter how advanced the system becomes, it still cannot compare to the expertise and nuance brought by a ghostwriter when it comes to crafting extensive texts and academic papers.
According to Apple, the ‘Writing Tools’ supported by Apple Intelligence will boost users’ confidence in their writing. For instance, the ‘Rewrite’ feature offers users different versions of their text, adjusting the tone to match the audience and purpose. On the other hand, the ‘Summarise’ feature allows users to condense selected text into easily digestible paragraphs, bullet points, tables, or lists.
When it comes to managing emails, Apple Intelligence simplifies the process. Features like Priority Messages highlight urgent emails at the top of the inbox. With AI integration, users can view email summaries without opening them. The ‘Smart Reply’ feature suggests quick responses and identifies questions in emails to ensure comprehensive answers.
AI enhancing communication and creativity
One of the most notable aspects of AI is its ability to generate images from natural language prompts almost instantly. Apple Intelligence not only streamlines communication but also empowers users with creative expression. The Image Playground feature allows users to create images in seconds, choosing from animation, illustration, or sketch styles. This feature is integrated into various apps, including messages.
Additionally, Apple offers a dedicated app for experimenting with images, allowing users to select concepts from categories like themes, costumes, accessories, and places. Users can describe an image, select a person from their photo library to include, and choose a preferred style.
Apple has introduced Genmoji, an image generator focused on emojis. Users can create emojis by typing a description.
Apple Intelligence enhances photo searching on iPhones, enabling users to search for specific photos using natural language prompts. Users can also search for specific moments in videos. The ‘Clean Up’ tool can identify and remove objects from the background of photos.
Apple Intelligence enhances Siri’s capabilities
With Apple Intelligence, Siri is now more contextually aware and has improved language understanding. Powered by AI, Siri is more natural, contextually relevant, and personalized. Siri can now follow along if a user stumbles over their words and maintains context between requests. Additionally, Siri has a new design with a glowing light around the screen edge to indicate activity.
Apple Intelligence introduces ‘onscreen awareness’ to Siri, allowing Siri to interact with visible screen content. For example, if a friend sends a new address, the user can simply say “add this address” to their contact card, and Siri will execute the command.
Integration of ChatGPT by Apple
Apple has officially partnered with OpenAI to deeply integrate ChatGPT into the iOS 18, iPadOS 18, and macOS Sequoia systems.
Apple explains the ChatGPT feature as follows:
By integrating ChatGPT from OpenAI into Siri and Writing Tools, you gain more expertise conveniently without switching between tools. Siri can utilize ChatGPT for specific requests, such as questions about photos or documents. Additionally, with Compose in Writing Tools, you can generate and illustrate original content from scratch.
Device Supporting Apple Intelligence?
Due to the advanced computing resources needed to effectively power these features, Apple Intelligence is only available on a select number of modern devices:
Also Read: Introduction To Artificial Intelligence
- iPads with M1, M2, or M4 chip
- Macs with M1, M2, or M3 chip
- iPhone 15 Pro and Pro Max
Conclusion:
Apple Intelligence signifies Apple’s major push into on-device AI. It aims to personalize the user experience by understanding your habits and content, all while keeping your data private. With features like a smarter Siri, creative content generation, and proactive assistance, Apple Intelligence has the potential to make Apple devices even more helpful and intuitive. However, it’s still early days, and how well it delivers on these promises in real-world use remains to be seen.
