Apple Intelligence
![]() | |
Developer(s) | Apple Inc. |
---|---|
Operating system | iOS 18, iPadOS 18, macOS Sequoia |
Platform | ARM |
Type | Artificial intelligence |
License | Proprietary |
Website | https://www.apple.com/apple-intelligence/ |
Part of a series on |
Artificial intelligence |
---|
![]() |
Major goals
|
Glossary |
|
Apple Intelligence is an artificial intelligence platform developed by Apple Inc.[1] Relying on a combination of on-device and server processing, it was announced on June 10, 2024, at WWDC 2024 as a feature of Apple's iOS 18, iPadOS 18, and macOS Sequoia operating systems, which were announced alongside Apple Intelligence. Apple Intelligence will be free for all users with supported devices. It launched in the United States on July 29, 2024, with the iOS 18.1 Beta, and will fully launch in 2025.[2][3]
Models
Apple Intelligence consists of an on-device model as well as a cloud model running on servers using Apple silicon. Both models consist of a generic foundation model, as well as multiple adapter models that are more specialized to particular tasks like text summarization and tone adjustment.[4]
According to a human evaluation done by Apple's machine learning division, the on-device foundation model beat or tied equivalent small models by Mistral AI, Microsoft, and Google, while the server foundation models beat the performance of OpenAI's GPT-3, while roughly matching the performance of GPT-4.[5]
Apple's cloud models are built on a Private Cloud Compute platform, designed heavily with user privacy and end-to-end encryption in mind.[6][better source needed]
Functionality and features
Writing tools
Apple Intelligence features writing tools that are powered by AI, including Rewrite and Proofread. These features help enhance users' writing to make it more friendly, concise or professional, similar to Grammarly's AI writing features. It can also be used to generate summaries, key points, tables, and lists from an article or piece of writing.[7][8] ChatGPT will be available as part of Writing Tools.[9]
Image Playground
Apple Intelligence can also be used to generate images on-device with the Image Playground app. Similarly to OpenAI's DALL-E, it can be used to generate images using AI, using phrases and descriptions to create an image with customizable styles such as Animation and Sketch.[10] In Notes, users can access Image Playground on iPad through the Image Wand tool in the Apple Pencil palette without having to open the Image Playground app. Rough sketches can be transformed into images.[11]
Genmoji
Using Apple Intelligence text-to-image models, users can create original Genmoji images by typing descriptions.[12] Users can pick people in photos and create Genmoji images that resemble them.[13] Similarly to emoji, Genmoji can be added inline to text messages and can be shared in Messages and in supported third-party apps as stickers or Tapback reactions.[14][15]
Siri overhaul
Siri, Apple's virtual assistant, has been updated with enhanced capabilities made possible by Apple Intelligence. The latest iteration features an updated user interface, improved natural language processing, and the option to interact via text by double tapping the home bar without enabling the feature in the Accessibility menu. In addition, Apple Intelligence adds the ability for Siri to use personal context from device activities to make conversations feel more natural and fluid.[9]
Apple Intelligence adds a feature called Priority Messages to the Mail app, which shows urgent emails such as same-day invitations or boarding passes, with AI generated summaries of the email.[9]
Photos
Apple's Photos app includes a feature to create custom memory movies and enhanced search capabilities. Users can describe a story, and using Apple Intelligence, selects matching photos and videos. It organizes these into a movie with a narrative arc based on identified themes. Additionally, users can search for specific photos or videos by description and/or keyword, and Apple Intelligence can pinpoint particular moments within video clips.[16]
ChatGPT integration
As a result of the company's partnership with OpenAI, Apple Intelligence also includes a system-wide integration with ChatGPT, allowing Siri to determine when to send certain complex user requests to ChatGPT. This system-wide integration is powered by GPT-4o.[9] ChatGPT integration is opt-in by default, with users being prompted before any data or photos are sent to ChatGPT servers and IP addresses being obscured when requests are sent to OpenAI's servers.[17] Using ChatGPT features is free for all users without needing to sign in, however paid subscribers can sign in to gain access to paid features systemwide. Apple plans to integrate other models such as Google's Gemini into the system in the future.[18]
Development
Background
Apple first implemented artificial intelligence features in its products with the release of Siri in the iPhone 4S in 2011.[19] In the years after its release, Apple engaged in efforts to ensure its artificial intelligence operations remained covert; according to University of California, Berkeley professor Trevor Darrell, the company's secrecy deterred graduate students.[20] The company started expanding its artificial intelligence team in 2015,[21] opening up its operations by publishing more scientific papers and joining AI industry research groups.[22] Apple reportedly acquired more AI companies from 2016 to 2020.[23] In 2017, Apple released the iPhone 8 and the iPhone X with the A11 Bionic processor, which featured its first dedicated Neural Engine for accelerating common machine learning tasks.[24] Despite its investments in artificial intelligence, Siri was criticized both by reviewers[25] and internally at Apple[26] for lagging behind other AI assistants.
The rapid development of generative artificial intelligence and the release of ChatGPT in late 2022 reportedly blindsided Apple executives and forced the company to refocus its efforts on AI.[27][28] In an interview with Good Morning America, Apple CEO Tim Cook stated that generative AI had "great promise" but had some potential dangers, and that it was "looking closely" at ChatGPT. It was first reported in July 2023 that Apple was creating its own internal large language model, codenamed "Ajax".[27] In October 2023, Apple was reportedly on track to release generative AI features into its operating systems by 2024, including a significantly redeveloped Siri.[28] In an earnings call in February 2024, Cook stated that the company was spending a "tremendous amount of time and effort" into AI features that would be shared "later that year".[29]
Supported devices
All Macs and iPads with an M-series Apple silicon processor will support Apple Intelligence with the release of macOS Sequoia and iPadOS 18. iPhones with the latest A17 Pro chip or later will also be supported with the release of iOS 18.[30] Analyst Ming-Chi Kuo speculates that the RAM requirements of the on-device model prohibits Apple Intelligence from running on older iPhone models.[31]
Macs
- MacBook Air (M1, 2020) or later
- MacBook Pro (M1, 2020) or later
- Mac mini (M1, 2020) or later
- Mac Pro (M2 Ultra, 2023)
- Mac Studio (M1 Max/Ultra, 2022) or later
- iMac (M1, 2021) or later
iPads
- iPad Air (5th generation) or later
- iPad Pro (5th generation) or later
iPhones
See also
- Multimodal large language model – Type of artificial neural networkPages displaying short descriptions of redirect targets
References
- ^ "Apple's AI plans, iOS 18, and more at WWDC 2024". The Verge. June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 10, 2024.
- ^ "Apple Intelligence Preview". Apple. Archived from the original on June 13, 2024. Retrieved June 14, 2024.
- ^ Davis, Wes (June 16, 2024). "Apple won't wait until next year for some Siri improvements". The Verge. Vox Media. Archived from the original on June 17, 2024. Retrieved June 17, 2024.
- ^ "Introducing Apple's On-Device and Server Foundation Models". Apple Machine Learning Research. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
- ^ Lambert, Nathan (June 12, 2024). "AI for the rest of us". Interconnects. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
- ^ "Private Cloud Compute: A new frontier for AI privacy in the cloud". Apple Security Research. June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 11, 2024.
- ^ Chedraoui, Katelyn (June 11, 2024). "Did Apple Intelligence's 'Rewrite' Tool Just Kill Grammarly?". CNET. Archived from the original on June 12, 2024. Retrieved June 12, 2024.
- ^ Lovejoy, Ben (June 11, 2024). "Apple Intelligence: The features I can't wait to try". 9to5Mac. Archived from the original on June 12, 2024. Retrieved June 12, 2024.
- ^ a b c d "Introducing Apple Intelligence for iPhone, iPad, and Mac". Apple Newsroom. June 10, 2024. Archived from the original on June 15, 2024. Retrieved June 14, 2024.
- ^ Zivkovic, Marko (June 17, 2024). "How Apple plans to label AI-generated images made through its new Image Playground app". AppleInsider. Retrieved August 25, 2024.
- ^ Clover, Juli (August 23, 2024). "iOS 18 Notes App: All the New Features". MacRumors. Retrieved August 25, 2024.
- ^ Rutherford, Sam (June 10, 2024). "In case there weren't enough emoji already, Apple's Genmoji uses AI to generate even more". Engadget. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
- ^ Jones, D. Griffin (June 10, 2024). "Image Playground and Genmoji bring AI images to iMessage and more". Cult of Mac. Archived from the original on June 11, 2024. Retrieved June 24, 2024.
- ^ Murphy, Darragh (June 10, 2024). "WWDC 2024: Genmoji lets you create your own emojis with 'Apple Intelligence'". Mashable. Archived from the original on June 12, 2024. Retrieved June 24, 2024.
- ^ Joseph, Melwyn (June 11, 2024). "How to Use Genmoji - Steps Explained". Stealth Optional. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
- ^ Perez, Sarah (June 10, 2024). "Apple revamps its Photos app for iOS 18". TechCrunch. Retrieved June 12, 2024.
- ^ Edu, Jide (June 14, 2024). "Apple insists its ChatGPT tie-up will protect users' privacy: here are the questions it must answer first". The Conversation. Archived from the original on June 26, 2024. Retrieved June 26, 2024.
- ^ Perry, Alex (June 11, 2024). "Apple plans to work with Google's Gemini, other AI models". Mashable. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
- ^ Olson, Parmy. "Steve Jobs Leaves A Legacy In A.I. With Siri". Forbes. Archived from the original on November 28, 2023. Retrieved July 6, 2024.
- ^ Clark, Jack (October 29, 2015). "Apple's Deep Learning Curve". Bloomberg News. Archived from the original on May 26, 2023. Retrieved June 10, 2024.
- ^ Love, Julia (September 7, 2015). "Exclusive: Apple ups hiring, but faces obstacles to making phones smarter". Reuters. Archived from the original on November 19, 2015. Retrieved July 6, 2024.
- ^ "Apple Set to Join Amazon, Google, Facebook in AI Research Group". Bloomberg.com. January 26, 2017. Archived from the original on July 6, 2024. Retrieved July 6, 2024.
- ^ "Apple Bought the Most AI Companies From 2016 to 2020". MacRumors. March 25, 2021. Archived from the original on May 20, 2024. Retrieved July 6, 2024.
- ^ "The future is here: iPhone X". Apple Newsroom. Archived from the original on April 1, 2018. Retrieved July 6, 2024.
- ^ Vincent, James (October 4, 2021). "Hey Siri, what happened?". The Verge. Archived from the original on June 12, 2024. Retrieved July 6, 2024.
- ^ "Former Apple Employees Reflect on Siri's 'Squandered Lead' Over Amazon Alexa and Google Assistant". MacRumors. March 14, 2018. Archived from the original on February 23, 2024. Retrieved July 6, 2024.
- ^ a b "Apple Tests 'Apple GPT,' Develops Generative AI Tools to Catch OpenAI". Bloomberg.com. July 19, 2023. Archived from the original on July 6, 2024. Retrieved July 6, 2024.
- ^ a b "Apple Generative AI Features and Smarter Siri Could Launch Next Year". MacRumors. October 22, 2023. Archived from the original on June 14, 2024. Retrieved July 6, 2024.
- ^ "Apple Spending a 'Tremendous Amount of Time and Effort' on AI, Details Coming 'Later This Year'". MacRumors. February 1, 2024. Archived from the original on July 6, 2024. Retrieved July 6, 2024.
- ^ Nield, David (June 11, 2024). "Apple Intelligence: here's a full list of the iPhones, iPads and Macs that'll get Apple's new AI powers". TechRadar. Archived from the original on June 11, 2024. Retrieved June 15, 2024.
- ^ Kuo, Ming-Chi (June 11, 2024). "How Apple defines on-device AI and future trends — from the perspective of analyzing supported models of Apple Intelligence". Medium. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
External links
- Official website
- Apple Developer page