Apple has introduced new Apple Intelligence features with the release of iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2. These features include an image playground, Genmoji, enhancements to writing tools, and integration with ChatGPT.
Additionally, Apple has expanded language support for Apple Intelligence to include localized English in Australia, Canada, Ireland, New Zealand, South Africa, and the U.K. Previously, the AI suite of features was only available in U.S. English.
One of the most anticipated AI features is the integration of ChatGPT. With this update, Siri can now offer the option to ask ChatGPT certain questions that it cannot answer itself. While Apple Intelligence-powered writing tools do not generate text for you, the new “compose” option allows users to call on ChatGPT to create text based on a given prompt.
Apple had previously introduced writing tools with iOS 18.1, which were limited to rewriting a block of text in a friendly, professional, or concise style, or simply tapping the rewrite button without any additional input. With the release of iOS 18.2, users can now describe the specific changes they want to Apple Intelligence, allowing for more customized editing.
Users have the option to control the integration of ChatGPT. By default, there is no need to sign in to a ChatGPT account to use the feature, and OpenAI will not store any requests. However, users can log in to their OpenAI account to access higher-quality models.
The new image playground feature enables users to create images in various styles through a dedicated app. Additionally, users can take someone’s picture and create an AI-powered remix by describing different scenarios and settings. Image styles can be chosen from options such as animation or illustration. Apple is integrating Image Playground into apps like Messages and will also provide an API for third-party developers.
Similar to the Image Playground feature, Apple will assist you in creating a new emoji when you describe one that doesn’t currently exist while using the emoji keyboard. When the option to create a new emoji is available, your description will be highlighted. Additionally, you can use images from your photo library to create custom Genmoji.
In addition, Apple is introducing visual intelligence for the iPhone 16, 16 Pro, and 16 Pro Max. This feature allows you to search or ask ChatGPT about objects in your camera’s frame by long-pressing and holding the Camera Control button (similar to the demo where a person pointed at a dog). The camera can also be pointed at text to save a phone number (a feature already available through Live Text) or to translate between languages.
The Notes app is also receiving an upgrade with the new Image Wand tool. This tool transforms your rough sketches into illustrative images. By circling a sketch in your note, the tool will automatically convert it into a polished image.
Apple’s future plan for AI includes providing developers with access to its Apple Intelligence-related APIs, allowing them to integrate these capabilities into their own apps. The company announced that in the coming months, Siri will become more adept at understanding users, offering contextual suggestions, and gaining onscreen awareness.