Apple Intelligence updates in iOS 27, iPadOS 27 and macOS Golden Gate bring new AI-powered features called Clean Up, Expand and Spatial Reframing. All these features let you make changes to photos, such as expanding them, removing unwanted objects, and fully reframe the viewpoint and angle, after they have been captured.
Here’s our full guide that walks through each of the new features and how to use them. We will be going through the iPhone version of these features in this guide, but they work exactly the same on iPad and Mac. These features work on every Apple Intelligence compatible device, which includes iPhone 15 Pro or later, iPads with M1 chips or later, or iPad mini with A17 Pro, as well as all Apple Silicon powered Macs.
For our test subject, we will be used this picture of probably the coolest Tron-looking Cybertruck that you might have ever seen. This is a photo I took while on the road.
Clean Up
Clean Up is not exactly Apple’s first attempt at adding object removal. It was originally released with iOS 18.1. It was neither intelligent nor were the results good enough compared to other options such s Google Photos which were using generative AI to not only remove objects but even add new ones. It seemed like Apple was trying to hold back from adding AI tools that would really change what a photo is.
However, that has changed completely. The new Clean Up means that you can make amazing edits that can remove objects and people from your photos, while making it hard to tell if something was changed.
Extend
Extend is the second tool in Apple’s new AI toolkit for Photos. This tool basically uses generative fill to add more information to your Photo. It’s basically the same thing as what Photoshop does, except this is free and on-device.
You can select any photo, zoom out, and it’ll basically fill in what it thinks should be around the photo. Not only does it do a great job with scenery but it’s smart enough to even work on people. It adds clothes, or extends arms and legs correctly which makes it seem like magic.
Reframe
This is perhaps the best feature out of all. It is obviously out of the Vision Pro feature set where users could see Spatial photos. However, this works with all photos, whether they were taken with a 100 year old camera, or some other phone camera.
Reframe, as the name suggests, will basically let you change the angle, zoom in or out, and just change the view point of the photo. This does not work perfectly with all types of photos, but the result is more often amazing than not.
The tools are very simple to use even though the function they perform is very complex. Here is a comparison of the before and after result of the photo we used for the guide:
Apple has also improved Image Playground considerably and it enables not only creation of unique images with different styles and filters, but also generating additional objects in existing photos. We’ll cover that in another guide.