How to use Clean Up in Photos with iOS 18.1


The new Clean Up tool comes to the Photos app



Apple’s new Clean Up tool is a great use of Apple Intelligence that can enhance your photos without excessive editing. Here’s how it works.

Clean Up is part of Apple Intelligence as, unlike with some repair tools, it uses generative AI. The AI analyzes the photo to do its best to fill in or remove the selected area.

We’ve been testing it out the past week or so, and have found it to be one of the most useful Apple Intelligence features so far.

Make your photos better with Clean Up

To use the Clean Up tool, open the Photos app and select an image you want to edit. At the bottom, you’ll see the new Clean Up tool icon shaped like an eraser.

The first time you launch the Clean Up tool it will need to download the AI model to your device. The Clean Up tool does everything on-device and doesn’t send anything to the servers.

This keeps everything private and secure though there could be tradeoffs compared to cloud computing in terms of quality with complex scenes.

Three iPhone screenshots showing the ability of the Clean Up tool to remove a pool noodle sitting on the beach

Clean Up tool does a good job removing objects, and can be further refined afterwords

Once selected, it will automatically analyze your photo for errant objects that it believes could be removed to improve the photo. They will highlight in a swirl of bright colors so they’re easy to see.

Tap any of those objects and the will quickly be removed. We tried this with cars, people, and any other objects so far.

Most of the time it did a great job. But, if we tried to remove too large of an object with a busy background it would get confused and muddled.

Apple’s on-device processing is way better than Google’s, but the cloud-based option is far more capable with the power of remote servers.

A screenshot of the Google Pixel 9 keynote where they've added a hot air balloon and a field of flowers to a photo

You can’t create fake scenes with hot air balloons and fields of flowers with Apple’s Clean Up AI tool

This also differs from Google’s approach to “reimagining” images and adding to an image. Apple wants to retain the original intent of the photo an make it better, instead of creating fictitious images.

Clean Up tips and tricks

While Apple provides several suggestions for removal, you aren’t limited to those. If you see something you want to remove, tap it and Photos will try to identify its edges.

Using a finger to circle another toy sitting on the beach to be removed by the Clean Up tool

Circle or tap objects to remove them with the Clean Up tool

It will flash in a colorful rainbow of light before being removed. Similarly, you can circle anything just by drawing your finger around it.

You can zoom in and out by pinching or pan around so you can be very granular and your removals. This is very helpful when trying to remove stuff like facial blemishes that are small and precise.

An iPhone screenshot showing the metadata of a photo that it was editing with Clean Up

To help identify AI editing, photos will be marked with appropriate metadata

After making any modifications with Clean Up, Apple will add this information to the metadata to help prevent misinformation on AI editing. It will read “Modified with Clean Up,” similar to images generated with Image Playground.

A screenshot of a photo with a child and his face blurred

You can blur faces too with the Clean Up tool by circling them

Lastly, if you need to obfuscate someone’s face, you can circle it. It will flash before pixelating it. Great for hiding strangers or someone’s kids before sharing them online.

Available soon

Clean Up, as well as other Apple Intelligence features, will arrive as part of iOS 18.1, likely this October. It will follow the launch of iOS 18 with hundreds of other new features and changes.

A screenshot of the impending iOS 18.1 software update

Clean Up arrives with iOS 18.1 later this year



Source link

Previous articleMicrosoft exec says AI tools should learn to ask for help to curb the spread of misinformation