Google Photos Launches AI-Enhanced Magic Editor Feature with Pixel 8 and 8 Pro Smartphones

Google is integrating generative AI into its widely-used Google Photos app with the launch of the Pixel 8 and Pixel 8 Pro smartphones. First unveiled at the company’s I/O developer conference in May, this feature enhances users’ editing capabilities, enabling them to fill gaps in images, reposition subjects, and make intricate adjustments to both the foreground and background.

During the I/O event, Google showcased how Magic Editor effortlessly combines multiple editing tasks. For instance, it demonstrated altering an image of a person in front of a waterfall by eliminating extra individuals from the background and removing a bag strap from the subject’s shoulder for a cleaner appearance. The AI feature adeptly "cut out" the subject, allowing for a more favorable position in the final image.

Previously, Google Photos users relied on separate tools such as Google’s Magic Eraser or advanced software like Photoshop to achieve similar results, often requiring more manual intervention.

In another demonstration, Google highlighted how users can reposition a subject, while AI fills in empty spaces in the photo. For example, by dragging a boy with balloons sitting on a bench closer to the center, AI seamlessly added the remaining parts of the bench and enhanced the city background, even populating the sky with fluffy white clouds for an improved aesthetic.

Behind the scenes, Google Photos uses generative AI to facilitate these intricate edits, allowing for subject resizing and repositioning with simple user interactions. By tapping on an object, users can drag it to their desired location or pinch to resize. Contextual suggestions further enable users to adjust the lighting and background of their photos. Additionally, Magic Editor will provide multiple output options, so users can choose their favorite result.

As demonstrated, the new feature is impressive, but it is about to be tested by consumers in real-world scenarios. Google acknowledges that Magic Editor is still in its Labs program and "early stages," stating, "there will be times when the result isn’t exactly what you imagined." However, as the technology evolves and user feedback is gathered, Google anticipates improved outcomes over time.

Given the scale of testing, with Google Photos users editing an astounding 1.7 billion photos each month, even a fraction of those edits on the new Pixel devices will yield significant data for refinement.

Magic Editor is just one of several AI-driven photo-editing capabilities introduced with the Pixel 8 and 8 Pro. Additional features include Best Take, which combines multiple images into one ideal shot; a futuristic AI-enhanced Zoom feature; and improvements to the existing Magic Eraser, now capable of removing larger distractions from photos. Google announced that features like Best Take, Magic Editor, and Audio Magic Eraser, which eliminates background noise, will be available on Pixel 8 devices starting October 12.