Google Unveils New AI-Driven Photo Editing and Image Generation Features

At the Made by Google 2024 event on Tuesday, the company unveiled its highly anticipated Pixel 9 series smartphones. These innovative devices come packed with a multitude of AI-powered features, with Gemini serving as the default assistant.

Among the exciting new additions are advanced photo editing tools, improved apps for organizing and searching through screenshots, and a cutting-edge AI studio for image generation.

Add Me feature: This unique function allows the photographer to step into group photos. By leveraging a blend of augmented reality and advanced machine learning models, the process involves swapping places with a group member after capturing the initial shot. The phone then assists the second person in resetting the image, while AI algorithms realign both frames to create a seamless composite featuring everyone in one optimal shot.

Magic Editor enhancements: Building on the success of the Magic Editor introduced with the Pixel 8 and 8 Pro, Google has added two exciting new features to this tool in the Pixel 9 series. The first is auto framing, which intelligently recomposes images to ensure people or objects are in focus. Users can enjoy various generated options to select their favorite composition. Additionally, this feature uses generative AI to expand the photo context. The second new feature allows users to specify the type of background they envision, with AI generating the desired scene to enrich the image.

New screenshot and Pixel Studio apps: The Pixel 9 series also introduces enhanced screenshot and Pixel Studio applications. The screenshot app not only stores captured images but also facilitates localized searches—helping users find specific information, like Wi-Fi credentials from a vacation stay. While Google Photos offers a search function for items like license plates or passport numbers, the new screenshot app operates locally for added privacy.

Complementing this is the new Pixel Studio app, designed for creating AI-generated images directly on the device. With a combination of on-device diffusion models and Google’s cloud capabilities, users can simply input any prompt to generate a custom image, with options to modify the style within the app. While Google indicated that the technology is not yet able to create human faces—likely due to previous accuracy issues with Gemini—specific limitations regarding the generation of potentially harmful images were not disclosed.

Overall, the Pixel 9 series not only enhances mobile photography but also integrates sophisticated AI capabilities that empower users to unleash their creativity.