Snap Integrates ChatGPT into Augmented Reality at Lens Fest, Highlighting AI Innovations

Snap is integrating ChatGPT into its augmented reality (AR) Lenses, underscoring the growing role of AI in consumer technology.

In partnership with OpenAI, Snap has developed the ChatGPT Remote API, enabling Lens creators to leverage ChatGPT's capabilities within their projects. This collaboration enhances the potential for interactive learning, conversation, and creative experiences for Snapchat users. Additionally, a 3D face mask generator has been integrated, allowing for quick creation of expressive Lenses. This blend of generative AI and advanced face mesh technology enables rapid development of potentially viral Lenses in just seconds.

At the Lens Fest 2023 event, Snap introduced Lens Studio 5.0 beta, aimed at enhancing AR development. With over 330,000 developers in the Snap ecosystem and more than 3.5 million Lenses sold, Snapchatters have engaged with these Lenses over three trillion times in the last year.

Snap's mission is to empower the AR community with cutting-edge tools for creating the next generation of AR experiences. This mission is exemplified by the overhaul of Lens Studio, the software that drives Lens creation.

Lens Studio 5.0 Beta emphasizes performance improvements, loading projects 18 times faster and streamlining the development process for AR creators. The new version fosters collaboration by incorporating version control tools like Git, allowing multiple developers to work on projects simultaneously.

In addition to these innovative tools, Snap is committed to supporting developers in building their businesses within the platform. The introduction of Lenses with Digital Goods last year enables developers to implement revenue models within their Lenses. Now available to all developers, Digital Goods allow for exclusive AR features that Snapchatters can unlock for a fee. A new section in Lens Explorer will actively promote these Lenses, making them easily discoverable for users.

Jeetesh Singh, a member of the Snap Lens Network, remarked, “The Lens Studio 5.0 Beta is incredibly user-friendly. Its lightning-fast start-up speed allows developers to manage multiple projects simultaneously for improved workflows. The new Generative AI features simplify asset development within Lens Studio itself, enhancing the AR creation process and unlocking limitless creativity.”

Snap is also excited about the momentum gained from the Lens Creator Rewards program launched this summer, which rewards top-performing Lenses with monthly prizes up to $7,200. In its first month, over 45,000 Lenses participated, generating more than 5 billion interactions from Snapchat users.

Inna Sparrow, another member of the Snap Lens Network, stated, “The Lens Studio 5.0 Beta represents a significant advancement in AR development. Its intuitive new tools provide unlimited possibilities while being remarkably easy for AR developers to utilize. The Generative AI features streamline the creation process into a cohesive workflow within Lens Studio, reducing reliance on external tools.”