Nvidia recently showcased its Omniverse digital twin technology through the innovative Apple Vision Pro headset. The company's engineers have successfully enabled the Omniverse Cloud application programming interface (API) to stream interactive industrial digital twins directly into the Vision Pro. During a demo, I experienced cloud-based imagery at a stunning resolution that surpassed typical app performance on the headset.
This application holds great potential for the Apple Vision Pro, which retails at $3,500. While this price may restrict consumer adoption, industrial and enterprise sectors are likely to leverage the headset for its cost-saving capabilities through digital twins.
“Omniverse Cloud is available on the Apple Vision Pro,” announced Nvidia CEO Jensen Huang during the Nvidia GTC 2024 keynote, earning enthusiastic applause.
The concept of a digital twin involves creating a virtual replica of a factory, allowing for realistic simulations and optimizations before actual construction begins. Once the physical factory is operational, the digital twin can be updated with real-time data from sensors, ensuring continuous improvements and substantial cost savings.
At Nvidia GTC, a new Omniverse Cloud API framework was unveiled, allowing developers to seamlessly send their Universal Scene Description (OpenUSD) industrial scenes from content creation tools to Nvidia's Graphics Delivery Network (GDN). This global network of data centers provides the necessary bandwidth to stream high-quality 3D experiences to devices like the Apple Vision Pro.
Live Demo
I witnessed a remarkable demo where an interactive, physically accurate digital twin of a car was streamed to the Vision Pro. This experience included around 100 billion triangles rendered in real-time using ray tracing and global illumination, effectively turning the headset into a window to an animated, expansive 3D world.
Powered by CGI studio Katana on the Omniverse platform, I was able to customize the car’s paint and trim and even explore the vehicle's interior. The use of spatial computing allowed me to manipulate the car model easily, adjusting its size, all while maintaining impressive visual quality.
Typically, Apple Vision Pro's visual capabilities are limited due to its 8GB or 16GB memory. However, cloud streaming allows Nvidia to deliver imagery on-demand, significantly enhancing the visual experience. Rev Lebaredian, Nvidia's vice president of simulation, explained that the rendering happens in the cloud, utilizing technology far beyond what the device alone can support.
Engineers and designers can now work within this virtual environment to iterate more efficiently, gaining a realistic understanding of their simulations. I was able to alter lighting conditions and observe real-time changes in the environment, further immersing myself in this virtual space.
Inside a Wistron Factory
Nvidia also showcased a digital twin of a Wistron server factory in Taiwan, illustrating how a supercomputer could be moved within the facility. The visual fidelity was impressive, with realistic reflections and shadows, while the pinch-to-zoom feature allowed for closer inspection of intricate details.
Lebaredian noted that this technology facilitates pre-construction planning, helping manufacturers optimize equipment layout and reduce inefficiencies.
With cloud capabilities enabling access to vast amounts of data, the demo exemplified a significant leap in rendering power—around 50 teraflops per eye compared to the Vision Pro's more limited processing abilities.
Transforming Spatial Computing
The Omniverse Cloud enhances digital twin visualizations on the Apple Vision Pro. Spatial computing is set to revolutionize industrial enterprise interactions through high-resolution displays and efficient data processing, enabling immersive experiences.
This innovative workflow combines the Vision Pro’s advanced displays with Nvidia’s RTX cloud rendering to deliver seamless, high-fidelity experiences. Mike Rockwell, Apple’s vice president of the Vision Products Group, emphasized the potential for this combination to transform designer and developer interactions with digital content.
Lebaredian remarked on the untethered nature of the Vision Pro as a game-changer for enterprise customers, enabling them to utilize powerful tools in their workflows.
The introduction of hybrid rendering allows users to achieve fully interactive experiences using Apple’s native SwiftUI alongside the Omniverse RTX Renderer, streamed from GDN.
With Nvidia GDN's global infrastructure, users can access visually stunning, interactive content regardless of data complexity. This workflow holds promise across various applications, enabling designers to interact with 3D data without compromising quality.
The advancements in this technology pave the way for exciting new opportunities in e-commerce, factory planning, and beyond, ensuring that users interact with accurate and high-quality simulations.
Ranking
