Nvidia has launched innovative RTX technology designed to enhance AI assistants and digital humans on the latest GeForce RTX AI laptops.
A highlight of this unveiling is Project G-Assist, an RTX-powered AI assistant tech demo that provides context-aware assistance for PC games and applications. The demo debuted alongside ARK: Survival Ascended from Studio Wildcard.
During CEO Jensen Huang's keynote at Computex in Taiwan, Nvidia also introduced the first PC-based Nvidia NIM (Nvidia Inference Microservices) for the Nvidia ACE digital human platform.
These advancements stem from the Nvidia RTX AI Toolkit, a suite of tools and SDKs aimed at helping developers optimize and deploy large generative AI models on Windows PCs. This complements Nvidia’s robust RTX AI innovations, accelerating over 500 PC applications, games, and 200 OEM laptop designs. Nvidia's vision includes widespread AI adoption across data centers, edge computing, and home systems.
The newly announced RTX AI laptops from ASUS and MSI feature GeForce RTX 4070 GPUs and energy-efficient systems-on-a-chip with Windows 11 AI capabilities.
“Nvidia initiated the AI PC era back in 2018 with the release of RTX Tensor Core GPUs and DLSS technology,” stated Jason Paul, Nvidia's Vice President of Consumer AI. “With Project G-Assist and Nvidia ACE, we are unlocking the next generation of AI-powered experiences for over 100 million RTX AI PC users.”
Project G-Assist: A Game-Changing AI Assistant
AI assistants are poised to revolutionize gaming and app experiences, offering strategies, analyzing multiplayer replays, and aiding in complex workflows. Project G-Assist exemplifies this future.
PC games boast expansive worlds and complex mechanics, often challenging even the most dedicated gamers. Project G-Assist uses generative AI to deliver game knowledge directly to players. By taking voice or text inputs and contextual data from the game screen, it leverages AI vision models to enhance situational awareness. The result is tailored responses in text or speech form.
Collaborating with Studio Wildcard, Project G-Assist demonstrated its effectiveness in ARK: Survival Ascended, answering player queries about creatures, items, lore, and more, all while personalizing its guidance according to the player's gaming session. Moreover, it optimizes gaming systems for peak performance, offering insights on metrics, graphics settings, overclocking options, and power consumption management.
Nvidia ACE and Inference Microservices
Nvidia's ACE technology now brings digital human capabilities to RTX AI PCs through Nvidia NIM. This innovation simplifies deployment, slashing it from weeks to mere minutes. ACE NIMs enable high-quality inference locally on devices, facilitating natural language understanding, speech synthesis, and facial animation.
At Computex, Nvidia showcased ACE NIM's debut in the Covert Protocol tech demo, developed with Inworld AI, featuring NVIDIA Audio2Face™ and NVIDIA Riva automatic speech recognition capabilities.
Collaboration with Microsoft for GPU-Accelerated AI
Nvidia and Microsoft are partnering to enhance generative AI in Windows apps, providing developers with API access to GPU-accelerated small language models (SLMs). These models enable applications like content summarization, generation, and task automation, augmented by retrieval-augmented generation (RAG) capabilities tailored to specific domains.
Powered by Nvidia RTX GPUs and other hardware accelerators, these AI advancements promise fast, responsive experiences across the Windows ecosystem, with a developer preview set for release later this year.
Introducing the RTX AI Toolkit
To address the widespread use of open-source models primarily designed for data centers, Nvidia is launching the RTX AI Toolkit, a set of tools and SDKs for creating application-specific AI models on RTX PCs. Set for broader developer access in June, the toolkit allows customization using open-source QLoRa tools and optimization with Nvidia TensorRT, achieving performance increases of up to 4x compared to pretrained models.
The Nvidia AI Inference Manager (AIM) SDK simplifies AI integration across PCs and cloud services, preconfiguring necessary models and supporting various inference backends across different processors.
Software partners like Adobe, Blackmagic Design, and Topaz are incorporating components of the RTX AI Toolkit into their creative applications, significantly enhancing AI performance on RTX PCs.
AI in Content Creation and Modding
Nvidia is also infusing RTX AI acceleration into tools for creators, modders, and video enthusiasts. Following last year's introduction of RTX acceleration in the Automatic1111 Stable Diffusion interface, the popular ComfyUI will soon see improvements, offering a performance boost of up to 60% over its current version.
Nvidia RTX Remix, a modding platform for remastering classic DirectX 8 and 9 games with ray tracing, NVIDIA DLSS 3.5, and physically accurate materials, is also expanding. The RTX Remix Toolkit, launched open source earlier this year, has already engaged over 20,000 modders, resulting in more than 130 remastered projects.
Upcoming enhancements await as the RTX Remix Toolkit becomes fully open source, allowing even greater flexibility for modders to replace game assets and optimize scenes. Additionally, Nvidia will provide a REST API for integration with digital content creation tools and a specialized SDK for deploying the RTX Remix renderer across various applications.
Lastly, Nvidia RTX Video, an AI-driven super-resolution feature in major web browsers, is now available as an SDK for developers. This innovation will soon enable Blackmagic Design’s DaVinci Resolve and Wondershare Filmora to upscale video quality to 4K and convert standard dynamic range files into HDR. The free media player VLC will also incorporate RTX Video HDR, enhancing its existing super-resolution capabilities.
Ranking
