Computex 2024: NVIDIA Unveils Exciting Project G-Assist and Other AI

Nvidia has been a forerunner in AI for years now, and at Computex, they announced a range of concepts, including Project G-Assist, that look to cement their place in the modern computing landscape. 

NVIDIA has been one of the biggest leaders in AI for years now. From the advancements in GPU tech to the server infrastructure that runs the backbone of many of the biggest AI chatbots the world now uses. Always looking to push the boundaries of what is possible on the PC, NVIDIA unveiled a series of groundbreaking advancements at Computex 2024 in Taipei. These announcements highlight the integration of advanced AI capabilities into the latest GeForce RTX PCs and AI Laptops to revolutionize both gaming and productivity.

To kick things off, NVIDIA announced technology that is sure to shake up the gaming landscape. Project G-Assist is an AI-powered assistant designed to enhance the gaming experience. The new and exciting technology aims to provide gamers with real-time, contextual assistance by leveraging advanced AI vision models. Similar to what Microsoft has teased with Copiolot on the Xbox, Project G-Assist will be able to offer tailored advice and strategies by analyzing the game screen and taking voice or text input from the player. 

Working with Studio Wildcare on their flagship title, ARK: Survival Ascended, the Assistant was able to answer questions about game mechanics, creatures, and lore, adding a personal touch to each player’s session. It showed what could be done to improve accessibility in the game, all using a vision model built to understand the worlds players experience. Even in its early stages, it looks like a major shift in the way players get advice while they play. 

Nvidia detailed how Project G-Assist is about more than just in-game tips; it can be used to improve the overall gaming experience. It also optimizes the player’s gaming system for peak performance. From adjusting graphics settings to safe overclocking and power management, the AI ensures that the gaming rig runs smoothly and efficiently.

Jason Paul, Vice-president of consumer AI at NVIDIA explained, “Since the release of RTX Tensor Core GPUs and DLSS technology in 2018, we’ve been leading the charge in AI PCs. With Project G-Assist and NVIDIA ACE, we’re set to unlock a new era of AI-powered experiences for millions of users worldwide.”

Even with this strong opening, NVIDIA did not stop there, announcing a number of other projects that look to be just as exciting.  Next on the agenda, NVIDIA announced the introduction of NVIDIA ACE NIMs (NVIDIA Inference Microservices) for Digital Humans. These microservices are designed to bring lifelike characters to PC games and applications by providing high-quality inference for natural language understanding, speech synthesis, and facial animation. The gaming debut of ACE NIMs in the Covert Protocol tech demo, developed with Inworld AI, showcased the impressive capabilities of NVIDIA’s Audio2Face and Riva automatic speech recognition running locally on devices.

Moving things on to devices average gamers actually will use in their day-to-day lives, the new GeForce RTX AI laptops from Asus and MSI, featuring up to GeForce RTX 4070 GPUs, are designed to deliver exceptional AI performance while remaining energy efficient and are designed for devices that average gamers will actually use on a daily basis. Equipped with Windows 11 AI PC capabilities, these laptops represent a significant leap forward in the AI PC landscape, giving users the power to handle advanced AI applications and gaming with ease.

The Computex 2024 announcements were more than just direct AI, and NVIDIA continued to expand its offerings for gamers. Beyond expanding the titles that support DLSS, NVIDIA’s RTX Remix platform continues to be a game changer. This modding platform allows enthusiasts to remaster classic DirectX 8 and DirectX 9 games with full ray tracing, NVIDIA DLSS 3.5, and physically accurate materials. NVIDIA detailed that since its launch, more than 20,000 modders have used RTX Remix, resulting in more than 130 RTX remasters currently in development. With the upcoming release of the open-source RTX Remix Toolkit, modders will have even more tools to enhance and reimagine classic games.

NVIDIA is also making strides in content creation. The integration of RTX AI acceleration into applications such as Adobe Photoshop, Blackmagic Design’s DaVinci Resolve, and Wondershare Filmora promises to dramatically accelerate workflows for creators, modders, and video enthusiasts. For example, RTX acceleration for the popular ComfyUI, used to create Stable Diffusion images, delivers up to a 60% performance improvement over previous versions.

Wrapping things up, in collaboration with Microsoft, NVIDIA is extending the capabilities of Windows native and web applications with GPU-accelerated small language models (SLMs) and retrieval-augmented generation (RAG) capabilities. These enhancements will enable developers to create more responsive and intelligent applications, with RTX GPUs providing the necessary acceleration for these advanced AI tasks.

NVIDIA’s announcements at Computex 2024 show the company’s commitment to gaming and AI, and even if you’re not all in on the technology, the projects the brand is working on are incredibly interesting. From game assistants and lifelike digital humans to powerful AI laptops and comprehensive developer tools, NVIDIA is setting the stage for a future where AI enhances every aspect of our digital lives. How much of these technologies will the average gamer or content creator actually use is hard to say, but one thing is sure: Computex 2024 is already filled with a lot of excitement and the show floor has not even opened. 

Make sure to stay up to date with Computex 2024 here.