NVIDIA Debuts AI-Enhanced Real-Time Ray Tracing with New DLSS 3.5
NVIDIA announced DLSS 3.5, the latest version of its game-changing AI neural network that is continuously improving. NVIDIA DLSS 3.5 introduces a new feature called Ray Reconstruction, which enhances ray traced image quality for all GeForce RTX GPUs by replacing hand-tuned denoisers with an NVIDIA supercomputer-trained AI network that generates higher-quality pixels in between sampled rays. DLSS 3.5 includes Ray Reconstruction, Super Resolution, Deep Learning Anti-Aliasing and Frame Generation. The result improves lighting effects like reflections, global illumination, and shadows to create a more immersive, realistic gaming experience.
Denoising is used in ray-traced computer graphics to fill in missing pixels to more efficiently composite a final image. NVIDIA DLSS 3.5 is trained on 5x more training data than DLSS 3, so it can recognize different ray-traced effects and make smarter decisions about when to use temporal and spatial data.
NVIDIA announced that support from game developers, including:
- Alan Wake 2 Launches October 27th With DLSS 3.5, Full Ray Tracing & Reflex
- Cyberpunk 2077 & Cyberpunk 2077: Phantom Liberty Available This September With DLSS 3.5, Full Ray Tracing & Reflex
- Portal with RTX Upgrades To DLSS 3.5 This Fall
- DLSS 3.5 is also coming to GeForce NOW when Alan Wake 2, Cyberpunk 2077: Phantom Liberty launch day-and-date in the cloud. Members can also stream the DLSS 3.5 update for Portal with RTX from the cloud.
In addition to games, DLSS 3.5 also improves image quality in real-time 3D creator applications. Ray Reconstruction will be included in upcoming releases of D5 Render, Chaos Vantage and NVIDIA Omniverse.
DLSS 3.5 is being demonstrated in NVIDIA’s booth (Hall 2.1 Booth A10) at Gamescom 2023, taking place in Cologne, Germany August 23rd to 27th.
“Fully ray traced lighting in real-time was a significant milestone on our journey to photorealistic graphics in games, and we met those goals with Cyberpunk 2077’s RT Overdrive Mode, Minecraft with RTX, and Portal with RTX. With the addition of Ray Reconstruction in NVIDIA DLSS 3.5, developers are aided by AI to enhance the worlds they create by increasing image quality further than previously thought possible,” said NVIDIA VP of Marketing Matt Wuebbling.
"Thanks to DLSS 3.5’s smart technology, fuelled by AI rendering power, you can experience Cyberpunk 2077: Phantom Liberty’s newest location Dogtown at its very best — with sharper images, more accurate lighting, and the highest frame rates possible," commented CD PROJEKT RED VP of Art, Global Art Director Jakub Knapik.
“The new Ray Reconstruction feature in DLSS 3.5 renders our fully ray-traced world more beautifully than ever before, bringing you deeper into the story of Alan Wake 2,” added Remedy Entertainment Lead Graphics Programmer Tatu Aalto.
“The integration of DLSS Ray Reconstruction with D5 Render marks our third technical collaboration with NVIDIA, following DLSS SR and FG, which further enhances the image quality of D5 Render's real-time rendering capabilities. We look forward to exploring more possibilities with NVIDIA in the future,” said D5 Render VP/Head of Marketing Jessie Huang.
Call of Duty: Modern Warfare III, PAYDAY 3, and Fortnite Among Fall Blockbusters Getting DLSS and/or Reflex Upgrades
DLSS and Reflex will be coming to this Fall’s biggest titles including:
- Alan Wake 2 launching with Reflex, in addition to DLSS 3.5 and full ray tracing
- Call of Duty: Modern Warfare III launching With DLSS 3 & Reflex
- Cyberpunk 2077: Phantom Liberty launching with Reflex, in addition to DLSS 3.5 and full ray tracing
- Fortnite Upgrades To DLSS 3 This Fall
- PAYDAY 3 Launching September 21st With DLSS 3 & Reflex
Half-Life 2 RTX: An RTX Remix Project Announced
At Gamescom NVIDIA announced Half-Life 2 RTX: An RTX Remix Project: The Half-Life 2 community has started developing a RTX Remix remaster for Half-Life 2 using an early access version of RTX Remix’s creator toolkit.
Using RTX Remix, the modders are rebuilding materials with Physically Based Rendering (PBR) properties, adding extra geometric detail via Valve’s Hammer editor, and are leveraging NVIDIA technologies including full ray tracing, DLSS 3, Reflex, and RTX IO to deliver a fantastic experience for GeForce RTX gamers. Take a first look at the announce trailer for Half-Life 2 RTX: An RTX Remix Project.
No launch date has been announced. The community has just begun development of Half-Life 2 RTX: An RTX Remix Project. Four of the top Half-Life 2 Mod teams have banded together, and are looking to invite the entire mod community to join the effort to build Half-Life 2 RTX. We encourage mod artists to join Orbifold Studios and help create this incredible remaster.
NVIDIA ACE Adds Emotion To AI-Powered NPCs With NeMo SteerLM
NVIDIA ACE is a custom AI model foundry that aims to bring intelligence to non-playable characters (NPCs) through AI-powered natural language interactions. With ACE, generic NPCs can be turned into interactive characters capable of striking up a conversation, or giving local knowledge that leads to new quests.
At COMPUTEX 2023, NVIDIA showed our ACE Kairos demo, featuring Jin the ramen shop owner, rendered in Unreal Engine 5 with RTX ON. In the months since, NVIDIA’s team has continued to evolve ACE.
Our newest advancement is the inclusion of NVIDIA NeMo SteerLM, a new technique that enables developers to customize the personality of NPCs for more emotive, realistic and memorable interactions.
Most LLMs are designed to provide only ideal responses, free of personality or emotion, as you can see by interacting with chat bots. With the SteerLM technique, however, LLMs are trained to provide responses aligned with particular attributes, ranging from humor to creativity, to toxicity, all of which can be quickly configured through simple sliders.
GeForce NOW
With GeForce RTX 4080 SuperPODs fully rolled out throughout North America and Europe, Ultimate members have been enjoying access to powerful RTX 4080 gaming rigs in the cloud. It comes in time for the arrival of AAA titles in the cloud soon from Epic Games Publishing, CD Projekt Red, and Deep Silver – graphic intensive games best streamed at ultimate performance. Plus, the first Xbox Game Pass titles are arriving in the cloud this week!
Straight out of Gamescom
GeForce NOW is delivering AAA titles for members to stream from the cloud soon, including ‘Alan Wake 2’, ‘Cyberpunk 2077: Phantom Liberty’ expansion, ‘PAYDAY 3’ and Party Animals.
These games will be coming to the cloud on their respective launch dates:
- Alan Wake 2: Tuesday, Oct. 27
- Cyberpunk 2077: Phantom Liberty expansion: Tuesday, Sept. 26.
- PAYDAY 3: Thursday, Sept. 21.
Your Pass to the Cloud
Members will soon be able to stream more than ten supported Xbox PC Game Pass titles at GeForce RTX 4080 quality across devices of their choice.
The first Xbox Game Pass titles arrive in the cloud this week. Stream supported PC games from Xbox Game Studios and Bethesda, including Deathloop and Grounded starting August 24th.
Games from other top publishers with games on Xbox PC Game Pass are also available to stream, including Mount & Blade II: Bannerlord and No Man’s Sky.
More games from Xbox’s PC Game Pass library will be added to GeForce NOW on a regular basis.
Head to the cloud and stream new titles joining later this week, including DOOM 2016 from Bethesda.