Microsoft DirectX embraces neural rendering for next-gen graphics

Alfonso Maruccia

Posts: 1,513   +441
Staff
Forward-looking: Microsoft first introduced DirectX alongside Windows 95 as an incentive to drive game developers to support the new GUI-based operating system. The company has never stopped improving the collection of application programming interfaces since 1994, and is currently working to integrate the latest AI technologies.

Microsoft recently announced what could be the next major development in the history of DirectX. The High-Level Shader Language (HLSL) team is currently working with major GPU and SoC manufacturers to bring support for neural rendering technology in the company's APIs for 3D graphics, which Microsoft described as a significant evolution in what's possible with real-time graphics.

Redmond defines neural rendering as a suite of techniques capable of leveraging artificial intelligence, machine learning algorithms, and models to evolve traditional graphics pipelines. Cooperative vectors are the core element of these new neural rendering methods, and they should soon become part of the DirectX API suite for cross-platform game development.

Cooperative vectors are useful for accelerating AI workloads for real-time rendering, which in turn will improve the performance of neural rendering techniques. Cooperative vectors optimize the matrix-vector operations that are usually required in large quantities for AI training, fine-tuning, and inferencing, Microsoft explained.

The new tech can also make AI tasks run during different stages of the shading process, so a smaller neural network can run in a pixel shader process without needing the entire GPU's computational power. Microsoft promises a seamless integration of neural graphics rendering in DirectX applications, with access to hardware-based AI accelerators on multiple platforms.

The HLSL team is working on cooperative vector support in DirectX with AMD, Intel, Nvidia, and Qualcomm, which should provide enough cross-platform compatibility for the new solution. The most significant results will likely come to Xbox and PC platforms first and foremost.

The HLSL technology is a proprietary shading language designed to improve shader adoption in the latest versions of the DirectX APIs.

Microsoft praised the cross-vendor support for cooperative vectors in the DirectX ecosystem. The company also said that the new neural rendering techniques will unlock the power of Tensor Cores with neural shading available in the recently introduced Nvidia Blackwell GeForce GPUs. Nvidia explained that neural rendering will leverage small neural networks to greatly improve gaming graphics, though you will likely need to purchase a GeForce RTX 50 GPU to access this next-gen tech.

Permalink to story:

 
Finally something that is put in the API and not just proprietary vendor locked technology.

Remains to be seen what it really amounts to.
"The HLSL technology is a proprietary shading language designed to improve shader adoption in the latest versions of the DirectX APIs."

"The company also said that the new neural rendering techniques will unlock the power of Tensor Cores with neural shading available in the recently introduced Nvidia Blackwell GeForce GPUs. Nvidia explained that neural rendering will leverage small neural networks to greatly improve gaming graphics, though you will likely need to purchase a GeForce RTX 50 GPU to access this next-gen tech."

I mean, from what a gather in the last two sentances, it's still proprietary, as the only GPU's that can apparently use this new technology are the latest Nvidia cards. Considering they've had Tensor cores since the 20 series, and the latest DLSS 4 upgrades seem to work fine on all older cards, I'm fairly confused how this opens up anything, other than locking people into using DirectX instead of Vulkan.
 
"The HLSL technology is a proprietary shading language designed to improve shader adoption in the latest versions of the DirectX APIs."

"The company also said that the new neural rendering techniques will unlock the power of Tensor Cores with neural shading available in the recently introduced Nvidia Blackwell GeForce GPUs. Nvidia explained that neural rendering will leverage small neural networks to greatly improve gaming graphics, though you will likely need to purchase a GeForce RTX 50 GPU to access this next-gen tech."

I mean, from what a gather in the last two sentances, it's still proprietary, as the only GPU's that can apparently use this new technology are the latest Nvidia cards. Considering they've had Tensor cores since the 20 series, and the latest DLSS 4 upgrades seem to work fine on all older cards, I'm fairly confused how this opens up anything, other than locking people into using DirectX instead of Vulkan.
Well it remains to be seen if this can be brought to existing hardware AI like those present in rdna3 or intel’s chips. But it’s on the table and everyone can participate.
 
"The HLSL technology is a proprietary shading language designed to improve shader adoption in the latest versions of the DirectX APIs."

"The company also said that the new neural rendering techniques will unlock the power of Tensor Cores with neural shading available in the recently introduced Nvidia Blackwell GeForce GPUs. Nvidia explained that neural rendering will leverage small neural networks to greatly improve gaming graphics, though you will likely need to purchase a GeForce RTX 50 GPU to access this next-gen tech."

I mean, from what a gather in the last two sentances, it's still proprietary, as the only GPU's that can apparently use this new technology are the latest Nvidia cards. Considering they've had Tensor cores since the 20 series, and the latest DLSS 4 upgrades seem to work fine on all older cards, I'm fairly confused how this opens up anything, other than locking people into using DirectX instead of Vulkan.
I noticed that too, and didn't know how to reconcile it with the article's statement "The HLSL team is working on cooperative vector support in DirectX with AMD, Intel, Nvidia, and Qualcomm". Maybe Nvidia got there first, or maybe the Blackwell quote was an example, vs. the only.
 
I noticed that too, and didn't know how to reconcile it with the article's statement "The HLSL team is working on cooperative vector support in DirectX with AMD, Intel, Nvidia, and Qualcomm". Maybe Nvidia got there first, or maybe the Blackwell quote was an example, vs. the only.
I just understood the last paragraph as the author’s own view. Seeing how amd and intel both have AI hardware in their current lineup
 
"The HLSL technology is a proprietary shading language designed to improve shader adoption in the latest versions of the DirectX APIs."

"The company also said that the new neural rendering techniques will unlock the power of Tensor Cores with neural shading available in the recently introduced Nvidia Blackwell GeForce GPUs. Nvidia explained that neural rendering will leverage small neural networks to greatly improve gaming graphics, though you will likely need to purchase a GeForce RTX 50 GPU to access this next-gen tech."

I mean, from what a gather in the last two sentances, it's still proprietary, as the only GPU's that can apparently use this new technology are the latest Nvidia cards. Considering they've had Tensor cores since the 20 series, and the latest DLSS 4 upgrades seem to work fine on all older cards, I'm fairly confused how this opens up anything, other than locking people into using DirectX instead of Vulkan.
High-Level Shader Language (HLSL) is proprietary (I.e., the property of) Microsoft. However, while not open source, MS allows -neh- encourages people to use it as part of DirectX. All major GPUs support DirectX (to somewhat varying degrees with the latest version). What the author is saying (poorly) in the last sentence is that MS believes the new APIs will work especially well on the latest Nvidia GPUs.
 
Imagine explaining this to someone in 1995: "Yeah, so the AI inside your graphics card will now optimize your explosions to look better in real-time by running its own mini neural network."

... meanwhile, they’re still trying to figure out why their Doom floppy isn’t loading.
 
"The HLSL technology is a proprietary shading language designed to improve shader adoption in the latest versions of the DirectX APIs."

"The company also said that the new neural rendering techniques will unlock the power of Tensor Cores with neural shading available in the recently introduced Nvidia Blackwell GeForce GPUs. Nvidia explained that neural rendering will leverage small neural networks to greatly improve gaming graphics, though you will likely need to purchase a GeForce RTX 50 GPU to access this next-gen tech."

I mean, from what a gather in the last two sentances, it's still proprietary, as the only GPU's that can apparently use this new technology are the latest Nvidia cards. Considering they've had Tensor cores since the 20 series, and the latest DLSS 4 upgrades seem to work fine on all older cards, I'm fairly confused how this opens up anything, other than locking people into using DirectX instead of Vulkan.
so u are telling me that a rtx 4090 will not support neural rendering but a rtx 5050 will?
 
so u are telling me that a rtx 4090 will not support neural rendering but a rtx 5050 will?
That’s what I took away from the article, I think it’s just written badly? Check all the comments responding to mine, I’m not the only one a little confused by it.
 
Back