Bethesda says Nvidia's controversial new DLSS 5 AI filter "will all be under our artists' control, and totally optional for players"

https://lemmy.world/post/44358289

Bethesda says Nvidia's controversial new DLSS 5 AI filter "will all be under our artists' control, and totally optional for players" - Lemmy.World

Uh huh…

I think it’s a testament to DLSS 5 that people are calling it AI slop and can’t seem to recognize that the geometry/shape aren’t being modified, just lighting and material effects. Reminds me of this: www.youtube.com/watch?v=DKCyk3CeUFY

There is a lot of valid criticism of AI slop, there is even a lot of criticism about DLSS multi frame generation, but people who misuse the same term for everything just take away the meaning and credibility it and they had. For example, this technology wasn’t even trained on IP theft for a change!

DLSS is Magic, and This Proves It.

YouTube
I think that being a purist about terminology misses the point and substance of the complaints people have about this.

The point and substance of an argument are made with more precise and nuanced words, not by using less of them more poorly. There is no point and substance to deliberately trying to portray this as generative AI, which a lot of the comments are trying to do.

For example, you’ve said nothing and have absolutely not made the point and substance of your problem with DLSS 5 clear, while I actually have. Perhaps what you are actually referring to is the tendency for people to justify lying about a thing if they hate the thing associated with it enough. That’s just throwing sloppy shade to me.

Fine then. Make it clear how it is not approproate to label this generative AI. That’s the basis of your claim that everyone else is being sloppy. Back it up with more than just your own declaration.

Even here you’ve not backed up your beliefs or statements with anything beyond restating your original point.

To anyone just glancing at the promo before and after image, this appears to just be applying image generating AI toolchain tech to the preexisting frame generation. There is at least some amount of responsibility on nvidia for using an image that gives off this look.

Pretending that a reasonable conclusion that a large amount of people are drawing simply isn’t reasonable, and that it is for reasons entirely self-evident, is just masturbation.

I don’t think it’s possible to convince anyone with a closed mind, but sure.

This is doing the same thing as here: www.youtube.com/watch?v=DKCyk3CeUFY

It is not changing geometry.

It is changing lighting.

It is changing material properties.

There are no “image generating AI toolchain tech” involved. There is no image generation happening.

While wrong and being an asshole about it, thanks for at least making some effort of an explanation this time.

DLSS is Magic, and This Proves It.

YouTube

I’ve not been an asshole here, you’ve consistently talked down at everyone calling this slop due to some minor technicality in terminology that you’ve still failed to back up or expand on beyond linking to the same video a second time.

You also have really zeroed in on some claims that I’ve literally never heard anyone make:

It is not changing geometry. It is changing lighting. It is changing material properties.

No one has said shit about geometry, lighting, or materials because that is not the level at which DLSS operates. Both in previous versions and in this latest version.

It’s not what anyone thinks is going on here, and it calls into question your own understanding of all this that you’ve now insisted upon it twice. It’s not making lighting and materials changes. You’re confusing raytracing which is often turned on and off in graphics presets alongside DLSS because of the intense resource usage, but it is not part of DLSS. Go download a mod for finer grained graphics settings controls in Cyberpunk 2077 and that much will be made clear.

There are plenty of tools people can use to get an idea of how any games’ rendering pipline works, such as Special K as shouted out by the video you linked. Personally I like Reshade for getting a look at render passes, output targets, buffers etc.

DLSS operates on a completed “flat” render output/buffer. As far as I’m aware, It has no knowledge of geometry, materials, or shaders unless the devs are really doing wacky shit and have direct line to nvidia devs. Maybe they’re passing it the depth and normal buffers as well as the flat render output. That opens a lot of options (see marty’s RTGI shader) but is demonstrably still just working with slightly more than gets slapped on the screen as a flat raster image.

It can do edge detection as movement detection through comparing a number of the previous input frames using the types of techniques used in video compression to detect and handle movement, as the end of your video makes small mention of.

Usually it’s used on the output of the 3d render pipeline before the flat HUD elements are slapped on top. Apparently a lot of games the guy that made the video tested didn’t seperate out the HUD layer, or maybe it had something to do with his previous methodology. I’m not watching multiple of his videos to check, and I find it kind of hilarious that someone would think they were some voice of knowledge on how this stuff works if they put the kind of effort they indicated they had for their previous videos without using Special K.

I had already watched the video you linked. I’ve now watched it twice to ensure I didn’t miss anything.

It’s some guy playing with the features in Special K that allow you to utilize DLSS at arbitrary upscalong ratios while allowing HUD elements to render at the viewport resolution. It has nothing to do with the underlying tech or how DLSS works beyond showing that the defaults in most games could be better tuned.

He has a short bit talking about older anti-aliasing tech, then says that DLSS is an advancement without actually getting into how it works.

In all 18 minutes, there is hardly 60 seconds discussing the actual tech, and it literally uses the term generation.

So to be clear, since you seem to be highly mistaken about this: DLSS uses image generation technology along with some very fancy edge detection to attempt to fill in gaps and generate extra details that are not present in the original image.

It is not rendering only the needed sections at higher resolution or anything along those lines, but I can see how someone may think that was implied by your video.

So again, now that I hopefully have shown you that I do in fact know more than a decent bit about how DLSS works, and you still have not provided more to back up your point beyond a video of some guy fucking around with Special K and going “whoa cool”…

What part of DLSS generating image data that does not exist in a lower resolution source image and using it to fill in what would otherwise be repeated pixels in a traditionally upscaled (nearest neighbor, bilinear, trilinear, etc) image… how is that not generative?

Edit:

Would it kill you to not double the length of your goddamn comment after posting it?

I’ve got better things to do at this point than continue this, but at a glance I see that you took Nvidia’s news post’s wording as gospel.

Edit again:

It’s clear now, you got hung up on some misleading marketing wording in one of the headlines. You even admit it uses AI to generate additional image data. Stop being condescending.

Confirmation bias and closed mindedness it is.

My guy you literally linked some guy fucking around in Special K as supposedly an explanation of the tech, you misread a marketing headline as being technically descriptive, and yourself even admit that it uses AI to generate which is the common usage nowadays for the label.of slop.

I definitely appreciate being called close minded, an asshole, and compared to MAGA for not agreeing with your personal stick up your ass about what you think is proper terminology though.

Have a rotten day.

Please refrain from spreading misinformation and toxic trolling. We do not condone this kind of behaviour on our instance.
Is the NVIDIA release as the primary source the misinformation? I’ll be nicer and just suffer the downvotes for relying on primary sources.

From your own link

NVIDIA ACE is a suite of AI technologies—spanning models, developers tools, and on-device inference—that’s designed to help middleware and game developers build knowledgeable, actionable, and conversational in-game characters. The NVIDIA Nemotron Nano 9B V2 model is now available through NVIDIA ACE as an In-game Inferencing (IGI) SDK plugin. It simplifies the integration within your gaming pipeline and optimizes simultaneous AI inference and graphics processing for accelerated game performance

and on NVIDIA’s own DLSS 5 announcement page:

“Twenty-five years after NVIDIA invented the programmable shader, we are reinventing computer graphics once again,” said Jensen Huang, founder and CEO of NVIDIA. “DLSS 5 is the GPT moment for graphics — blending handcrafted rendering with generative AI to deliver a dramatic leap in visual realism while preserving the control artists need for creative expression.”

NVIDIA’s entire page is AI summaries and AI xyz tool, sdk, etc. Clearly they’re marketing this and are not hiding it.

Again, please take some time to reconsider before making condescending trollish posts. This kind of behavior is not tollerated on our instance.

Final warning. If you consider continuing to act in bad faith you will be banned.

NVIDIA DLSS 5 Delivers AI-Powered Breakthrough in Visual Fidelity for Games

NVIDIA today unveiled NVIDIA DLSS 5, the company’s most significant breakthrough in computer graphics since the debut of real-time ray tracing in 2018.

NVIDIA Newsroom
I stand corrected, I would not have referred to the process being described as generative AI, and neither did the sources I watched. Thank you for the clarification. I wasn’t acting in bad faith, which unfortunately means I will have to take greater care, as something that I did not intend to seems to be happening, and it is under a rather broad definition. I’ll lay off of the topic, and thank you for the rather direct rebuttal, I would like to think I would have accepted it had it been offered elsewhere in the thread.