madVR - high quality video renderer (GPU assisted)

[Warner306]

How about this for a denoising filter in madVR?

NVIDIA's AI can fix bad photos by looking at other bad photos

Check out the video at the end. It is pretty impressive, but there is a little loss in sharpness.

It looks like that button in the movies that enhances security footage.

[nevcairiel]

Those AI algorithms from NVIDIA are all quite impressive, but way too slow for realtime video use. Its more like something for offline processing of really bad videos.

[Asmodian]

Also, in regards to CSI style effects - the AI is adding fake detail that looks correct based on many other photos, not pulling the details from the image itself. Very impressive for viewing bad photos or videos but not great for identifying someone or similar forensic applications.

[Warner306]

It could probably be taught to recognize faces. In the end, it might not be any better than manual adjustment, but in real-time. Even though it takes milliseconds to render one image, getting it to run every 16-40 ms for video would likely be impossible as nevcairiel said.

Another of example of how deep learning is coming for everyone's job. Silicon Valley is obsessed with it. They can diagnose cancer in an MRI scan in 10 seconds using current neural networks.

[zeus0r]

Originally Posted by Warner306

That's the image I would expect if your display didn't activate its tone mapping.

and what could be the reason for that? win7?

[MishNZ]

Originally Posted by mclingo

Hi, this is fairly normal behaviour i'm afraid, this is unlikely to change, I get similar issues, mine plays audio for a second with a black screen, then starts after about 2-3 seconds but then plays perfectly fine. You just need to find a way to live with it mate.

If this can't be resolved, then surely a option for "Wait X seconds after switching to exclusive mode before starting playback" is required?

[LigH]

@Warner306: madVR is a renderer. Its purpose is to display video ... conveniently, as much as processing power permits, but most of all: fast enough. Image restoration is not its purpose, only displaying. A video filter for AviSynth or VapourSynth might be the better workflow for neural network based restoration algorithms (similar to NNEDI3). Here it appears quite off-topic to me.

[Warner306]

Originally Posted by LigH

@Warner306: madVR is a renderer. Its purpose is to display video ... conveniently, as much as processing power permits, but most of all: fast enough. Image restoration is not its purpose, only displaying. A video filter for AviSynth or VapourSynth might be the better workflow for neural network based restoration algorithms (similar to NNEDI3). Here it appears quite off-topic to me.

Removing artifacts from video is relevant. They all have them. Neural networks are one way to do it. Neural networks can do a lot of things for video. It is up to your imagination, really.

[Warner306]

Originally Posted by zeus0r

and what could be the reason for that? win7?

No idea. Your display must be recognizing some of the metadata because it is switching to HDR mode. It doesn't make sense why it wouldn't tone map. It must not understand the language of the PC or have something to do with Windows 7. Or not all of the metadata is making it to the TV.

Check to see if the mastering display peak nits is shown in the OSD. Also, try another file to eliminate the source as the problem.

[LigH]

Originally Posted by Warner306

Removing artifacts from video is relevant.

Then it may be a case for the decoder, because different video formats may produce different kinds of artifacts and may profit from format dependent artifact filters.

So, maybe ask for an option in LAV Filters. But I still believe that a renderer is the wrong place.

[Asmodian]

We already have a neural networks based artifact removal feature in madVR today so the idea cannot be off topic. We also don't want to deep dive into something that could never be part of madVR.

RCA is part of NGU and very effective compared to old deblocking methods, even if it is not part of the decoder.

[nussman]

Originally Posted by LigH

Then it may be a case for the decoder, because different video formats may produce different kinds of artifacts and may profit from format dependent artifact filters.

So, maybe ask for an option in LAV Filters. But I still believe that a renderer is the wrong place.

No idea what you are talking about. For GPU processing the video renderer is the right place for sure and there are already filters to remove artifacts in madVR. So whats your point?

[veggav]

Back here to ask a few more things, since you guys have a huge patience with me

I use JRiver because it's the only player that can do UHD BD menus with MadVR but the latests version of JRiver still uses an old version of MadVR.
The new one has tons of goodies like denoising and some image processing that are a must.

I know what I'm going to ask is related to JRiver but if I go ask in their forums they will tell me the newer version of MadVR is not supported that's why I'm asking here.

When playing a full UHD disc the subtitles only show if the menu is showing or at least the timeline bar when you pause the movie.
When playing the M2TS file directly this doesn't happen and this problem didn't occour in the older MadVR version bundled with JRiver software.

Do you guys have any idea of something I could try here to solve the problem?


And an unrelated question, do I really have to use exclusive mode for HDR?
My monitor goes HDR mode and it seems fine in D11 Windowed (10Bits). So if it's not broken don't try to fix it? Or am I missing something?

[nevcairiel]

Originally Posted by veggav

When playing a full UHD disc the subtitles only show if the menu is showing or at least the timeline bar when you pause the movie.
When playing the M2TS file directly this doesn't happen and this problem didn't occour in the older MadVR version bundled with JRiver software.

Do you guys have any idea of something I could try here to solve the problem?

Its a bug in the newer madVR versions, thats why JRiver Media Center still uses the old one until a release is made available that fixes it. I made madshi aware of that bug and hopefully the next one has it fixed, although he has been busy for longer then I would have hoped.

I'm not aware of a work-around.

[veggav]

Originally Posted by nevcairiel

Its a bug in the newer madVR versions, thats why JRiver Media Center still uses the old one until a release is made available that fixes it. I made madshi aware of that bug and hopefully the next one has it fixed, although he has been busy for longer then I would have hoped.

I'm not aware of a work-around.

I guess I'll let UHD BD menus aside for now since I really enjoy MadVR features in the newer versions.

This must be a really small bug because M2TS works and when you pause the subtitles are rendered so I don't think this might be hard to fix.

When you spoke with Madashi, did he mentioned a reason why this happens?

[ryrynz]

Originally Posted by veggav

When you spoke with Madashi

*madshi

[veggav]

Originally Posted by ryrynz

*madshi

Oops.

Cellphone typo.

[Warner306]

Originally Posted by Asmodian

We already have a neural networks based artifact removal feature in madVR today so the idea cannot be off topic. We also don't want to deep dive into something that could never be part of madVR.

RCA is part of NGU and very effective compared to old deblocking methods, even if it is not part of the decoder.

Sorry, probably should have mentioned artifact removal is already in madVR and be done with it. Typing with a morning coffee and not always paying attention.

I thought it was interesting and somewhat relevant. Nuff said..

[LigH]

That was new for me too. My personal opinion is not always right, especially with missing background knowledge...

[Asmodian]

I appreciated the post and link, it is cool to see what might be possible for madVR with next gen hardware. I just wanted to point out that we also shouldn't go off on a tangent about it either. It is so easy to go off topic for pages in this thread.