[OC3D] Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology for PlayStation 5 - Overclock.net - An Overclocking Community

Forum Jump: 

[OC3D] Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology for PlayStation 5

Reply
 
Thread Tools
post #1 of 72 (permalink) Old 07-29-2020, 02:47 PM - Thread Starter
sudo apt install sl
 
Join Date: Dec 2009
Posts: 7,038
Rep: 197 (Unique: 133)
[OC3D] Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology for PlayStation 5

Source: https://www.overclock3d.net/news/sof...laystation_5/1

Quote:
Reconstruction Technology
Sony has patented a machine learning algorithm which could deliver the console manufacturer higher fidelity visuals at a lower performance cost, using image reconstruction to provide similar results to Nvidia's DLSS tech.

The future of gaming will not be focused on pure resolution numbers. With techniques like Temporal upsampling, checkerboard rendering and DLSS 2.0, we already know that high-quality images can be produced with non-native pixel counts, and as reconstruction technologies continue to improve, native rendering will quickly become irrelevant.
Exciting, can't wait to see how well their AI runs.

Silent
(20 items)
CPU
Core i9 9900K... CoffeeTime! @ 5.1Ghz w/ 1.36v
Motherboard
Maximus VIII Formula
GPU
Titan RTX @ 2100Mhz/2075Mhz
RAM
TeamGroup Xtreem 32GB 3200Mhz CL15
Hard Drive
HP EX950 2TB
Hard Drive
Samsung 850 Evo 1TB
Hard Drive
Samsung 850 Evo 1TB
Power Supply
EVGA SuperNova 1200w P2
Cooling
EK Supremacy Full Copper Clean
Cooling
XSPC D5 Photon v2
Cooling
Black Ice Gen 2 GTX360 x2
Cooling
EK-Vector RTX RE Ti - Copper + Plexi
Case
Thermaltake Core X5 Tempered Glass Edition
Operating System
Solus Linux
Monitor
Acer XF270HUA
Keyboard
Cherry MX Board 6.0
Mouse
Logitech G600
Mouse
Alugraphics GamerArt
Audio
Definitive Technology Incline
Audio
SMSL M8A
▲ hide details ▲
WannaBeOCer is offline  
Sponsored Links
Advertisement
 
post #2 of 72 (permalink) Old 07-29-2020, 02:53 PM
Graphics Junkie
 
UltraMega's Avatar
 
Join Date: Feb 2017
Location: USA
Posts: 2,392
Rep: 61 (Unique: 54)
Interesting. If I understand correctly, the Xbox Series X has something at the hardware level to manage upscaling while the PS5 does not. It will be interesting to see their respective approaches, but I imagine both consoles will be running either at 4K or close enough to it most of the time that the differences will typically be negligible.

4K Rig
(7 items)
CPU
Intel 7700k @4.2ghz
GPU
Zotec 1080 Ti
RAM
16GB 3200mhz DDR4
Hard Drive
250GB nvme + 500GB SSD + 4TB HDD
Monitor
Samsung 4K 65 inch TV
Monitor
Pixio PX276 27inch 144Hz 1ms 1440p
Audio
Sound Blaster z
▲ hide details ▲
UltraMega is offline  
post #3 of 72 (permalink) Old 07-29-2020, 03:00 PM - Thread Starter
sudo apt install sl
 
Join Date: Dec 2009
Posts: 7,038
Rep: 197 (Unique: 133)
Quote: Originally Posted by UltraMega View Post
Interesting. If I understand correctly, the Xbox Series X has something at the hardware level to manage upscaling while the PS5 does not. It will be interesting to see their respective approaches, but I imagine both consoles will be running either at 4K or close enough to it most of the time that the differences will typically be negligible.
I'm aware a few TV manufacturers have their own AI engines for upscaling. I'm pretty sure Microsoft will use DirectML for upscaling. Some studios have been testing it since February.

https://www.tweaktown.com/news/70438...-time/amp.html

Silent
(20 items)
CPU
Core i9 9900K... CoffeeTime! @ 5.1Ghz w/ 1.36v
Motherboard
Maximus VIII Formula
GPU
Titan RTX @ 2100Mhz/2075Mhz
RAM
TeamGroup Xtreem 32GB 3200Mhz CL15
Hard Drive
HP EX950 2TB
Hard Drive
Samsung 850 Evo 1TB
Hard Drive
Samsung 850 Evo 1TB
Power Supply
EVGA SuperNova 1200w P2
Cooling
EK Supremacy Full Copper Clean
Cooling
XSPC D5 Photon v2
Cooling
Black Ice Gen 2 GTX360 x2
Cooling
EK-Vector RTX RE Ti - Copper + Plexi
Case
Thermaltake Core X5 Tempered Glass Edition
Operating System
Solus Linux
Monitor
Acer XF270HUA
Keyboard
Cherry MX Board 6.0
Mouse
Logitech G600
Mouse
Alugraphics GamerArt
Audio
Definitive Technology Incline
Audio
SMSL M8A
▲ hide details ▲
WannaBeOCer is offline  
Sponsored Links
Advertisement
 
post #4 of 72 (permalink) Old 07-29-2020, 03:24 PM
Overclocker
 
JackCY's Avatar
 
Join Date: Jun 2014
Posts: 11,145
Rep: 364 (Unique: 261)
Texture file upscaling has been out a while publicly as far as I know, adding fake detail to old game textures and packs of higher res textures being released by people for old games with these upscalers instead of spending a year to replace the textures manually. Aka run a script, come back hour later, new textures done.
I'm not aware of M$ being involved in that. Maybe they use something similar to Sony's and NV's NN processing.
JackCY is offline  
post #5 of 72 (permalink) Old 07-29-2020, 03:42 PM
Graphics Junkie
 
UltraMega's Avatar
 
Join Date: Feb 2017
Location: USA
Posts: 2,392
Rep: 61 (Unique: 54)
Quote: Originally Posted by JackCY View Post
Texture file upscaling has been out a while publicly as far as I know, adding fake detail to old game textures and packs of higher res textures being released by people for old games with these upscalers instead of spending a year to replace the textures manually. Aka run a script, come back hour later, new textures done.
I'm not aware of M$ being involved in that. Maybe they use something similar to Sony's and NV's NN processing.
This has nothing to do with texture upscaling, but with that said I played FFX with a texture upscaled mod and it looked pretty good. It would be cool to see more games get mods like that. Upscaling has becoming a more and more interesting topic recently.

4K Rig
(7 items)
CPU
Intel 7700k @4.2ghz
GPU
Zotec 1080 Ti
RAM
16GB 3200mhz DDR4
Hard Drive
250GB nvme + 500GB SSD + 4TB HDD
Monitor
Samsung 4K 65 inch TV
Monitor
Pixio PX276 27inch 144Hz 1ms 1440p
Audio
Sound Blaster z
▲ hide details ▲
UltraMega is offline  
post #6 of 72 (permalink) Old 07-29-2020, 03:50 PM - Thread Starter
sudo apt install sl
 
Join Date: Dec 2009
Posts: 7,038
Rep: 197 (Unique: 133)
Quote: Originally Posted by JackCY View Post
Texture file upscaling has been out a while publicly as far as I know, adding fake detail to old game textures and packs of higher res textures being released by people for old games with these upscalers instead of spending a year to replace the textures manually. Aka run a script, come back hour later, new textures done.
I'm not aware of M$ being involved in that. Maybe they use something similar to Sony's and NV's NN processing.
In the link I provided studios are using Microsoft's DirectML API to create their own NN to upscale their games for the Series X. AMD also uses DirectML for Media Filters and they were working on something similar to DLSS for games. The question is whether or not Microsoft will just create their own NN that they train and maintain so developers can just implement that AI into their games similiar to Nvidia's DLSS.

https://docs.microsoft.com/en-us/win...3d12/dml-intro

Silent
(20 items)
CPU
Core i9 9900K... CoffeeTime! @ 5.1Ghz w/ 1.36v
Motherboard
Maximus VIII Formula
GPU
Titan RTX @ 2100Mhz/2075Mhz
RAM
TeamGroup Xtreem 32GB 3200Mhz CL15
Hard Drive
HP EX950 2TB
Hard Drive
Samsung 850 Evo 1TB
Hard Drive
Samsung 850 Evo 1TB
Power Supply
EVGA SuperNova 1200w P2
Cooling
EK Supremacy Full Copper Clean
Cooling
XSPC D5 Photon v2
Cooling
Black Ice Gen 2 GTX360 x2
Cooling
EK-Vector RTX RE Ti - Copper + Plexi
Case
Thermaltake Core X5 Tempered Glass Edition
Operating System
Solus Linux
Monitor
Acer XF270HUA
Keyboard
Cherry MX Board 6.0
Mouse
Logitech G600
Mouse
Alugraphics GamerArt
Audio
Definitive Technology Incline
Audio
SMSL M8A
▲ hide details ▲

Last edited by WannaBeOCer; 07-29-2020 at 04:58 PM.
WannaBeOCer is offline  
post #7 of 72 (permalink) Old 07-29-2020, 04:41 PM
Graphics Junkie
 
UltraMega's Avatar
 
Join Date: Feb 2017
Location: USA
Posts: 2,392
Rep: 61 (Unique: 54)
Quote: Originally Posted by WannaBeOCer View Post
In the link I provided studios are using Microsoft's DirectML API to create their own NN to upscale their games for the Series X. AMD also uses DirectML for Media Filters and they were working on something similar to DLSS for games. The question is whether or not Microsoft will just create their own NN that they train and maintain so developers can just implement that AI into their games similiar to Nvidia's DLSS.

https://docs.microsoft.com/en-us/win...3d12/dml-intro
Oh whoops, I only skimmed it. That is pretty cool.

4K Rig
(7 items)
CPU
Intel 7700k @4.2ghz
GPU
Zotec 1080 Ti
RAM
16GB 3200mhz DDR4
Hard Drive
250GB nvme + 500GB SSD + 4TB HDD
Monitor
Samsung 4K 65 inch TV
Monitor
Pixio PX276 27inch 144Hz 1ms 1440p
Audio
Sound Blaster z
▲ hide details ▲
UltraMega is offline  
post #8 of 72 (permalink) Old 07-29-2020, 05:05 PM
New to Overclock.net
 
ILoveHighDPI's Avatar
 
Join Date: Oct 2011
Posts: 3,607
Rep: 139 (Unique: 89)
PS5 was the last (home) system where there was any question of AI Upscaling support.
As soon as consoles have their AI Upscale solution that pretty much cements the position of 4K as the new standard resolution for gaming. AI Upscaling also disincentivizes lower resolution displays since DLSS can become dramatically less effective at lower resolutions.

It's also the golden ticket to mainstream 8K gaming, given that the more pixels you have the better DLSS works, using a Native 4K render target for 8K output should look spectacular.

Last edited by ILoveHighDPI; 07-29-2020 at 05:10 PM.
ILoveHighDPI is offline  
post #9 of 72 (permalink) Old 07-29-2020, 05:17 PM
Overclocker
 
JackCY's Avatar
 
Join Date: Jun 2014
Posts: 11,145
Rep: 364 (Unique: 261)
Quote: Originally Posted by ILoveHighDPI View Post
PS5 was the last (home) system where there was any question of AI Upscaling support.
As soon as consoles have their AI Upscale solution that pretty much cements the position of 4K as the new standard resolution for gaming. AI Upscaling also disincentivizes lower resolution displays since DLSS can become dramatically less effective at lower resolutions.

It's also the golden ticket to mainstream 8K gaming, given that the more pixels you have the better DLSS works, using a Native 4K render target for 8K output should look spectacular.
As spectacular as 1080p upscaled to 2160p. Or 720p upscaled to 1440p.
JackCY is offline  
post #10 of 72 (permalink) Old 07-29-2020, 08:58 PM
Vermin Supreme 2020
 
skupples's Avatar
 
Join Date: Apr 2012
Location: Bradentucky
Posts: 25,555
Rep: 737 (Unique: 388)
Gaben saids Xbox is better, that's all that matters. close all the threads.

Add me on Steam, same name
R.I.P. Zawarudo, may you OC angels' wings in heaven.
If something appears too good to be true, it probably is.
skupples is online now  
Reply

Quick Reply
Message:
Options

Register Now

In order to be able to post messages on the Overclock.net - An Overclocking Community forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.
User Name:
If you do not want to register, fill this field only and the name will be used as user name for your post.
Password
Please enter a password for your user account. Note that passwords are case-sensitive.
Password:
Confirm Password:
Email Address
Please enter a valid email address for yourself.
Email Address:

Log-in



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page


Forum Jump: 

Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off