[TechSpot] Nvidia showcases an AI-rendered, interactive virtual world - Overclock.net - An Overclocking Community

Forum Jump: 

[TechSpot] Nvidia showcases an AI-rendered, interactive virtual world

Thread Tools
post #1 of 3 (permalink) Old 12-11-2018, 10:41 AM - Thread Starter
sudo apt install sl
WannaBeOCer is an unknown quantity at this point WannaBeOCer is an unknown quantity at this point
WannaBeOCer's Avatar
Join Date: Dec 2009
Posts: 3,808
[TechSpot] Nvidia showcases an AI-rendered, interactive virtual world

Source: https://www.techspot.com/news/77681-...ual-world.html

Using real-world video footage, Nvidia managed to train an AI model to create what appears to be a living, breathing city (or a part of a city), with remarkably realistic graphics.
Graphics aren't remarkable but a machine being able to create a virtual world from just footage is incredible.

(18 items)
Core i7 6700K 4.8Ghz @ 1.4v
Maximus VIII Formula
Radeon RX VEGA 64 @ 1750/1105Mhz with 1175Mv
G-Skill 32GB 3200Mhz
Hard Drive
Samsung 850 Evo 2TB Raid 0
Power Supply
EVGA SuperNova 1200w P2
EK Supremacy Full Copper Clean
EK-FC Radeon Vega
XSPC D5 Photon v2
Black Ice Gen 2 GTX360 x2
Thermaltake Core X5 Tempered Glass Edition
Operating System
Windows 10 Pro
Acer XF270HUA
Cherry MX Board 6.0
Logitech G600
Alugraphics GamerArt
Definitive Technology Incline
▲ hide details ▲
WannaBeOCer is online now  
Sponsored Links
post #2 of 3 (permalink) Old 12-11-2018, 12:06 PM
New to Overclock.net
PharmingInStyle Level 1
PharmingInStyle's Avatar
Join Date: Sep 2013
Location: California
Posts: 121
The Verge which is mentioned in the TechSpot article above says a single video card was used to show the demo, the Titan V. Not saying one card was used to create the demo city, just to "power the demo" quoted from their article below.


Last edited by PharmingInStyle; 12-11-2018 at 12:10 PM.
PharmingInStyle is offline  
post #3 of 3 (permalink) Old 12-11-2018, 12:39 PM
professional curmudgeon
looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about looniam has a spectacular aura about
looniam's Avatar
Join Date: Apr 2009
Location: on a lake that is erie
Posts: 9,013
that virge article is a lot more informative . .

Nvidia has created the first video game demo using AI-generated graphics

Nvidia’s system generates graphics using a few steps. First, researchers have to collect training data, which in this case was taken from open-source datasets used for autonomous driving research. This footage is then segmented, meaning each frame is broken into different categories: sky, cars, trees, road, buildings, and so on. A generative adversarial network is then trained on this segmented data to generate new versions of these objects.

Next, engineers created the basic topology of the virtual environment using a traditional game engine. In this case the system was Unreal Engine 4, a popular engine used for titles such as Fortnite, PUBG, Gears of War 4, and many others. Using this environment as a framework, deep learning algorithms then generate the graphics for each different category of item in real time, pasting them on to the game engine’s models.

“The structure of the world is being created traditionally,” explains Catanzaro, “the only thing the AI generates is the graphics.” He adds that the demo itself is basic, and was put together by a single engineer. “It’s proof-of-concept rather than a game that’s fun to play.”

To create this system Nvidia’s engineers had to work around a number of challenges, the biggest of which was object permanence. The problem is, if the deep learning algorithms are generating the graphics for the world at a rate of 25 frames per second, how do they keep objects looking the same? Catanzaro says this problem meant the initial results of the system were “painful to look at” as colors and textures “changed every frame.”

The solution was to give the system a short-term memory, so that it would compare each new frame with what’s gone before. It tries to predict things like motion within these images, and creates new frames that are consistent with what’s on screen. All this computation is expensive though, and so the game only runs at 25 frames per second.

"Name as many uses for a brick as you can in one minute." - interview at graphics-chip maker Nvidia for a campaign-manager job
Fermi: it's better to burn out than fade away.
Remember the golden rule of statistics: A personal sample size of one is a sufficient basis upon which to draw universal conclusions.
"The more you buy, the more you save." - Jensen Huang GTC 2018
loon 3.2
(18 items)
Asus P8Z77-V Pro
16Gb PNY ddr3 1866
Hard Drive
PNY 1311 240Gb
Hard Drive
1 TB Seagate
Hard Drive
3 TB WD Blue
Optical Drive
Power Supply
EVGA SuperNova 750 G2
EKWB P280 kit
EK-VGA supremacy
Stryker M [hammered and drilled]
Operating System
Win X
Ducky Zero [blues]
corsair M65
SB Recon3D
Klipsch ProMedia 2.1
▲ hide details ▲

looniam is offline  

Quick Reply

Register Now

In order to be able to post messages on the Overclock.net - An Overclocking Community forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.
User Name:
If you do not want to register, fill this field only and the name will be used as user name for your post.
Please enter a password for your user account. Note that passwords are case-sensitive.
Confirm Password:
Email Address
Please enter a valid email address for yourself.
Email Address:


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page

Forum Jump: 

Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off