7734128Aug 2024Recommends
What you're describing reminded me of this cool project: ▶ this video "Playing a Neural Network's version of GTA V: GAN Theft Auto"
in “Diffusion models are real-time game engines” · View on HN
Playing a Neural Network's version of GTA V: GAN Theft Auto
Playing a Neural Network's version of GTA V: GAN Theft Auto on HackerTube: recommended by 3 Hacker News commenters across 4 separate months, 2021–2025.
sentdex
Open on YouTubedemo · dated
Sentdex demonstrates GAN Theft Auto, a GameGAN-based neural network that recreates GTA V so the network itself is the playable environment. He shows the results and releases the code.
Why Hacker News recommends it
Cited as an early, striking demo of neural networks acting as game engines and world models.
- people recommended it
- 3
- separate months
- 4
- strong recommendations
- 0
- discussed on HN
- 2021–2025
“This YouTube video, to me, shows the promise of things to come.”
What HN commenters said
12 Hacker News comments link this video. Each one links back to its thread.
eruDec 2022Recommends
> You could directly encode the elements as understanded by the process used to generate them, rather than attempting to reconstitute things from a stream of bitmaps. You might like Gan Theft Auto: ▶ this video
in “Netflix: 30% bitrate saving using Film Grain Synthesis” · View on HN
ALittleLightApr 2022Recommends
This YouTube video, to me, shows the promise of things to come. AI generated game worlds. Language models to generate plots and dialog, transformers and GANs to create illustrations. Imagine a game, a truly open world sand box, Grand Theft Auto meets AI Dungeon - every NPC is a "real" person with unlimited dialog options, the buildings you drive by you could easily walk in and investigate, unlimited play space - you could type in more general instructions and ideas to the plot generator ("add in a vampire romance and murder mystery angle") on the fly. ▶ this video
in “DALL-E, the Metaverse, and Zero Marginal Content” · View on HN
ALittleLightAug 2021Recommends
This video really amazed me in terms of automated game development. My fantasies are something like this and GPT-3 plus a couple decades of progress. I think we'll get to genuinely open ended sand box games. ▶ this video
in “Where are the robotic bricklayers?” · View on HN
imtringuedNov 2025Cites it
>There's some progress in video generation which takes a short clip and extrapolates what happens next. That's a promising line of development. The key to "common sense" is being able to predict what happens next well enough to avoid big mistakes in the short term, a few seconds. How's that coming along? And what's the internal world model, assuming we even know? ▶ this video This has been a thing for a while. It's actually a funny way to demonstrate model based control by replacing the controller with a human.
in “Spatial intelligence is AI’s next frontier” · View on HN
spyderSep 2024Cites it
True, but also AI could be the reason why games would need more powerful GPUs in the future (but not yet). For example LLMs for NPC dialogs, or the wilder things like running the whole game inside a neural network, or running an AI style filter over the output of the regular game engines. [link] ▶ this video [link]
in “Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W” · View on HN
Show 6 more comments
KhoomeiKAug 2024Cites it
NVIDIA did something similar with GANs in 2020 [1], except users could actually play those games (unlike in this diffusion work which just plays back simulated video). Sentdex later adapted this to play GTA with a really cool demo [2]. [1] [link] [2] ▶ this video
in “Diffusion models are real-time game engines” · View on HN
SXXNov 2023Cites it
Actually it was already done by sentdex with GAN Theft Auto: ▶ this video To an extent... PS: Video is 2 years old, but still really impressive.
in “Stable Video Diffusion” · View on HN
eruDec 2022Cites it
I guess unless your codec handles water physics. Which is not quite as absurd as it sounds. Have a look at the reflections in ▶ this video
in “Netflix: 30% bitrate saving using Film Grain Synthesis” · View on HN
eruNov 2022Cites it
> I'm not going to be so stupid as to say 8 cores should be enough for anyone (while attached to a machine with 128) but you have to wonder if the stable diffusion style apps running on your desktop are going to be mainstream, or isolated to the few who choose to _need_ them as a hobby or a smaller part of the public that uses them for commercial success. AKA, I can utilize just about every core i'm given with parallel compiles, or rendering a 4K video, but I'm pretty sure i'm the only one in my immediate family that needs that. My wife in the past might have done some simulation work, but these days the heaviest thing she runs on her PC is office products. See GAN Theft Auto at ▶ this video Someone trained a neural network to convert controller input into video output that simulates the game Grand Theft Auto. If technology keeps improving, I expect many future games will be such 'dreams' of neural networks. You are right that running Word or Excel won't really benefit from more cores.
in “Chip design shifts as fundamental laws run out of steam” · View on HN
bentcornerJul 2021Cites it
GAN Theft Auto also had a similar dream-like quality, especially with anything involving collisions (cars and how "big" the road was). ▶ this video
in “The art of asking nicely” · View on HN
magic_quotesJun 2021Cites it
Have you seen the video? The author even goes as far as suggesting the technique might useful for (generating?) entire operating systems at ▶ this video . That's just wild.
in “GAN Theft Auto [video]” · View on HN
Topics & tags
LLMs & generative AIMachine learning & deep learningGame programming & enginesgangamegangta vworld modelsgenerative ai