Skip to content
HHackerTube.videoSurprise me

Computer program that learns to play classic NES games

Computer program that learns to play classic NES games on HackerTube: recommended by 9 Hacker News commenters across 10 separate months, 2015–2025.

Tom7 explains and demos software that learns to play NES games by finding score patterns in memory and then searching for inputs that raise it. It is the video companion to his SIGBOVIK paper.

Why Hacker News recommends it

Loved on HN as a hilarious, brilliant example of hacker-academic work and cited whenever game-playing AI or fuzzing comes up.

people recommended it
9
separate months
10
strong recommendations
2
discussed on HN
2015–2025
“Watch the whole thing, it's delightful.”
— fartcannon, Feb 2021, in “Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves”

What HN commenters said

19 Hacker News comments link this video. Each one links back to its thread.

fartcannonFeb 2021Strongly recommends

There was an AI created the absolutely brilliant Tom7 on on his YouTube channel 'SuckerPinch' on April 1, 2013 that paused a game of Tetris instead of losing. In my opinion, Tom doesn't get enough credit for his work. He released his AI a full 8+ months before DeepMind released their Atari playing AI. Watch the whole thing, it's delightful. The AI pauses Tetris right before it loses at around 16mins into the video. ▶ this video I also recommend his other videos. Brilliant guy. Edit: Here's the paper [link]

in “Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves” · View on HN

learc83Feb 2018Strongly recommends

Thanks for pointing that out. I wouldn't have noticed who that was otherwise. His video on learnfun/playfun is both hilarious and amazing. ▶ this video

in “A C89 compiler that produces executables that are also valid ASCII text files [pdf]” · View on HN

rdlwFeb 2025Recommends

Not quite what you're describing, but no one has yet linked the classic Tom7 series where he applies deep learning to classic NES games: ▶ this video

in “AI-designed chips are so weird that 'humans cannot understand them'” · View on HN

dan_quixoteOct 2022Recommends

tom7 is awesome. He made an awesome and hilarious video years ago about his SIGBOVIK paper/research on AI playing NES: ▶ this video

in “MAR1D: First-Person Mario” · View on HN

onliJun 2018Recommends

I'm not sure many people can pull this off. The author here was also great in his presentation about automated NES playing, ▶ this video . You don't see often academics & hacker work that is also combined with the right amount of humor. He even 3Dified the original Zelda!

in “Reverse-emulating the NES” · View on HN

onliApr 2017Recommends

You should look at some other things the author did. They fit in the same area of craziness, and are absolutely great. For example [link] , Portmantout: A portmanteau of every English word, or the first one, ▶ this video , Computer program that learns to play classic NES games. I also liked the humor in What, if anything, is epsilon?, [link] .

in “The glEnd of Zelda(): Automatic 3Dification of NES Games (2016)” · View on HN

Show 13 more comments
d33Jun 2016Recommends

In the context of AI and gaming, I definitely recommend this series of three youtube videos: ▶ this video Some games are played better than human would.

in “Deep Reinforcement Learning: Pong from Pixels” · View on HN

tomjakubowskiMay 2016Recommends

If you're interested in a "dumber" approach to machines "learning" to play classic video games (including Super Mario Bros), tom7's video [1] and paper [2] on Playfun are both fascinating. [1] ▶ this video [2] [link]

in “Autonomous Mini Rally Car Teaches Itself to Powerslide” · View on HN

fixermarkApr 2016Recommends

Tom 7's work on machine learning and NES emulation is very impressive. This isn't the first time he's attacked that space; you can see previous experiences he had with an automatic game-playing AI he built called "LearnFun / PlayFun" on that YouTube channel also: ▶ this video [link] [link]

in “Automatic 3Dification of Nintendo Games: The GlEnd() of Zelda” · View on HN

reconditeMar 2015Recommends

Haha, I love it. There was a SIGBOVIK submission a couple years ago that looked at byte patterns within video game RAM (specifically NES) to automate the playing of. Pretty entertaining stuff. ▶ this video

in “SIGBOVIK 2015 Proceedings [pdf]” · View on HN

DweditAug 2025Cites it

Did anyone else get reminded of the Lexographic Ordering Solver that played NES games? This was featuring in Sigbovik 2013. [link] Video: ▶ this video

in “Optimizing our way through Metroid” · View on HN

MrPoushMay 2024Cites it

Tom7 implemented some of this with his Learnfun and Playfun ( ▶ this video ) - It looks for lexicographical changes to bytes in memory (i.e., one byte seems to almost always increase, and then when it suddenly decrements, a neighboring byte is incremented) as a way of calculating memory location for increasing values (score, x-position), and similarly detects bytes that generally seem to decrease (lives). It then tries to play the game, choosing inputs that increase the values that should be increasing (move right, gain lives), or tries not to decrease the values that are decreasing (don't die).

in “Reversing Choplifter” · View on HN

chc4Apr 2024Cites it

A lot of fuzzers use Mario or other simple games as an internal testcase. I'm aware of a hypervisor fuzzer from 2016 that did it, and I'm positive there are others (both before and since). Hell, tom7 has a fuzzer for exploring program states that uses Super Mario Bros as the example from 2013 ( [link] , plus a youtube video ▶ this video ), and he's definitely not the first either.

in “How Antithesis finds bugs” · View on HN

dpflanMar 2018Cites it

This reminds me of AI research using NES Games. The AI eventually became proficient at completing Mario levels, and along the way it discovered novel strategies for survival, obtaining points, and finishing levels. > Check out this timestamp to watch the machine "cheat": ▶ this video > Researcher's site about the project: [link] > The Paper: The First Level of Super Mario Bros. is Easy with Lexicographic Orderings and Time Travel...after that it gets a little tricky. : [link]

in “AI Cheats at Old Atari Games by Finding Unknown Bugs in the Code” · View on HN

djsumdogDec 2017Cites it

Here is an actual implementation of trying to implement a general AI to play all NES games. It's pretty interesting, but his approach does involve the algorithm having access to the raw NES memory map: ▶ this video

in “Classic Nintendo Games Are NP-Hard (2012)” · View on HN

shellbackgroundSep 2017Cites it

To reference: ▶ this video It's fun how program learning to play teris pauses the game just before loosing.

in “Is there a winning strategy in Tetris?” · View on HN

HoushalterJun 2017Cites it

Why not use game emulators? With popular NES emulators you can advance the game frame by frame. You can read the raw memory addresses that correspond to the score. You can dump the memory at any time and reload the game to a specific game state. You can even manipulate the games in many fun ways by messing around with the game memory. Or give an AI algorithm access to memory addresses as additional information, instead of relying on pure machine vision, if you want to do that.. Here's an example of a guy who made a general game playing algorithm that brute forces it's way through any NES game: ▶ this video This isn't necessarily interesting from an AI perspective - the playing algorithm is just brute force. But it shows what can be done with the platform, easily reloading to previous states and exploring counterfactual futures (which is exactly the sort of thing RL algorithms do.) He also has a cool algorithm for finding the objective function of an arbitrary game, by watching a human play, and seeing what memory addresses increment. Which is a lot more easy to use than writing OCR code to read the score and game over states from the screen.

in “Why I’m Remaking OpenAI Universe” · View on HN

KarunamonNov 2015Cites it

So as someone with only a lay understanding of what NP-Hard means - does anyone remember that neural network that someone trained to play the game[1]? So if you can train a neural network to solve an NP-Hard problem, does that mean by definition (since NP refers to a whole class of problems) that a neural network could eventually be trained to solve any given NPH problem given the time and compute resources to do so? [1]: ▶ this video

in “Classic Nintendo Games Are NP-Hard (2012)” · View on HN

keeperofdakeysAug 2025Joke

A bit out of context, but it reminded me of this funny moment. The only winning move is not to play. ▶ this video (Background: Someone training an algorithm to win NES games based on memory state)

in “We put a coding agent in a while loop” · View on HN

Topics & tags