Skip to content
HHackerTube.videoSurprise me

Autonomous Testing and the Future of Software Development - Will Wilson

Autonomous Testing and the Future of Software Development - Will Wilson on HackerTube: recommended by 1 Hacker News commenter across 4 separate months, 2019–2024.

The Linux Foundation

talk · advanced · evergreen

Open on YouTube

Will Wilson explains autonomous testing: using deterministic simulation and fuzzing, building on FoundationDB's approach, to test software continuously. It sets out the ideas behind his later company Antithesis.

Why Hacker News recommends it

HN recommends it as an excellent talk on generalizing deterministic simulation testing, and Antithesis hiring posts link it to explain the work.

people recommended it
1
separate months
4
strong recommendations
2
discussed on HN
2019–2024
“I would encourage you to listen to Will Wilson’s excellent talk on the subject of Autonomous Testing”
— georgelyon, Jul 2020, in “Against Testing”

What HN commenters said

17 Hacker News comments link this video. Each one links back to its thread.

georgelyonFeb 2024Strongly recommends

Congratulations to the Antithesis team! I actually interviewed with them when they were just starting, and outside of being very technically proficient, they are also a great group of folks. They flew my wife and I out to DC on what happened to be the coldest day of the year that year (we are from California) so we didn’t end up following through but I’d like to think there is an alternative me out there in the multiverse hacking away on this stuff. I highly recommend Will’s talks (which I believe he links in the blog post): [link] ▶ this video

in “Is something bugging you?” · View on HN

georgelyonJul 2020Strongly recommends

I very much agree with this sentiment, but it is difficult to endorse this line of reasoning without offering a better alternative. As folks have pointed out in other comments, there are other values to tests in the broad sense that the author doesn’t address. That said, if you are interested in improving the state of testing, I would encourage you to listen to Will Wilson’s excellent talk on the subject of Autonomous Testing: ▶ this video Indeed, FoundationDB (which Wilson worked on) has a very unique and sophisticated approach to testing that seems to have served them very well.

in “Against Testing” · View on HN

georgelyonMar 2024Recommends

Really unique product with a super-strong founding team! I’m not a working with them, but am cheering from the sidelines. One of the founders gives a great talk here: ▶ this video

in “Ask HN: Who is hiring? (March 2024)” · View on HN

georgelyonJul 2023Recommends

FoundationDB is a truly one-of-a-kind bit of technology. Others have already linked to the testing methodology that allows them to run orders of magnitude more database hours in test than have run in production: [link] A less known but also great talk is the follow which talked about what the a few of the team worked on next, effectively trying to generalize the methodology to any computer program: ▶ this video I liken the approach to being able to fuzz the execution space of the program, not just the inputs.

in “FoundationDB: A Distributed Key-Value Store” · View on HN

thecollinsOct 2024Cites it

Antithesis | Software Engineers (Kernel / Systems / Infra / Fullstack) | Northern VA | ONSITE | [link] Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. See Will's talk ( ▶ this video ) for the ideas that underpin our approach or read the Simulation Testing section of [link] . We have a growing base of customers and great community buy-in. Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Check out our blog for an examples of what we recently launched, e.g.: [link] Apply at [link] . We're also hiring for professional services roles. Feel free to ask about those, too.

in “Ask HN: Who is hiring? (October 2024)” · View on HN

thecollinsJul 2024Cites it

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | [link] Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (July 2024)” · View on HN

Show 11 more comments
thecollinsOct 2023Cites it

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | [link] Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We work together onsite in a highly collaborative environment. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. (But if you love Nix...we should talk.) What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (October 2023)” · View on HN

thecollinsMay 2023Cites it

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | [link] Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We work together onsite in a highly collaborative environment. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. (But if you love Nix...we should talk.) What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (May 2023)” · View on HN

thecollinsApr 2023Cites it

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | [link] Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (April 2023)” · View on HN

thecollinsMar 2023Cites it

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | [link] Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (March 2023)” · View on HN

thecollinsMay 2022Cites it

Antithesis | DC / Northern Virginia | onsite | [link] Antithesis is using deterministic simulation, fuzzing, and ML to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (May 2022)” · View on HN

thecollinsNov 2021Cites it

Antithesis | Senior Software Engineers | DC / Northern Virginia | ONSITE | FULL-TIME Antithesis is using deterministic simulation, fuzzing, and ML to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. Apply at [link] (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

in “Ask HN: Who is hiring? (November 2021)” · View on HN

thecollinsOct 2021Cites it

Antithesis | DC / Northern Virginia | Software Engineers | ONSITE | FULL-TIME Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. Apply at [link] (but don't worry too much about which role you choose). We're also hiring for professional services roles. Feel free to ask about those!

in “Ask HN: Who is hiring? (October 2021)” · View on HN

thecollinsAug 2021Cites it

Antithesis | DC / Northern Virginia | ONSITE | Software Engineers | FULL-TIME Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. If that sounds like you, send us a brief (one to two paragraph) explanation of an interesting technical challenge you've faced. Feel free to send a resume too. [email protected] We're also hiring for professional services roles. Feel free to ask about those!

in “Ask HN: Who is hiring? (August 2021)” · View on HN

thecollinsJul 2021Cites it

Antithesis | DC / Northern Virginia | Onsite | Software Engineers | FULL-TIME | $100k-$150k + equity Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of [link] . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. If that sounds like you, send us a brief (one to two paragraph) explanation of an interesting technical challenge you've faced. Feel free to send a resume too. [email protected] We're also hiring for professional services roles. Feel free to ask about those!

in “Ask HN: Who is hiring? (July 2021)” · View on HN

wwilsonAug 2019Cites it

Antithesis | DC / Northern Virginia | Onsite | Software Engineers | FULL-TIME | $100k-$150k + equity Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders are two FoundationDB veterans; for an idea of what we're doing, see my talk here: ▶ this video . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. If that sounds like you, send us a brief (one to two paragraph) explanation of an interesting technical challenge you've faced. Feel free to send a resume too. [email protected] We're also hiring for professional services roles and an operations manager. Feel free to ask about those!

in “Ask HN: Who is hiring? (August 2019)” · View on HN

chubotMar 2019Cites it

FWIW I think that DOES happen, but it happens on the "wrong" computers! Google has at least tens of thousands of cores running builds and tests 24/7. And they're utilized to the hilt. Travis and other continuous build services do essentially the same thing, although I don't know how many cores they have running. From a larger perspective, Github does significant things "in the background" to make me more productive, like producing statistics about all the projects and making them searchable. (Admittedly, it could do MUCH more.) I think part of the problem is that it's cheaper to use "the cloud" than to figure out how to use the developer's own machine! There is a lot of heterogeneity in developer machines, and all the system administration overhead isn't worth it. And there's also networking latency. So it's easiest to just use a homogeneous cloud like Google's data centers or AWS. There's also stuff like [link] which improves productivity. I do think that most software will be tested 24/7 by computers in the future. Foundation DB already does this: "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson [link] Autonomous Testing and the Future of Software Development - Will Wilson ▶ this video They have sort of an "adversarial" development model where the tests are "expected" to find bugs that programmers introduce. So it's basically like having an oracle you can consult for correctness, which is a productivity aid. Not exactly, but that would be the ideal.

in “Why isn’t CPU time more valuable?” · View on HN

Topics & tags

Testing, debugging & developer toolsDistributed systemsautonomous testingfoundationdbfuzzingantithesisdistributed systems