Btw, for anyone interested, here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack. ▶ this video
in “Launch HN: Aquarium (YC S20) – Improve Your ML Dataset Quality” · View on HN
Building the Software 2 0 Stack (Andrej Karpathy) on HackerTube: recommended by 1 Hacker News commenter across 1 month, 2019–2022.
talk · intermediate · evergreen
Andrej Karpathy's Databricks talk on Software 2.0, the shift from human-written code to code produced by neural network training. It covers how developer work moves toward curating datasets, the advantages and challenges, and opportunities for new tooling.
HN uses it as the primary source for the 'Software 2.0' idea and recommends it as a quick talk on the next software stack.
“here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack.”
3 Hacker News comments link this video. Each one links back to its thread.
Btw, for anyone interested, here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack. ▶ this video
in “Launch HN: Aquarium (YC S20) – Improve Your ML Dataset Quality” · View on HN
Was there a dedicated HN submission for this topic? This is extremely fascinating to me. In what Andrej Karpathy calls "software 2.0"[1], leaking your model is equivalent to leaking the main IP of your company. Unlike source code where it loses value quickly out of context (e.g. twitch leaked their code yet that didn't spawn a bunch of twitch clones), models can be fine-tuned and transfer-learning-ed for many other purposes Since these models take millions of dollars to train, I see these sort of hacks becoming a thing! I wonder when companies will start adding "trap streets"[2] to prove that others are using their stolen models? [1] ▶ this video [2] [link]
in “/r/StableDiffusion – Mod here – My side of the story” · View on HN
Andrej Karpathy (who was one of the presenters today) actually made similar statements last year, about how the part of the software stack that is not neural networks is gradually shrinking: ▶ this video
in “Tesla Live Stream – Autonomy Day [video]” · View on HN