Skip to content

#from-scratch

4 posts

Tags
  1. 005

    One body, two heads: training a HydraNet that draws boxes and masks, in the browser

    Emoji fruit as training data, and a small network with one shared trunk and two output heads, trained from scratch in your browser. It finds the fruit within ten seconds. Then we measure honestly what multi-task learning bought us and what it cost.

    Interactive#computer-vision#multi-task#from-scratch

    10 min
  2. 004

    Training a Transformer from scratch in the browser: watching attention grow

    No PyTorch and no libraries. A tiny autodiff engine and a Transformer of about fourteen thousand parameters, written in TypeScript. Press a button and it learns to reverse a string of digits within seconds.

    Interactive#llm#transformer#from-scratch

    8 min
  3. 002

    The fantastic journey of neural network evolution: 50 birds teach themselves Flappy Bird

    Nobody shows these birds how to fly. Give each one a brain of six weights, add survival of the fittest, and a few dozen generations later they glide through every pipe.

    Interactive#ai-agent#neuroevolution#from-scratch

    5 min
  4. 001

    A CNN from scratch: watching a convolutional network see, in your browser

    A handwritten-digit classifier written in plain TypeScript with no machine-learning library, then opened up so you can look at the output of every layer.

    Interactive#computer-vision#cnn#from-scratch

    7 min