Blog
Short notes on what I'm learning, building, or thinking about.
Featured
nanoGPT: from characters to a GPT-2 reproduction
A decoder-only Transformer built from scratch, with a causal attention visualizer, parameter map, and the path from the current 10.79M model to GPT-2 124M.
makemore: names, one character at a time
Four stages of character-level language modeling, from bigram counts to a hierarchical context network, with loss and gradient diagnostics.
Bare-metal data logger: firmware from the registers up
An embedded-firmware project in C: sample an I2C sensor, store CRC-protected records on SPI NOR flash, stream status over UART, and catch a flipped bit with a Python verification harness.
micrograd: backprop from scratch in ~100 lines
Building a scalar autograd engine and a tiny neural-net library by hand, with the computation graph, training curves, and a real make_moons classifier.
Serotonin and DMT: a two-atom difference
How a hydroxyl and two methyl groups on the same tryptamine backbone separate a neurotransmitter from a psychedelic, with molecular diagrams.
learning ml, laplace
17th November 2025
Going to start the 3Blue1Brown playlist on Laplace transforms and machine learning. I love the Maxwell distribution.
relationshippp
15th November 2025
Approaching 3y in timeline.
the start
08th July 2027
bhai kya kar rha tu yha?