Blog

Writing, notes, and technical references I keep coming back to.

Log-Likelihood From First Principles

April 13, 2026

Building log-likelihood from joint probability through likelihood, cross-entropy, softmax, and LLM training — plus numerical stability and why the same objective can drive overconfidence.