formalStatistics

The probability and statistics foundations behind modern machine learning.

Deep-dive explainers combining rigorous mathematics, interactive visualizations, and working code. The bridge between formalCalculus and formalML.

formalCalculus formalStatistics formalML

Latest

foundational 40 min read

Sample Spaces, Events & Axioms

The Kolmogorov axioms, sigma-algebras, combinatorial probability, and the union bound that powers PAC learning.

9 Tracks · 32 Topics · 3 planned

Track 1

Foundations of Probability

Kolmogorov axioms, conditional probability, random variables, expectation

4 topics
Track 2

Core Distributions & Families

Discrete and continuous distributions, exponential families, multivariate distributions

4 topics
Track 3

Convergence & Limit Theorems

Modes of convergence, law of large numbers, central limit theorem, tail bounds

4 topics
Track 4

Statistical Estimation

Bias-variance, maximum likelihood, method of moments, sufficiency

4 topics
Track 5

Hypothesis Testing & Confidence

Neyman-Pearson paradigm, likelihood ratio tests, confidence intervals, multiple testing

4 topics
Track 6

Regression & Linear Models

Least squares, generalized linear models, regularization, model selection

4 topics
Track 7

Bayesian Statistics

Prior selection, MCMC computation, model comparison, hierarchical models

4 topics · 1 planned
Track 8

High-Dimensional & Nonparametric

Order statistics, kernel density estimation, bootstrap, empirical processes

4 topics · 1 planned
Track 9

Time-Series & State-Space Methods

Hidden Markov models, state-space inference, and the foundations of time-series statistics

1 planned

Prerequisite Graph

The full dependency graph — arrows show prerequisites. Click any node to open the topic.

ProbabilityDistributionsConvergenceEstimationTestingRegressionBayesianNonparametricDrag nodes · Scroll to zoom