formalStatistics

The probability and statistics foundations behind modern machine learning.

Deep-dive explainers combining rigorous mathematics, interactive visualizations, and working code. The bridge from formalCalculus to formalML and formalNLP.

formalCalculus → formalStatistics → formalML · formalNLP

Latest

foundational 40 min read

Sample Spaces, Events & Axioms

The Kolmogorov axioms, sigma-algebras, combinatorial probability, and the union bound that powers PAC learning.

9 Tracks · 36 Topics · 1 planned

Track 1

Foundations of Probability

Kolmogorov axioms, conditional probability, random variables, expectation

4 topics
Track 2

Core Distributions & Families

Discrete and continuous distributions, exponential families, multivariate distributions

4 topics
Track 3

Convergence & Limit Theorems

Modes of convergence, law of large numbers, central limit theorem, tail bounds

4 topics
Track 4

Statistical Estimation

Bias-variance, maximum likelihood, method of moments, sufficiency

4 topics
Track 5

Hypothesis Testing & Confidence

Neyman-Pearson paradigm, likelihood ratio tests, confidence intervals, multiple testing

4 topics
Track 6

Regression & Linear Models

Least squares, generalized linear models, regularization, model selection

4 topics
Track 7

Bayesian Statistics

Prior selection, MCMC computation, model comparison, hierarchical models

5 topics
Track 8

High-Dimensional & Nonparametric

Order statistics, kernel density estimation, bootstrap, empirical processes

4 topics · 1 planned
Track 9

Time-Series & State-Space Methods

Hidden Markov models, state-space inference, and the foundations of time-series statistics

3 topics

Prerequisite Graph

The full dependency graph — arrows show prerequisites. Click any node to open the topic.

ProbabilityDistributionsConvergenceEstimationTestingRegressionBayesianNonparametricTime SeriesDrag nodes · Scroll to zoom