9YSDZ3joMHAvsSZGrFQQ9OXArLMgqW9nXNw+LSnq4OYveepTL6BxCfzABa5sBeA4PECe7wsDn1BRUd4xXcHX3T9k1o9Per/ZL9Pi7DXF8EdgVokPabMSaPKXrDrLG8NKLyDruc1CqT6GqkmcRgHwjSVN796ZI31Qh4IHGwGPDhjKhjMEEGcCvuta29cPsY/H7QDVpUjotF5esml4yGL8EjUDJbzIMMgPTAIjJa6x237dIZea11aD0EVnzUkNL3zDGfnYADcF1Rrc3FKKdMVK3AQc6y9+FOT3DGNkJhWUP0cqK4wzVGKbq/4xpgGofaj17wxgdQtP548xkYboiDJ4MnpbJcbnq3cXYmGGWTupVonPDaJ+1Qsc5Jq/xvW1dX7c1771iZgdpWvpW+jkkFxl2tGgZcpaUFyJO/RdBGXNa9WCTdT12IXlOuaSeuw0xOqz0MZxYSmuS4WbI5/a5qGKhop1wn/n0tI3BiKK9LQu9c1KiMPaX6yF9xjgRxBmsJFRnIj7/E5ylMCrUKZgakdlJXxR5DT6kpYmT2e3ynQn77Ah5Yi670lOa73Z2CQjde26/8d0eNDwqWmSZTOKbjXnjBCe4NftM9D+tclOAtF2uVG8v1u/3tW6kG2uAgUnkhETGjzlUnFb7JuldyFZrCpODYYGs8DaoVJf9cfDtkyjjldRaTf4tEo2npnp+dP04HgK7TuwmpPcmYBPIxKMY+akKPcWWkPP7ly3WSQqnFbfszMZkLtu2Zt3dLKrjp3uiIiv1dnm4+8hBCZ1q5yJvA7wRyvTmM0xaZyqKHD6jVJY2YM/DALICBckzVz16PQYor9BCNdaidB8FbHo5oSy0ZR/GXQ

Probability & Distributions

w+BlFvvVyRaHeMaXhCfPeEWVw4f8afNQLuczCJrJjPnfQoek8yKapri+YqPzjjF7U0YrWW26PaQwGFaa0pgHLPDoy4IpwFpRrD4MEtXYYlL7wKvsHp6MBomNnApUisRoDmlxouSVWVsXHl3oQkB8KkxH9R3OE38thVwCweHcTUp/qlyXiOI+OGd+PUPuSwifhhHO4K8e6SlgnNMrmRiuYqKnB1bTkQizIuC0DVf50hZna91rpQzM+6j0WXGAKoMPf0fTO5rLjnRJ2o6GgkQZp77WbSzCi+DtEW1P89GwvMaetx5dXwrSp1rZehGORRojbzauZK6nCPzK/sJRZss1FAutl8cHlUK4Q2Bt1sdNGwVLfWbgsCaOVIHZAPYbSPqTz8h5RNQGjdQ3bzHHNwgTueVsqwwtAidVdCZJMQ0Sihebck6dVYDtHvbF5MWcb29kv7gv7IX4BOBbK9KdW3zP9JYdMzVwWSvUgsbkhurWGmVGCYH8VCmZN15eEbGBhNNmrUIQT9gWLbUjSils5HQIV2MQhajGK1D//NHIrTA/LNmzi9l6AinaYALR3O5beJVHzti8/ewKwXW6z1ikxUpTeO4x+321FSTEvJ/tij8WvZlpixUm2C6bBU8Zo0BweClEi8ILqNAv7KxXOTi8rPIKpvmAgPY+7O0jWJF/DKEBj9sRoB1tY+zRrR5Ex0HyB2+0TuJM4AdKTyvgoOl98IR5r1FUCvCWpRmTMpk9do/dPURgtdj8r12IJ2NbFCkGVGYo1disz2XVrgecChjkVqFMiGO5SatwHhOaeRIQqSv6DP5iUucSZwD9XQ1oBWWiPFgjJ9sr56R8RM4zj5oDfIlo45M

Model uncertainty with probability and understand how random variables behave.

Probability Basics

P(A) = favorable outcomes / total outcomes
0 ≤ P(A) ≤ 1
P(A ∪ B) = P(A) + P(B) − P(A ∩ B)
P(A') = 1 − P(A)

Probability quantifies uncertainty. These rules come from set theory — unions and intersections. Counting techniques like combinatorics (permutations and combinations) are essential for computing probabilities in finite sample spaces.

G/2Ny1jRiU/6JFVAxoGotXAChWp16wJ5BY9O1W4W9YE5mw1SyWYQtJaeITz2Bm/oCIBj9sm8RWwmBcPHwW8yXXGApT4C+qeT6mDHeW5T8CFb2MSxk1uoWtSlLjA+SmfEmpp1OgyQlLCSDsNSY2B5xlKUtL8EuJzOli4qH+Lub/ACrzkVE+fPWfjaneJFFDshdAg5g3Ah6snNCw+5CPo7CfGZDd+6P5pvjU0f+BxT9NP6I7tMWBbN+hJxnnUEyzUL1DYklxbqG5yKZwvnRqT6sdYK2+q/22UtfW5bUxwu42L+Up0KW7akWWgxpNg3O0pudRpHguzJbjvHlmbVohGgQ+mZsOngRGfDIejRpRaH7G1Z1WJ/HjujEoqMMdOWqrz3zuaJX6o2FBeGb0BH6T4DSxK/kMsmAEqtbgTVc6LK4M4U5qn2J9sC4sy+QvoSS6rPwysxLBz21vPC4yIOtSCF2yvwGs/frwPKgmHYuDaLqtqtZTv1q7wGWxWTuMLjEVz9MBJ0PM2zZmW9jTTikIaVAmQUe3+c4lOPNh7AEyN11C70Dx9ny3W0GU5L5NzONXh4o2jIWw3evEh3k/as4PkP98/4e5timXVRfHh1qxBp3qq1ctHpCx0WBXNsfvCsVCwZ6wkmR2NRlxyG7qA3E4uoz3MrMSYc+cazCNe7LQBfvvXH3YsJOlb3K3288JaWZqI76W74JKfaY/3lb61ZGdKaEKounWoNtke1GJ8QJC1ES4wVbAtDZCUCLaUX6XPgme8JB8bfdaQ5/mMzLaotqlKfg/NI06MO9G9FFZQ2omDk98WkP8hLXlVhjkJk0EwNMOY9Hc2dusG27ruZjw/zxYDcR+

Conditional Probability & Bayes' Theorem

P(A|B) = P(A ∩ B)/P(B)
Independent events: P(A ∩ B) = P(A)·P(B)
Bayes: P(A|B) = P(B|A)·P(A)/P(B)

Bayes' Theorem is the backbone of Bayesian inference and machine learning. It lets us update beliefs with new evidence. Total probability connects this to partition: P(B) = Σ P(B|Aᵢ)·P(Aᵢ).

Example: Disease Testing

Disease prevalence: 1%. Test sensitivity: 99%. False positive rate: 5%.

P(Disease | Positive) = (0.99×0.01)/(0.99×0.01 + 0.05×0.99) ≈ 0.0099/0.0594 ≈ 16.7%

Even with a good test, a positive result is only 16.7% likely to be a true positive when the disease is rare!

Discrete Distributions

  • Bernoulli: Single trial, p = success. E[X] = p, Var = p(1−p)
  • Binomial(n, p): P(X = k) = C(n,k)·pᵏ(1−p)ⁿ⁻ᵏ — uses polynomial expansion
  • Poisson(λ): P(X = k) = e⁻λ·λᵏ/k! — models rare events per interval
  • Geometric(p): P(X = k) = (1−p)ᵏ⁻¹·p — trials until first success. Connects to exponential functions

Continuous Distributions

Normal: f(x) = (1/σ√(2π))·e^(−(x−μ)²/(2σ²))
Z-score: z = (x − μ)/σ
Standard normal: μ = 0, σ = 1

For continuous distributions, probabilities are areas under the curve — you need integration. The normal (Gaussian) distribution is the most important, governing everything from measurement error to stock prices.

Bb+cofUtrlZ20B9Kg2SqFxLGy7pPSSszNFnnT2QtNiJPZgo4/WO4W4IjTm2hwaZsGmlFy+09l6gY4/bitDOSa+DDm2b+qO/CWUmiBYXMMY41im1qxTNhJmSKhTN5iVws4RhuNAY647wqhkrLQIeCWEGSQxXhyDoK4ksqKOq+EGKEDMsSKgxbHYwmGXe8ltyUkHzB1EGk/kncIx9ewAcYluYPwp2I5kXzkZyaeOxRwKrqpS/byTxGVtia8xq0Ay1vK0AMoYW+8yLIdld1AaLgCAooQnRr/DTZkR6pGBYMoPEet56IgDoQWdKkf5qPbvoRmUe3tjx0LjbdoNGd8dToBxxiChpKEc6G7znhCQ83SwFVV/xL6bRI2cLmMPjbVQNOtoPwiLGcnO8Dbjb6gLo1oiDWabXl+0Y1O1L/SxQAvGp7QzSQeIJF3BgQ59lQ+uwFQZPfLEnZ4JyHxcDKoc8jGRBPlZREoBon/yRc/ZLPuOB5X0LlnLwjY633Zvo9+G2dsuntZIpYbpXbRk60X/2J/damsNZny0kptsB1fWBl6RdMuJrHA96VqMcl93hzVsqR7NjfQMp9btnQFMEfGzCQhXmHDO9Todb3yPo+p0/Gq5xfxbdj2cOP2d5Ka2V/OnsGV1+b5U17Iuuz4l7kb6OnocRld2s4fcb2GMXwcJvrI2dPA8pnhawW9spIQJ+QXAF+SLXrXVh+j+Xoh53hHjDczyCvixe1vzRGxaEQkN6WupiQJrqZadQKtpMrhkGzQGoTrw2TmyuvzQk4hjCvn3DGwBNa9OkIzh7GKKtzJVNtEwTG5rjLCS7S6gMZyOgtm1VjwLaYRBkJoiGamhCIFU9COR
  • Uniform(a, b): f(x) = 1/(b−a) — constant density
  • s5JmdcmX2MA1/9hxYCVh41tfIIBSwCxGBaaFN04rrgkODX8Ksi7HHtbwaReJAuvdqU6PBrIDBLiAWa/2V3pZTkiSUfaADSV4thD3j1GMkD+bwaQUCwHZtS9Ah8JAhOHFKPjKEQTr7KSvpUAvWb5fHAR0FGMOVUA1f3xquA9wHJD34RDV2RSZReov5Vy73xOPnlVXMygSgz4HzBqNPrlP0NitZgpdbpdKq1jOzg9wK3CXQ7nptse5Misph7tBlQ0kwBKnsCgBqOAn9Pd9VUSig1koRHMtnd7cGRGjXwDpS986F01kPOOhap74qv+7BBdgVMA1P8OPbfo8GQ2Z5xwl70ggKnPi401POohCxePus5r8qzIqzGBa50OPl+39ao8bq1IVBqGOH+cpvQvPe9WTjLrMva6NnIX6ZRbW0DjnQM5wUgeV8B80hNagEvYWiN+StipxiYrwYTWIVcGWfyfnGLIUvJAozqbXIfd4cwJbGFhEO1BKHHrWNSpPfxUwIEXKFiKLQMKI+h2aAef+doognYfXMwoiaDVnVr5Wieng3wu8z9/SCMWDWvn2o+Pt73dw1cA1tgKVJzjE7HOl9/1A707xYXy6s7jDtx1umBx4n5QRvhulH0nZn17TZUGZUw/w4orGzzGXqlMp3kKnYAzzhQwXGVuObA2DCF15B5TDgCkwkaf0J55GAlog2OWNWffWqZFEDnH0L47S/vvfVfSmTs/U+XDRqKla0B8J4KmJo0X7l+KzIgEtZ0emk6GokoGdOD/J55sdoGHtJRbWxDokni9cAGDDvm3hWXNqR8EOfw6HhHha0aa/JKxpbABcE9OOxhYWV1IgadeqIY45f+rQwL
  • Exponential(λ): f(x) = λe⁻λˣ — time between events
  • t-distribution: Used in hypothesis testing with small samples
  • Chi-squared: Sum of squared standard normals — used in goodness-of-fit tests
  • IWqQtWu6vPj+nEh2QBVl9ljQ8EH6xoJXgof6QZSo+El6uSxiMVQdZLrGDgY5hhH3LlEcuk5RD3ouMWk8EalXxF4Jj0Wr4ukWLqvkZGH6Mhm/5iIN8Z3aINPCiOw2SPPWs+8eHGP8L6r8CCi/TxMNHUjrkfliwghSUVe60Kfj9/r8IpkWXKfQo4AfykFLDSgMaeohkfFTvCVGHqNobzAlRNvzDe7h8I4PP5/GpdzRDaw0gRAc+pe1cMKGDB1Ul70/V+c5+xSuz5K5v5KRIJYT9D/Sh0ob1qo5+j/gSkxrDwtYG5VSLbCIZNPQQsyd0icXSVgTtXSJzgCjCGBdB8pfA7IYnm2IMYnw8Yy4543NKy+/dp7U1JDlasia+NP01f9XO/FnhMs2GpSZlygaUqcUqbDo0Zb+ltkLFdrw7hOlosy6PAcvVyZ2wfsWIGJ9Rnx1iKO/+V8O967gJEy25jvP0AayNZ+UkNWhvXxKnnmx6+xS7Msh187gK7Zw6fUNHjZ7fbJvKIecQ9O7fJINTd4la80ko8ojymzk208h3RbqmUnIq0NdrIkOjvRdQ82qodroJHe14aX5cCFEJg0g8i3nGsEVZmHdNs2Sjtzuq19qXV35sCKfIa+WnwICihxSOO77ZX2zuqlK1STE2cZThiQigrpDA47f7Y9ZaEed4+eAcQa+6cJF6vcYwD3RsyoYAq/zLeLDRyv4+FdHbBdbvJ21wDvHS9UphnQwNUgezdDT+COrIza0xrZ+JdjUvvHIEdYBjEAhSoEF8OQCGS9+Y1nHzb4yCccmlNNtES1zB+O1Q7SWQ0dVpirycXK1f6F+ExocymmEvz1SIqVyV2bQ9tFGW1

Central Limit Theorem

Central Limit Theorem: Regardless of the population distribution, the sample mean X̄ approaches a normal distribution N(μ, σ²/n) as n → ∞. This is why the normal distribution is so important, and why statistical inference works. The convergence concept mirrors limits in calculus.
hyelsEdatXGnhHQHd/FsqVmrJ/u0WGuLlgqKysrsu6cC10u1aCzuAlLnwWXaSRfi0+LzmKyUIoXOdcj3GuKSrAvno8OYY9bpiLJhDeeZlYvg93eu1TJD+4fdSrvU3ZwU2mW+QXldZxfTjJP+hzVdVRppNHs6VVtgcRdPKW6e2BumES1yPIyRmCyJEoRDKmRrthUsC2NcnHN9UHpJIPv1MAfKKeC5e1Kyq1gkfv5Sudkgs0SHD5Re4LDEe3qI0PevCssOSpl/zawaj4/Vd9HoRhyJ9KOC6y5GXiexr83B/4vV7RRnBfkk7jFA/oeQBWv+xlx1iCVlVPujTDqv0vK1rxJFbsq66QW7xx/l/SlvSYn5Mhx+TDrZ/iG0gnaP2DIOT0xvydRk4EPsMIqwIwrpp7eb8CyvvjB0matv/DJ9/28wWxl+B5oY1MgQv82yYcsSHApiSzceYhQf1Ddu7UNHULFx2YZY3tGGfZM195g3G6pKstuKRIE0twx1bNGun0nG8DvLFOmIt8rGUJcAe8Z56shYtDsvfBPiXJHviqMM3dHxEWnWhQOl1LApo7fLOyogkyy8rSHqKwrDZse21MDKX/EXZes/VR+84nGAyFnxgsMJJcAzsSgEDVkkrAV4z2Bli1wGVoVkGNjxTR+Dg4aZjykM5oRARD+iuW9JVXG+3dst0uqphc/KOZSPbYEYNttKHnXqtUHAn+E0HZMulcEDNlgUaX9Nh7RZ+qLYiR59lIlNHMvNv5HYZOOJ98AQH90rUQwIFocgFjQJod8M0r+/D3R1zKNUWJKGYI2RCqoeRlPm8i5nhuM862Y9KArVsJbuvpGOI9rV5FX9+sRiaDDrbz