Statistical Inference

Make evidence-based conclusions about populations using sample data.

Point & Interval Estimation

Confidence interval for the mean:
x̄ ± z*(σ/√n)  (known σ)
x̄ ± t*(s/√n)  (unknown σ, use t-distribution)

A 95% CI means: if we repeated the sampling many times, about 95% of the intervals would contain the true parameter. This frequentist interpretation connects to probability theory. The margin of error shrinks as n grows — reflecting the limit behavior of estimation.

g1hwgXCrLchLClBhdOhlAGEcETroRpuvHsT6YcTabIs9OkDmCYhUJTP8Sn0qyC1ZRY7GNKPPiZOwoFf29dZ10P4HWeKFqMXKOgqHmRRpIKrqEAcqEen9Aj7IkFSnBepwS6SWXqgMlNIh9Dg4J0PgVSTjhjIhjcH8cjTALbQB6nBLBMs3fARSz4ZzBVxaXysOmm54qo10PhI/IrVOXS4q8nSDzhCD/gQTTqQjnnsU3GzGf7qI+PXAyHgOJPzSdsxj31rvt0ggcx8HY2S/X8NSQ9g9hmQo4UmviffKTIClE6Lx7qZIl+hrPKE+UPkD5/1e8lz6vNDO3m43Zup/dPBceJhD+34KiGwu2Y+TYa673ylFDnUMuAS9OBaHJ/hV+j8kJwT5jGTqpNoe9cpjspx1uXdzz8LshrQxJUXmZpR4llXBFisVduiFkQLh+5DYRlY+0VVdPa2taJs5nOzEksmEmEszYPUbQVjpyTApea5+ffySgjHZnbr1Krv2Eb6QNANJzp0E1WDjM5iOQ2LoUkY5I5c7WbF5MDe4GH/NJwv7FljN3AiICzw4VXZpmsMbaggUmHYz1xQ3a1k84IGXzs+pFpE6ewpQw041rPRTgN68IylaTimWvvMtfyK6/ogAdi+ZLpxGwThUCRqSBYj6+HKGkbbdNwWejyB+RaoZa8e7FmesAzuZlkyTePB9OUg+AERL81V6kV6YioB7ap+hB4T3vrTVm4/6ry2RNSnz4o3HvYT6PTwOGmgJGlrJ7RFaLJj/qMZlPSqeJsoEW+GQykfLB8gOud5YSXhcgk7+yYLJPYWQcREmtbT5ZqFDa8mGOhigV7wCLi2phLYJgZsLx7g3C//6kApugQmAoyxwwjSBAem1J8pxk9Glfo6llnJiv2c0F3xENl83v5HrdpOkUHdWxIzzayQyFwmysTdts864In06v4DBQZ08qcQ1FONTkl5S+ay4R86SAOjPIwdJ1tCUbgkvWQawWqqyacoR0vWGQfo0twY1S+qwxgh5LB7YAT9evbEsr3yZ0ujFZMIDGWRVHbwOiz+XyOpHczk7Z1c7aDGb7Y5tg

Hypothesis Testing

The framework:

  1. State hypotheses: H₀ (null) vs. Hₐ (alternative)
  2. Choose α: Significance level (usually 0.05)
  3. Compute test statistic: z = (x̄ − μ₀)/(σ/√n)
  4. Find p-value: P(observing data this extreme | H₀ is true)
  5. Decision: If p-value < α, reject H₀
tJfgGs0JT1+iUnIW8nB6zRXtBK8eHw6v0UbSygIiZ+ITe65GF+lTSAUxBANHg1/h0sDQtnnmqMyjpuVrs6eSNpFr692AJWsNxlJ0eOfjxwpno2HwGh9xF8H8CsUSME50y2/STc+Kb8PPCmADS1wcY2IHdAfr/RfP8JQWKc+y6rM9pfx8HvaJNfwM8H9IFN//IvVvdlWHwefGNSjXFObo+1N7aTemB5Vhj4C+VRRakVZFUxpo596HJwIN/tGAm8UTrAiUkG15a6mJAmpfFGY/9PNz0rlzNxnQCF+IfF42ZhcTjuALn4GXkj8QdAXSYy3Sao5+OAovF8yzLLyqBcP0KhmC4Ar49IzWO9zlpcBwqp2dOhgJdJZSoDYVj+pXr3JDr8GXDIaodrGPBGwLR2wj4uy+lE1tCQCSiRcmVmu2ZhTLcWByMVPnnjvSq7GkjRqPk/VtdleH4Tj/neY5Zm8ftDN/oAlxaBQ+OHUBsMbjOen2XclVmjG+/erpj+dHRXp6ut5r/mwJfyVIAZUYOmKtnW3FUf9zgJ6Oji1PfQpLfnT9MAgWvwWN1MXyk/yArD5d7MeCNirVdTcpT/p7faT+Wi+Pf4/RoyEwwmKbbLALpKsKGo8hczfdzDZ0REqnOh3U+IExfQyOkEshVNGMua+VmaJIUMtqHcyB/HcSCQahi+tlPWgMI5qXYuwHU72X83NuWycZsjtskN4zOq+Z9hy7vIwTueDYCMvUdYZlGJinaIYf9Ya44uuunPDE3eqvF8u+ITQhrPdt1qrt1UChyFDd8WIZkJrabpaxtP3Hsatl0AGTefx5fWWZPSVqfIZgXDkaGEwLeCrgdc+OC8hReLpAknA1C/l0cWiFuUh82yWMhEgPTdZMiIR4I6mt/v9Ko0ATkp5nG0cqh+JINkh3shPbYS19bq05G/J6RgCistu0pUHdsZHrTaPHhmGsaA2MFC+MxImR0KrGzYQoM0zCEKsc677u8OHO75ZCc0x8ThcH8XstWZIqdG8+34YLjtbwROosF2yH9Pg811QuNbLw4GW+qR2AYqRlSwQl8QiwdgyINYmRcg==

Example: One-sample z-test

Claim: μ = 500. Sample: n = 36, x̄ = 515, σ = 60

z = (515 − 500)/(60/√36) = 15/10 = 1.5

p-value ≈ 0.134 > 0.05 → fail to reject H₀

rhAY9EjOiu0YgKfLnutlamUnNdpiC5CIqh7Gk+bgLmeHkV7qd01BBRdEhpqWlIKpLUv11nf9vLX3oSa/MQBWwLJS+LOTKmCvmGUzlfv4fPsiu9gJEk/aFvGTC0isQsRydSay3bsfUqY8RhdXiq35X4ij3V1ktZYReeeFO9t0GRdlxGT4obO284daOvb0TEnQo67Irp5Cou2ToPSPD0sHMTulzTjTbuP2rvlt9TmORLuKpqS4aeQ5z8ByR5t81OpJwpNec1+2XQN+CpFWPJWb/mQoK6KoYdBtIuMNsEz32UyUm4kA26QvO4Q/QLceDUADa2QPoqHUDxKySCosAmv738najWVsFPzxEZ1lmX11Zhstt7UEYJ2THqkIaizCBEHfjMjG5VONaRYHYt2qmtxuT1NxPvT00PVHlTTGRmbSVBYHZJkrbIERDaUqnKCoaJo0f2rC/QnHb1zka6WAzFyRs/ZmqmEx2fEKE/LBpJsGqASDY+ft5H7u609bKgh/DL42/PhW3mwNzCCkTeIdrd4caOAIm5KZ7E57bdny2Q4dBsBAZ0kqHYB5N17ra6tZGmuzaWETz8dHGbK8xsdQLb25w+huHYmldZzwhA6XagGvlIr9Y0ANYXHgtKg4q8duIVKKrgWieJVbOSAdlF3/H/WptOvCzouidlD1auMSDA0EZVeQ9eDofvJ+F/samZQQsJRGmvqP9LrV1CBPnu+H5d0Vlnvk5auQlXj5Qgdg+cUEFPu2oqT2E3URbPavOf4j4CqUmffNqEE7c0dDyRSVucprN1N35VcVFctmqeyFjQjTXN4YPnLD7lCatOWyzdQf6pTyvpUUr5gGhEEV5+/P9RiEK65YGWr7tNJo8ib4dp9OmWY78iZ1XSLdMMumnY9xS/ll5K8S83PNY4/4BCWdwFE/BlvG8UzukjhfYJLJiHRNuKsstMSB6ONf9lIJQVXsMl8xnuwp8LpWIPXukLft1lEitlwxfmFWpiySg825NfLE0ii8cduPYmeoNQ8hew0PkI7VgNvcFyS6M2T555B/ZuGSIh4EYl1itZA2qoctwkL1EAX5ZoHq

Type I & II Errors

  • Type I (α): Rejecting H₀ when it's true (false positive)
  • Type II (β): Failing to reject H₀ when it's false (false negative)
  • Power = 1 − β: Probability of correctly rejecting a false H₀

Increasing sample size increases power without inflating α. These trade-offs are fundamental to experimental design.

Regression Analysis

Simple linear regression: ŷ = b₀ + b₁x
b₁ = Σ(xᵢ − x̄)(yᵢ − ȳ)/Σ(xᵢ − x̄)²
b₀ = ȳ − b₁x̄
R² = 1 − SS_res/SS_tot

Regression finds the line of best fit using calculus optimization (minimizing the sum of squared residuals). For multiple predictors, matrix algebra gives the solution: b = (XᵀX)⁻¹Xᵀy.

ANOVA & Chi-Square Tests

ANOVA (Analysis of Variance) tests whether means differ across groups — it generalizes the t-test. The F-statistic = MS_between / MS_within. Chi-Square tests independence in contingency tables and goodness-of-fit for categorical data.

Modern statistics increasingly uses computational methods: bootstrapping, permutation tests, and Bayesian approaches. These still rely on the probability and descriptive foundations covered earlier, but add computational power to handle complex real-world data.
gcCzi7ttKFBV4A+FOAQoGt0QR5tlJh111AodlFOLrxq3GI6D6TEod/dC/V3We2HUuAROIPJYQ/eVKy1aX55KHwzP6rh/U2eHp8sM0OxLEolhuNsLXugYh4oJHsikesjBYvTSsx9gq0UdzzXAkY0brWeHOFmXw2mRfNaNNQa7Nsbcek/PYkljJLPy8gTc4genXMdhS/QvpXVmCowz1TA5HvcLoVzVUQfjswNnfudIKO1PSn+j6GAAXqALRb6KK7x2tF4CGtIghudsz6dd54EGQ/NPprj/Vqo+GA3xUk8ILjN3UDtgD28Gm9ezD3KxrNaB183dS5ZbZCNUNDZXNNMz6+6U2uaZbxCU4xu82Xdddn3lQCQpnRF18K8hz/nUMaO90jQSR6vpZeds3MW1Pc8Vb3PUork7wqr2m2lmebeoV41HPyW2rYrgVH5V2G8bhvSSUQuQEh9UyDnQDMvHZdz1kZZr8KzTeYuMUhScqWO/c5WtHXTnd5T8N6QFflwVqld/TQYbgWnevLRqoJeC+Q8+X8o4o95oI5xy7P+RVEsu/b3pzx12atjH2P7G/0x0UQtOxzxp/z+po4yTRWH/r7k39UnlbCYumvWauph50OhhJqbqT30z3NlKysA5qXPxOSnWCkj1Hj3w7lt5RRPvP15SU0lTL3ArX144mmt4MNRUO31SNC5/FoW2rMv7rUqQvgq+Ez687Ogb7tsQ7MhSxhfutbicTQzC7v/qWn4LQ2IUa9wlj44HDhCJ1/GIQD6cXK6MG5zYo9Xt025Oyp9PhlnXAUvyR+wC1pJyaBsAzknmIIA/Xg5iWSb6YhngAPJmX/KazJJ2ALT4pb1xmOMa1DblPOUk+iGqV6Fa9lrezERgylHBeD3Hpz268CbanojYCTqJkdFk3aszDp364X/OgbKenMR/dEZTQQEU5rUCibgOeIMzyKCKni6aYgodQ6///I4fFp0LIWlSRIQJjVeTLyOjPxDoMg3S3YDVTBhMIY9/Eh9T8aUHuLplZ/RVnP9qYatR78aC4YMzX/ec3S3YfLXHsYFDCvHej0U8pI8yjT8jAcNdXIyPQ