Point estimation aims to provide a single "best guess" value for the unknown parameter
Mathematical Statistics, lecture 11, part 1: Unbiased point estimators
is a threshold chosen to guarantee a specific Type I error rate 6. The Bayesian Paradigm mathematical statistics lecture
[X̄−zα/2σn,X̄+zα/2σn]open bracket cap X bar minus z sub alpha / 2 end-sub the fraction with numerator sigma and denominator the square root of n end-root end-fraction comma space cap X bar plus z sub alpha / 2 end-sub the fraction with numerator sigma and denominator the square root of n end-root end-fraction close bracket 5. Hypothesis Testing
An estimator is consistent if it converges in probability to the true parameter value as the sample size increases. Interval Estimation (Confidence Intervals) Point estimation aims to provide a single "best
The lecture then extends this to composite hypotheses, introducing the generalized likelihood ratio test , and connects it to the asymptotic chi-square distribution via Wilks’ theorem. The student sees that the ( \chi^2 ) test, ( t )-test, and ( F )-test are all special cases of a single, beautiful theory.
I(θ)=−E[𝜕2𝜕θ2ℓ(θ)]cap I open paren theta close paren equals negative cap E open bracket the fraction with numerator partial squared and denominator partial theta squared end-fraction ℓ open paren theta close paren close bracket The famous Likelihood Principle is stated: all evidence
The professor will derive the likelihood function ( L(\theta; x) ), not as a probability, but as a measure of evidence. The famous Likelihood Principle is stated: all evidence from an experiment about ( \theta ) is contained in the likelihood function. This is a philosophical earthquake. It implies that the design of an experiment (stopping rules, optional sampling) is irrelevant after the data are collected.
: Measures the average squared difference between the estimator and the parameter. It decomposes cleanly into variance and bias:
The most important theorem in statistics: