Let X1,…,Xn be n random variables defined on a common probability space (Ω,F,P) with a common state space S and PX be a probability distribution on S. The random vector X=(X1,…,Xn) is a random sample of size n from PX if and only if X1,…,Xn are iid with distribution PX.
Let X be a random sample from PX. The distribution PX is the population of the random sample.
Let X be a random sample of size n. An observed random sample is a vector x=(x1,…,xn) of realised values of X. A set of data is modelled as an observed random sample.
Let X be a random sample from the population PX. The population is parametric if and only if PX is assumed to belong to a parametric family {PX;θ:θ∈Θ} indexed by a scalar or vector parameter θ with parameter space Θ. The population is written PX;θ to show that its pmf or pdf depends on θ.
Let X be a random sample of size n with state space S and t:Sn→Rk be a function for some k≥1 that does not depend on any unknown parameter. A statistic is the random variable or random vector T=t(X).
Let T be a statistic. The sampling distribution of T is the probability distribution of T.
Let X be a random sample of size n. The sample mean of X is the statistic given by the arithmetic mean of the random sample.
Xn:=n1i=1∑nXi
Let X be a random sample of size n≥2. The sample variance of X is the statistic given by the sum of the squared deviations from the sample mean divided by n−1.
Sn2:=n−11i=1∑n(Xi−Xn)2
Let X be a random sample of size n. The order statistics X(1)≤X(2)≤…≤X(n) of X1,…,Xn are statistics of the random sample, and the rth order statistic is X(r).
Let X be a random sample of size n. The sample minimum and sample maximum of X are the smallest and largest order statistics.
X(1)=i∈{1,…,n}minXi,X(n)=i∈{1,…,n}maxXi
If the population is continuous then ties occur with probability 0, so X(1)<X(2)<…<X(n) with probability 1.
Let x be an observed random sample of size n with order statistics x(1)≤x(2)≤…≤x(n). The sample median of x is the middle order statistic when n is odd and the average of the two middle order statistics when n is even.