Let X be a random sample of size n from the population PX;θ and T=t(X) be a statistic. The statistic T is a sufficient statistic for θ if and only if the conditional distribution of the random sample given T does not depend on θ.
P(X∣T,θ)=P(X∣T)
A sufficient statistic contains all of the information in the random sample about θ. A statistic cannot contain more information about θ than the random sample that it summarises.
Let X be a random sample of size n from a continuous population PX;θ with joint pdf fX(x∣θ) and T=t(X) be a statistic with pdf fT(t∣θ). The statistic T is a sufficient statistic for θ if and only if the ratio of the joint pdf of the random sample to the pdf of the statistic does not depend on θ for all x∈Sn.
fT(t(x)∣θ)fX(x∣θ)
Let X be a random sample of size n from a continuous population PX;θ with joint pdf fX(x∣θ) and T=t(X) be a statistic. The factorisation theorem states that T is a sufficient statistic for θ if and only if there exist functions u(t∣θ) and v(x) such that the joint pdf of the random sample factorises into a function of the statistic and the parameter and a function of the data alone.
fX(x∣θ)=u(t(x)∣θ)v(x)∀x∈Sn,θ∈Θ
The ratio test and the factorisation theorem also hold for discrete populations with the corresponding pmfs in place of pdfs.