Let (Ω,F) be a measurable space. A probability measure on (Ω,F) is a function P:F→R that satisfies the probability axioms:
- non-negativity: P(A)≥0 for all A∈F;
- normalisation: P(∅)=0 and P(Ω)=1;
- countable additivity: if E1,E2,… are pairwise disjoint events in F then
P(i=1⋃∞Ei)=i=1∑∞P(Ei).
Let (Ω,F) be a measurable space and P be a probability measure on it. The triple (Ω,F,P) is a probability space.
Let (Ω,F,P) be a probability space and A∈F be an event. The marginal probability of A is the value P(A), the probability that A occurs.
Let (Ω,F,P) be a probability space and A,B∈F be events. The probability measure has the following properties:
P(A)=1−P(A)
ifA⊆BthenP(A)≤P(B)
P(A∪B)=P(A)+P(B)−P(A∩B)
P(A∩B)=P(A)−P(A∩B)
P(A∪B)≤P(A)+P(B)
P(A∩B)≥P(A)+P(B)−1
Let (Ω,F,P) be a probability space and E1,…,Ek∈F be a finite collection of k>1 events. The joint probability of E1,…,Ek is the probability of their intersection.
P(i=1⋂kEi)
Let (Ω,F,P) be a probability space and A,B∈F be events. The events A and B are independent events if and only if their joint probability is the product of their marginal probabilities.
P(A∩B)=P(A)P(B)
Independence has the following properties:
- if A and B are independent then the occurrence of one event does not affect the probability of the other event occurring;
- disjoint events with non-zero probability are not independent.
Let (Ω,F,P) be a probability space and E1,…,Ek∈F be a finite collection of k>2 events. The events are pairwise independent if and only if every pair of distinct events in the collection is independent.
P(Ei∩Ej)=P(Ei)P(Ej)∀i,j∈{1,2,…,k},i=j
Let (Ω,F,P) be a probability space and E1,…,Ek∈F be a finite collection of k>2 events. The events are mutually independent if and only if for every subcollection of the events the probability of their intersection is the product of their probabilities, that is, for 2≤l≤k and distinct indices 1≤i1<i2<…<il≤k
P(j=1⋂lEij)=j=1∏lP(Eij).
Mutual independence implies pairwise independence. Pairwise independence does not imply mutual independence.