Let (Ω,F)\left(\Omega, \mathcal{F}\right) be a measurable space. A probability measure on (Ω,F)\left(\Omega, \mathcal{F}\right) is a function P:F→R\mathbb{P}: \mathcal{F} \rightarrow \mathbb{R} that satisfies the probability axioms:

  • non-negativity: P(A)≥0\mathbb{P}\left(A\right)\geq 0 for all A∈F;A\in\mathcal{F};
  • normalisation: P(∅)=0\mathbb{P}\left(\varnothing\right)=0 and P(Ω)=1;\mathbb{P}\left(\Omega\right)=1;
  • countable additivity: if E1,E2,…E_1, E_2, \ldots are pairwise disjoint events in F\mathcal{F} then
P(⋃i=1∞Ei)=∑i=1∞P(Ei).\mathbb{P}\left(\bigcup_{i=1}^\infty E_i\right)=\sum_{i=1}^\infty \mathbb{P}\left(E_i\right).

Let (Ω,F)\left(\Omega, \mathcal{F}\right) be a measurable space and P\mathbb{P} be a probability measure on it. The triple (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) is a probability space.

Let (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) be a probability space and A∈FA\in\mathcal{F} be an event. The marginal probability of AA is the value P(A),\mathbb{P}(A), the probability that AA occurs.

Let (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) be a probability space and A,B∈FA,B\in\mathcal{F} be events. The probability measure has the following properties:

P(A‾)=1−P(A)\mathbb{P}(\overline{A})=1-\mathbb{P}\left(A\right) if  A⊆B  then  P(A)≤P(B)\mathrm{if}\,\,A\subseteq B\,\,\mathrm{then}\,\,\mathbb{P}\left(A\right)\leq\mathbb{P}\left(B\right) P(A∪B)=P(A)+P(B)−P(A∩B)\mathbb{P}\left(A\cup B\right)=\mathbb{P}\left(A\right)+\mathbb{P}\left(B\right)-\mathbb{P}\left(A\cap B\right) P(A∩B‾)=P(A)−P(A∩B)\mathbb{P}\left(A\cap\overline{B}\right)=\mathbb{P}\left(A\right)-\mathbb{P}\left(A\cap B\right) P(A∪B)≤P(A)+P(B)\mathbb{P}\left(A\cup B\right)\leq\mathbb{P}\left(A\right)+\mathbb{P}\left(B\right) P(A∩B)≥P(A)+P(B)−1\mathbb{P}\left(A\cap B\right)\geq\mathbb{P}\left(A\right)+\mathbb{P}\left(B\right)-1

Let (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) be a probability space and E1,…,Ek∈FE_1,\ldots,E_k\in\mathcal{F} be a finite collection of k>1k>1 events. The joint probability of E1,…,EkE_1,\ldots,E_k is the probability of their intersection.

P(⋂i=1kEi)\mathbb{P}\left(\bigcap_{i=1}^k E_i\right)

Let (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) be a probability space and A,B∈FA,B\in\mathcal{F} be events. The events AA and BB are independent events if and only if their joint probability is the product of their marginal probabilities.

P(A∩B)=P(A) P(B)\mathbb{P}\left(A\cap B\right)=\mathbb{P}\left(A\right)\,\mathbb{P}\left(B\right)

Independence has the following properties:

  • if AA and BB are independent then the occurrence of one event does not affect the probability of the other event occurring;
  • disjoint events with non-zero probability are not independent.

Let (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) be a probability space and E1,…,Ek∈FE_1, \ldots, E_k\in\mathcal{F} be a finite collection of k>2k>2 events. The events are pairwise independent if and only if every pair of distinct events in the collection is independent.

P(Ei∩Ej)=P(Ei) P(Ej)  ∀ i,j∈{1,2,…,k}, i≠j\mathbb{P}\left(E_i\cap E_j\right)=\mathbb{P}\left(E_i\right)\,\mathbb{P}\left(E_j\right)\,\,\forall\,i,j\in \left\{1,2,\ldots,k\right\},\,i\neq j

Let (Ω,F,P)\left(\Omega,\mathcal{F},\mathbb{P}\right) be a probability space and E1,…,Ek∈FE_1, \ldots, E_k\in\mathcal{F} be a finite collection of k>2k>2 events. The events are mutually independent if and only if for every subcollection of the events the probability of their intersection is the product of their probabilities, that is, for 2≤l≤k2\leq l\leq k and distinct indices 1≤i1<i2<…<il≤k1\leq i_1<i_2<\ldots<i_l\leq k

P(⋂j=1lEij)=∏j=1lP(Eij).\mathbb{P}\left(\bigcap_{j=1}^l E_{i_j}\right)=\prod_{j=1}^l\mathbb{P}\left(E_{i_j}\right).

Mutual independence implies pairwise independence. Pairwise independence does not imply mutual independence.