Conditional Probability
Conditional probability is a fundamental concept in probability theory that measures the likelihood of an event occurring given that another event has already occurred. It forms the mathematical backbone of Bayesian inference, statistical decision theory, machine learning, and risk analysis.
Unlike unconditional probability, which considers all possible outcomes in a sample space, conditional probability restricts the sample space to only those outcomes consistent with the given condition. This refinement is essential in fields where prior information significantly alters future expectations.
Mathematical Definition
Let A and B be two events in a sample space S. The conditional probability of A given B, denoted P(A|B), is defined as:
Where:
- P(A ∩ B) is the joint probability that both A and B occur
- P(B) is the probability of the conditioning event B
- The condition P(B) > 0 is necessary to avoid division by zero
The vertical bar | reads as "given". In formal literature, it may also appear as P(A|B) or P_B(A). The notation was popularized by Thomas Bayes and later formalized by Bruno de Finetti.
Key Properties
Conditional probability satisfies several axiomatic properties that distinguish it from joint or marginal probabilities:
- Axiom Compliance: For a fixed B, P(·|B) satisfies all Kolmogorov axioms of probability.
- Independence Criterion: Events A and B are independent if and only if P(A|B) = P(A).
- Chain Rule: P(A ∩ B) = P(A|B)P(B) = P(B|A)P(A)
- Bayes' Theorem: P(A|B) = \frac{P(B|A)P(A)}{P(B)}
- Law of Total Probability: P(A) = \sum_{i} P(A|B_i)P(B_i) for a partition {B_i}
Interactive Calculator
Compute conditional probability using the formula P(A|B) = P(A ∩ B) / P(B). Enter values between 0 and 1.
📐 Conditional Probability Calculator
Worked Examples
Example 1: Medical Diagnostics
A disease affects 1% of a population (P(D) = 0.01). A test correctly identifies 95% of infected individuals (P(T+|D) = 0.95) but yields false positives in 2% of healthy individuals (P(T+|¬D) = 0.02). What is the probability a person actually has the disease given a positive test?
Using Bayes' Theorem:
Despite the high sensitivity, only ~32.3% of positive results are true positives due to the low base rate.
Example 2: Card Drawing
From a standard 52-card deck, what is the probability of drawing a King given that the card is a Face card?
Real-World Applications
- Machine Learning: Naive Bayes classifiers rely on conditional independence assumptions to predict class labels.
- Epidemiology: Conditional risk ratios assess how exposures affect disease outcomes while controlling for confounders.
- Finance: Credit scoring models estimate default probability given borrower characteristics.
- Quality Control: Conditional failure rates guide maintenance scheduling in manufacturing.
- Artificial Intelligence: Language models predict next tokens using P(w_n | w_{1},...,w_{n-1}).
For advanced treatments, see measure-theoretic conditional probability via σ-algebras, or explore Markov chains where P(X_{n+1}|X_n, ..., X_0) = P(X_{n+1}|X_n).
References & Further Reading
- Feller, W. (1968). An Introduction to Probability Theory and Its Applications, Vol. I. Wiley.
- Casella, G., & Berger, R. L. (2002). Statistical Inference (2nd ed.). Duxbury.
- Jaynes, E. T. (2003). Probability Theory: The Logic of Science. Cambridge University Press.
- Aevum Editorial Board. (2024). "Bayesian Networks & Conditional Independence". Aevum Encyclopedia.