Probability Distributions: Binomial, Poisson, Normal

In statistics, a probability distribution is a function that describes the likelihood of obtaining the different possible values that a random variable can take. It essentially tells us how likely each outcome is. For example, when you flip a coin, there are two possible outcomes: heads or tails. A probability distribution would tell us the chance of getting heads and the chance of getting tails.

Probability distributions are crucial in statistics and research. They help us understand the behavior of data, make predictions, and test hypotheses. For competitive exams like UGC NET Commerce, a solid understanding of the key probability distributions is essential. We will focus on three fundamental discrete and continuous distributions: Binomial, Poisson, and Normal distributions.

Binomial Distribution

The binomial distribution is a discrete probability distribution. It describes the probability of obtaining a certain number of 'successes' in a fixed number of independent trials, where each trial has only two possible outcomes: success or failure. The probability of success remains the same for each trial.

Conditions for Binomial Distribution

For a random variable to follow a binomial distribution, the following conditions must be met:

• There must be a fixed number of trials (n).
• Each trial must have only two possible outcomes: success or failure.
• The trials must be independent of each other.
• The probability of success (p) must be the same for each trial. Consequently, the probability of failure (q) is also constant, where q = 1 - p.

The Binomial Probability Formula

The probability of getting exactly 'k' successes in 'n' trials is given by the binomial probability formula:

P(X=k) = C(n, k) * p^k * q^(n-k)

Where:

• P(X=k) is the probability of getting exactly k successes.
• n is the total number of trials.
• k is the number of successes we are interested in (k must be less than or equal to n).
• p is the probability of success on a single trial.
• q is the probability of failure on a single trial (q = 1 - p).
• C(n, k) is the binomial coefficient, which represents the number of ways to choose k successes from n trials. It is calculated as n! / (k! * (n-k)!).

Example of Binomial Distribution

Imagine a company that manufactures light bulbs. They know that on average, 5% of the bulbs are defective. If we randomly select 10 bulbs, what is the probability that exactly 2 of them are defective?

Here, n = 10 (number of trials/bulbs). p = 0.05 (probability of a bulb being defective - success). q = 1 - 0.05 = 0.95 (probability of a bulb not being defective - failure). k = 2 (number of defective bulbs we are interested in).

Using the formula: P(X=2) = C(10, 2) * (0.05)² * (0.95)^(10-2) P(X=2) = [10! / (2! * 8!)] * (0.0025) * (0.95)⁸ P(X=2) = 45 * 0.0025 * 0.6634 P(X=2) ≈ 0.0746

So, there is approximately a 7.46% chance that exactly 2 out of 10 randomly selected bulbs will be defective.

Properties of Binomial Distribution

• Mean (Expected Value): E(X) = np
• Variance: Var(X) = npq
• Standard Deviation: SD(X) = sqrt(npq)

Poisson Distribution

The Poisson distribution is another discrete probability distribution. It is used to model the probability of a given number of events occurring in a fixed interval of time or space, if these events occur with a known constant average rate and independently of the time since the last event.

Conditions for Poisson Distribution

The Poisson distribution is applicable when:

• Events occur independently.
• The average rate (λ) at which events occur is constant.
• The probability of an event occurring is proportional to the length of the interval (time or space).
• Two events cannot occur at the exact same instant.

The Poisson distribution is often used to model the number of occurrences of rare events.

The Poisson Probability Formula

The probability of exactly 'k' events occurring in an interval is given by the Poisson probability formula:

P(X=k) = (λ^k * e^-λ) / k!

Where:

• P(X=k) is the probability of exactly k events occurring.
• λ (lambda) is the average number of events in the given interval (mean).
• k is the number of events we are interested in (k must be a non-negative integer: 0, 1, 2, ...).
• e is the base of the natural logarithm, approximately 2.71828.
• k! is the factorial of k (k! = k * (k-1) * ... * 2 * 1).

Example of Poisson Distribution

Suppose a call center receives an average of 5 calls per hour. What is the probability that in a given hour, they will receive exactly 3 calls?

Here, λ = 5 (average number of calls per hour). k = 3 (number of calls we are interested in).

Using the formula: P(X=3) = (5³ * e^-5) / 3! P(X=3) = (125 * 0.006738) / 6 P(X=3) = 0.84225 / 6 P(X=3) ≈ 0.1404

So, there is approximately a 14.04% chance that the call center will receive exactly 3 calls in a given hour.

Properties of Poisson Distribution

• Mean (Expected Value): E(X) = λ
• Variance: Var(X) = λ
• Standard Deviation: SD(X) = sqrt(λ)

Notice that for the Poisson distribution, the mean and variance are equal.

Normal Distribution

The normal distribution, also known as the Gaussian distribution or bell curve, is the most important and widely used continuous probability distribution. Many natural phenomena, such as heights, weights, measurement errors, and IQ scores, tend to follow a normal distribution.

It is a continuous distribution, meaning that the random variable can take any value within a range. The distribution is symmetric around its mean, and the shape of the curve is a bell shape.

Characteristics of the Normal Distribution

• Symmetry: The normal distribution is perfectly symmetric about its mean. The mean, median, and mode are all equal and located at the center of the distribution.
• Bell Shape: The curve is highest at the center (where the mean is) and tapers off equally on both sides.
• Asymptotic: The tails of the curve approach the horizontal axis but never actually touch it.
• Total Area: The total area under the normal curve is equal to 1, representing 100% probability.
• Parameters: The normal distribution is defined by two parameters: its mean (μ) and its standard deviation (σ). The mean determines the location of the center of the curve, and the standard deviation determines the spread or width of the curve. A smaller standard deviation means a narrower, taller curve, while a larger standard deviation means a wider, flatter curve.

The Normal Probability Density Function (PDF)

The formula for the probability density function of a normal distribution is:

f(x | μ, σ²) = (1 / (σ * sqrt(2π))) * e^{-((x-μ)2 / (2σ2))}

Where:

• f(x) is the probability density at a given value x.
• μ is the mean of the distribution.
• σ is the standard deviation of the distribution.
• σ² is the variance of the distribution.
• π (pi) is approximately 3.14159.
• e is the base of the natural logarithm, approximately 2.71828.

Note: For continuous distributions, we calculate the probability of a variable falling within a certain range, not the probability of it being exactly a specific value (which is theoretically zero). This is done by calculating the area under the curve between two points.

The Standard Normal Distribution (Z-distribution)

To make calculations easier and to compare different normal distributions, we often standardize them. The standard normal distribution is a special case of the normal distribution with a mean (μ) of 0 and a standard deviation (σ) of 1. The variable for the standard normal distribution is denoted by 'Z'.

The formula to convert any normal random variable X to a standard normal variable Z is:

Z = (X - μ) / σ

We use Z-tables (standard normal distribution tables) to find the probability (area under the curve) for any given Z-score.

The Empirical Rule (68-95-99.7 Rule)

The empirical rule is a handy shortcut for estimating probabilities in a normal distribution without needing Z-tables or complex calculations. It states that for a normal distribution:

• Approximately 68% of the data falls within one standard deviation of the mean (μ ± 1σ).
• Approximately 95% of the data falls within two standard deviations of the mean (μ ± 2σ).
• Approximately 99.7% of the data falls within three standard deviations of the mean (μ ± 3σ).

This rule is extremely useful for quickly assessing the spread and likelihood of values in a normally distributed dataset.

Example of Normal Distribution

Suppose the IQ scores of a large population are normally distributed with a mean (μ) of 100 and a standard deviation (σ) of 15. What is the probability that a randomly selected person has an IQ score between 85 and 115?

Here, μ = 100, σ = 15. We are interested in the range [85, 115].

Let's find the Z-scores for the boundaries: For X = 85: Z = (85 - 100) / 15 = -15 / 15 = -1 For X = 115: Z = (115 - 100) / 15 = 15 / 15 = +1

So, the range [85, 115] corresponds to Z-scores between -1 and +1. According to the empirical rule, approximately 68% of the data falls within one standard deviation of the mean. Therefore, the probability of a randomly selected person having an IQ score between 85 and 115 is approximately 68%.

If we wanted to find the probability of an IQ score between 70 and 130: For X = 70: Z = (70 - 100) / 15 = -30 / 15 = -2 For X = 130: Z = (130 - 100) / 15 = 30 / 15 = +2

This range corresponds to Z-scores between -2 and +2. The empirical rule states that approximately 95% of data falls within two standard deviations. So, the probability is about 95%.

Properties of Normal Distribution

• Mean: E(X) = μ
• Variance: Var(X) = σ²
• Standard Deviation: SD(X) = σ

Relationship Between Distributions

There are relationships between these distributions that are important for understanding and approximation.

• Binomial to Poisson: When the number of trials (n) in a binomial distribution is very large, and the probability of success (p) is very small, the binomial distribution can be approximated by the Poisson distribution with λ = np. This is particularly useful when calculating probabilities for rare events in many trials.
• Binomial to Normal: When the number of trials (n) in a binomial distribution is large, and both np and nq are greater than 5 (or sometimes 10, depending on the rule of thumb used), the binomial distribution can be approximated by the normal distribution with mean μ = np and standard deviation σ = sqrt(npq). This approximation is useful for simplifying calculations for large 'n'.
• Poisson to Normal: When the average rate (λ) in a Poisson distribution is large (typically λ > 10 or 20), the Poisson distribution can be approximated by the normal distribution with mean μ = λ and standard deviation σ = sqrt(λ).