Probability Theory and Random Variables - Question Bank

1. What is the correlation coefficient, ρ(X, Y)?
A) Cov(X, Y)
B) Cov(X, Y) / (σ_X * σ_Y)
C) σ_X / σ_Y
D) (σ_X * σ_Y) / Cov(X, Y)
2. If Cov(X, Y) = 0, what can we say about X and Y?
A) They are independent.
B) They are uncorrelated.
C) They are perfectly correlated.
D) They are identical.
3. What is the covariance of two random variables X and Y, Cov(X, Y)?
A) E[(X - E[X])(Y - E[Y])]
B) E[XY] - E[X]E[Y]
C) E[XY]
D) E[X]E[Y]
4. For independent random variables X and Y, what is Var(X + Y)?
A) Var(X) + Var(Y)
B) Var(X) + Var(Y) + 2Cov(X, Y)
C) Var(X) - Var(Y)
D) Var(X) * Var(Y)
5. Which property of random variables states that E[aX + b] = aE[X] + b for constants a and b?
A) Independence
B) Linearity of Expectation
C) Additivity of Variance
D) Symmetry
6. What is the median of a probability distribution?
A) The most frequent value.
B) The value that divides the probability distribution into two equal halves.
C) The expected value.
D) The range of the distribution.
7. What is the mode of a probability distribution?
A) The average value.
B) The value with the highest probability (for discrete) or highest density (for continuous).
C) The middle value when data is ordered.
D) The sum of all possible values.
8. In the context of random variables, what does it mean for X and Y to be identically distributed?
A) They are independent.
B) They have the same probability distribution.
C) They have the same expected value.
D) They have the same variance.
9. What is a Markov chain?
A) A stochastic process where the future state depends only on the present state, not on the past states.
B) A stochastic process with independent increments.
C) A deterministic process with no randomness.
D) A process that always returns to its initial state.
10. What is a stochastic process?
A) A fixed sequence of events.
B) A collection of random variables indexed by time or space.
C) A deterministic mathematical model.
D) A single random experiment.
11. What are marginal probabilities in the context of joint distributions?
A) Probabilities of the intersection of events.
B) Probabilities of individual random variables, obtained by summing or integrating the joint distribution.
C) Probabilities of the union of events.
D) Conditional probabilities.
12. What is a joint probability distribution?
A) The probability of a single random variable.
B) The probability of two or more random variables occurring simultaneously.
C) The conditional probability of one variable given another.
D) The marginal probability of a random variable.
13. What is the primary purpose of a probability distribution?
A) To calculate the exact value of a random variable.
B) To describe the likelihood of different possible outcomes for a random variable.
C) To prove theorems in mathematics.
D) To measure the physical properties of an object.
14. What does the Law of Large Numbers state?
A) The probability of an event is proportional to the number of favorable outcomes.
B) As the number of trials increases, the sample average converges to the expected value.
C) The variance of a sum of independent random variables is the sum of their variances.
D) The distribution of sample means tends towards normality.
15. Which theorem is fundamental to statistical inference and allows us to use normal distributions to approximate other distributions?
A) Law of Large Numbers
B) Bayes' Theorem
C) Central Limit Theorem
D) De Moivre-Laplace Theorem
16. What is the Central Limit Theorem (CLT)?
A) The sum of independent random variables is always normally distributed.
B) The distribution of the sample mean of sufficiently large samples will be approximately normally distributed, regardless of the population distribution.
C) The probability of an event approaches zero as the number of trials increases.
D) The variance of a sum of random variables is the sum of their variances.
17. If X ~ Poi(λ), what does 'λ' represent in the Poisson distribution?
A) The number of trials.
B) The probability of success.
C) The average rate of occurrence.
D) The standard deviation.
18. If X ~ B(n, p), what does 'n' represent in the Binomial distribution?
A) The probability of success.
B) The number of trials.
C) The expected number of successes.
D) The variance.
19. What is the key characteristic of a Bernoulli random variable?
A) It can take any real value.
B) It has only two possible outcomes: success (1) or failure (0).
C) It models the number of events in an interval.
D) Its distribution is symmetric.
20. The Exponential distribution is commonly used to model:
A) The number of successes in a fixed number of trials.
B) The time until the first success (or failure) in a series of Bernoulli trials.
C) The time between events in a Poisson process.
D) The sum of multiple dice rolls.
21. What are the parameters of a Normal Distribution?
A) n and p
B) lambda
C) mean (μ) and standard deviation (σ)
D) a and b
22. Which distribution is often called the 'bell curve' and is characterized by its mean and variance?
A) Binomial Distribution
B) Poisson Distribution
C) Uniform Distribution
D) Normal Distribution
23. The Poisson distribution is typically used to model:
A) The number of successes in a fixed number of trials.
B) The time between events in a Poisson process.
C) The number of events occurring in a fixed interval of time or space.
D) The sum of two independent random variables.
24. Which probability distribution is used to model the number of successes in a fixed number of independent Bernoulli trials?
A) Poisson Distribution
B) Exponential Distribution
C) Binomial Distribution
D) Normal Distribution
25. The standard deviation of a random variable is:
A) The square of the variance.
B) The square root of the variance.
C) The expected value.
D) The sum of probabilities.
26. What does the variance of a random variable measure?
A) The central tendency of the distribution.
B) The spread or dispersion of the values around the expected value.
C) The probability of the most likely outcome.
D) The sum of all possible outcomes.
27. How is the expected value of a discrete random variable calculated?
A) Sum of all possible values.
B) Sum of (value * probability of value).
C) Average of the probabilities.
D) Square root of the sum of squared values.
28. What is the expected value of a random variable X, denoted E[X]?
A) The average value of X over an infinite number of trials.
B) The most probable value of X.
C) The square root of the variance of X.
D) The median of the distribution of X.
29. For a continuous random variable, what is the probability of it taking on a specific single value?
A) 1
B) 0.5
C) 0
D) Undefined
30. What is the cumulative distribution function (CDF), F(x), for a random variable X?
A) F(x) = P(X >= x)
B) F(x) = P(X = x)
C) F(x) = P(X <= x)
D) F(x) = P(X > x)
31. What is the probability density function (PDF) used for?
A) Discrete random variables.
B) Continuous random variables.
C) The variance of a random variable.
D) The cumulative distribution function.
32. What is the probability mass function (PMF) used for?
A) Continuous random variables.
B) Discrete random variables.
C) Both discrete and continuous random variables.
D) The expected value of a random variable.
33. Which of the following is an example of a continuous random variable?
A) The number of cars passing a point in an hour.
B) The number of defective items in a batch.
C) The speed of a car.
D) The outcome of a dice roll.
34. Which of the following is an example of a discrete random variable?
A) The height of a person.
B) The temperature of a room.
C) The number of heads in 10 coin flips.
D) The time it takes for a light bulb to burn out.
35. What type of random variable can only take on a finite or countably infinite number of values?
A) Discrete Random Variable
B) Continuous Random Variable
C) Poisson Random Variable
D) Exponential Random Variable
36. What type of random variable can take on any value within a given range?
A) Discrete Random Variable
B) Continuous Random Variable
C) Bernoulli Random Variable
D) Binomial Random Variable
37. What is a random variable?
A) A variable whose value is a fixed number.
B) A variable whose value is determined by the outcome of a random phenomenon.
C) A variable that can only take integer values.
D) A variable representing the probability of an event.
38. When flipping a fair coin, what is the probability of getting heads?
A) 0
B) 0.5
C) 1
D) 1/4
39. When rolling a fair six-sided die, what is the probability of rolling a 4?
A) 1/6
B) 1/3
C) 1/2
D) 1
40. What is the probability of a certain event?
A) 1
B) 0.5
C) 0
D) Undefined
41. What is the probability of an impossible event?
A) 1
B) 0.5
C) 0
D) Undefined
42. An event is defined as:
A) The set of all possible outcomes.
B) A subset of the sample space.
C) A probability value between 0 and 1.
D) A random variable.
43. A sample space is defined as:
A) A single outcome of an experiment.
B) The set of all possible outcomes of an experiment.
C) An event that cannot occur.
D) The probability of an event occurring.
44. What is the conditional probability of event A given that event B has occurred, P(A|B)?
A) P(A ∩ B) / P(B)
B) P(A ∩ B) / P(A)
C) P(A) / P(A ∩ B)
D) P(B) / P(A ∩ B)
45. What is the probability of the union of two events A and B, P(A U B)?
A) P(A) + P(B)
B) P(A) * P(B)
C) P(A) + P(B) - P(A ∩ B)
D) P(A) + P(B) + P(A ∩ B)
46. If events A and B are independent, which relationship holds true?
A) P(A and B) = P(A) + P(B)
B) P(A and B) = P(A) * P(B)
C) P(A | B) = P(A) + P(B)
D) P(A | B) = 1
47. What does it mean for two events A and B to be mutually exclusive?
A) They can occur at the same time.
B) The occurrence of one event prevents the occurrence of the other.
C) The occurrence of one event does not affect the probability of the other.
D) They are independent events.
48. If P(A) denotes the probability of event A, what is the range of possible values for P(A)?
A) P(A) > 0
B) 0 < P(A) < 1
C) 0 <= P(A) <= 1
D) P(A) = 1
49. Which of the following is NOT a basic axiom of probability (Kolmogorov's axioms)?
A) The probability of any event is non-negative.
B) The probability of the sample space is 1.
C) The probability of the union of two mutually exclusive events is the sum of their probabilities.
D) The probability of an event is directly proportional to the number of favorable outcomes.
50. What is the fundamental concept of probability theory?
A) The study of deterministic events.
B) The quantification of uncertainty or chance.
C) The analysis of fixed, unchanging systems.
D) The measurement of physical constants.