Probability theory: concepts, distributions, moments and central limit theorem. - Question Bank

1. Which theorem is fundamental for statistical inference, allowing us to approximate complex distributions with the normal distribution for large samples?
A) Bayes' Theorem
B) Law of Large Numbers
C) Central Limit Theorem
D) De Moivre-Laplace Theorem
2. The concept of 'moments' in probability theory helps describe the shape of a distribution by quantifying:
A) Only the average value.
B) The central tendency, spread, skewness, and kurtosis.
C) The probability of any single outcome.
D) The total probability of all possible outcomes.
3. What is the 'Law of Large Numbers' related to probability theory?
A) The probability of an event approaches 0 as trials increase.
B) The average of the results obtained from a large number of trials should be close to the expected value.
C) The distribution of sample means always converges to a normal distribution.
D) The variance of a distribution increases with the number of trials.
4. The exponential distribution is often used to model:
A) The number of events in a fixed interval.
B) The time until the next event occurs in a Poisson process.
C) The sum of an infinite number of variables.
D) The outcome of a coin flip.
5. What is the primary characteristic of a continuous uniform distribution?
A) It has a single peak.
B) All outcomes within a given range are equally likely.
C) It is defined only for integer values.
D) It is skewed to the right.
6. Which distribution is commonly used to model the number of successes in a fixed number of trials, where each trial has only two outcomes?
A) Normal Distribution
B) Poisson Distribution
C) Binomial Distribution
D) Exponential Distribution
7. A distribution with high kurtosis (leptokurtic) tends to have:
A) Thin tails and a flat peak.
B) Heavy tails and a sharp peak.
C) No tails and a wide peak.
D) Uniform distribution of values.
8. If a distribution has a skewness of 0, it implies:
A) It is highly peaked.
B) It is symmetric.
C) It has heavy tails.
D) It is uniform.
9. Kurtosis measures the:
A) Symmetry of the distribution.
B) Spread of the distribution.
C) Peakedness and tail heaviness of the distribution.
D) Expected value of the distribution.
10. Skewness measures the:
A) Peakedness of the distribution.
B) Symmetry of the distribution.
C) Asymmetry or lack of symmetry of the distribution.
D) Average value of the distribution.
11. The second moment about the mean is:
A) The expected value.
B) The variance.
C) The standard deviation.
D) The mode.
12. The first moment about the origin of a random variable X is:
A) The variance.
B) The expected value E(X).
C) The standard deviation.
D) The probability density function.
13. Which of the following is NOT a moment of a probability distribution?
A) Mean (First moment about the origin)
B) Variance (Second moment about the mean)
C) Skewness (Third standardized moment)
D) Kurtosis (Fourth standardized moment)
14. The CLT is crucial in statistics because it allows us to:
A) Calculate probabilities for any distribution using sample data.
B) Make inferences about population parameters using sample statistics, even if the population distribution is unknown.
C) Determine the exact population distribution from a sample.
D) Avoid using probability theory altogether.
15. What is the minimum sample size generally considered 'sufficiently large' for the Central Limit Theorem to apply reasonably well?
A) 10
B) 15
C) 30
D) 100
16. According to the Central Limit Theorem, what is the standard deviation of the sampling distribution of the sample mean (also known as the standard error)?
A) Population standard deviation (σ).
B) Population variance (σ^2).
C) Population standard deviation divided by the square root of the sample size (σ/√n).
D) Population mean (μ).
17. According to the Central Limit Theorem, what is the mean of the sampling distribution of the sample mean?
A) Equal to the population standard deviation.
B) Equal to the population variance.
C) Equal to the population mean (μ).
D) Equal to 0.
18. The Central Limit Theorem (CLT) states that the distribution of the sample mean approaches a normal distribution:
A) Regardless of the population distribution, if the sample size is small.
B) If the population is normally distributed, regardless of sample size.
C) Regardless of the population distribution, if the sample size is sufficiently large.
D) Only if the population is uniformly distributed.
19. A standard Normal distribution has:
A) Mean = 1 and Variance = 1
B) Mean = 0 and Variance = 1
C) Mean = 0 and Standard Deviation = 1
D) Mean = 1 and Standard Deviation = 0
20. The shape of the Normal distribution is:
A) Skewed to the right
B) Skewed to the left
C) Bell-shaped and symmetric
D) Uniform
21. The Normal distribution is a continuous probability distribution that is symmetric around its mean and is characterized by two parameters:
A) n and p
B) lambda (λ)
C) Mean (μ) and Variance (σ^2)
D) Degrees of freedom
22. The Poisson distribution is often used to approximate the Binomial distribution when:
A) n is small and p is close to 1.
B) n is large and p is small.
C) n is small and p is small.
D) n is large and p is large.
23. The Poisson distribution is characterized by a single parameter, lambda (λ), which represents:
A) The number of trials.
B) The probability of success.
C) The average rate of occurrence of an event.
D) The variance of the distribution.
24. The Binomial distribution is suitable for modeling:
A) The number of events in a fixed interval of time or space.
B) The sum of two dice rolls.
C) The number of successes in a fixed number of independent Bernoulli trials.
D) The time until an event occurs.
25. Which distribution is characterized by two parameters: n (number of trials) and p (probability of success)?
A) Poisson distribution
B) Binomial distribution
C) Normal distribution
D) Exponential distribution
26. The standard deviation is:
A) The variance squared.
B) The square root of the variance.
C) The expected value.
D) The sum of squared deviations.
27. The variance is defined as:
A) E(X)
B) E(X^2)
C) E[(X - E(X))^2]
D) sqrt(E[(X - E(X))^2])
28. The variance of a random variable X, Var(X) or sigma^2, measures:
A) The central tendency of the distribution.
B) The spread or dispersion of the values around the mean.
C) The probability of the most likely outcome.
D) The sum of all possible outcomes.
29. For a discrete random variable X with PMF f(x), the expected value is calculated as:
A) Sum of all possible values of x.
B) Sum of x * f(x) over all possible x.
C) Integral of x * f(x) over the range of x.
D) The most frequent value of x.
30. The expected value of a random variable X, denoted E(X), is also known as the:
A) Variance
B) Standard Deviation
C) Mean or Average Value
D) Mode
31. Which of the following is a property of the CDF, F(x)?
A) It is always decreasing.
B) It ranges from -infinity to +infinity.
C) It is non-decreasing and ranges from 0 to 1.
D) It is always equal to 0.5.
32. The cumulative distribution function (CDF), F(x), represents:
A) The probability of X being exactly equal to x.
B) The probability of X being greater than x.
C) The probability of X being less than or equal to x, i.e., P(X <= x).
D) The probability density at x.
33. For a continuous random variable X, P(X = c) is always:
A) Greater than 0
B) Equal to the PDF at c
C) Equal to 0
D) Greater than 0.5
34. The probability density function (PDF) is associated with which type of random variable?
A) Discrete
B) Continuous
C) Both discrete and continuous
D) Independent
35. The probability mass function (PMF) is associated with which type of random variable?
A) Continuous
B) Discrete
C) Both discrete and continuous
D) Neither discrete nor continuous
36. A continuous random variable can take values that are:
A) Only specific, separate values.
B) Any value within a given interval or range.
C) A finite number of outcomes.
D) Mutually exclusive outcomes.
37. A discrete random variable can take values that are:
A) Any value within a given range.
B) Only integers.
C) A finite or countably infinite number of distinct values.
D) Continuous and non-measurable.
38. A random variable is a function that assigns:
A) A numerical value to each outcome of a random experiment.
B) An outcome to each possible numerical value.
C) A probability to each event.
D) A theoretical distribution to a dataset.
39. Bayes' Theorem relates conditional probabilities and is stated as:
A) P(A|B) = P(B|A) * P(A) / P(B)
B) P(A|B) = P(A) * P(B) / P(A and B)
C) P(A and B) = P(A) + P(B)
D) P(A or B) = P(A) * P(B)
40. The conditional probability P(A|B) is defined as:
A) P(A and B) / P(B)
B) P(B and A) / P(A)
C) P(A) * P(B)
D) P(A) + P(B)
41. If events A and B are independent, then:
A) P(A and B) = P(A) + P(B)
B) P(A and B) = P(A) * P(B)
C) P(A or B) = P(A) + P(B)
D) P(A | B) = 0
42. Two events A and B are considered mutually exclusive if:
A) The occurrence of A implies the occurrence of B.
B) The occurrence of B implies the occurrence of A.
C) They cannot occur at the same time; P(A and B) = 0.
D) The occurrence of A does not affect the probability of B.
43. What is the probability of a certain event?
A) 0
B) 0.5
C) 1
D) Undefined
44. What is the probability of an impossible event?
A) 1
B) 0.5
C) 0
D) Undefined
45. If P(A) denotes the probability of event A, which of the following is always true?
A) P(A) < 0
B) P(A) = 1
C) 0 <= P(A) <= 1
D) P(A) > 1
46. What is the sample space of a random experiment?
A) A single outcome that is most likely to occur.
B) The set of all possible outcomes of the experiment.
C) The probability of a specific event occurring.
D) A subset of the outcomes that defines an event.
47. In probability theory, an 'event' refers to:
A) A single outcome of a random experiment.
B) A collection of outcomes of a random experiment.
C) The entire set of all possible outcomes.
D) A statement that is either true or false.
48. What is the fundamental concept of probability theory?
A) The study of certainty and absolute truth.
B) The quantification and study of randomness and uncertainty.
C) The analysis of deterministic systems and predictable outcomes.
D) The exploration of philosophical paradoxes and logical fallacies.
All Question Banks
E-Book Probability theory: concepts, distributions, moments and central limit theorem. One Line Questions Probability theory: concepts, distributions, moments and central limit theorem. Online Test Probability theory: concepts, distributions, moments and central limit theorem.