Chebyshev's lemma, weak law of large numbers, central limit theorem for i.i.d. variables, standard errors - Question Bank
1. The Weak Law of Large Numbers is a statement about the behavior of the sample mean as the sample size approaches infinity. It states that the sample mean converges to the population mean:
2. Which of the following is a direct consequence of Chebyshev's lemma?
3. The Central Limit Theorem allows us to approximate the sampling distribution of the sample mean with a normal distribution. This approximation improves as:
4. What is the standard error of the difference between two independent sample means (X̄₁ - X̄₂), assuming equal variances σ²?
5. If X₁, X₂, ..., Xn are i.i.d. random variables with mean μ and variance σ², the distribution of the sample mean X̄n for large n is approximately:
6. The Weak Law of Large Numbers is essential for the concept of statistical estimation. It provides theoretical justification for:
7. Chebyshev's lemma is a general result. Compared to the actual distribution of the sum of random variables, the bound provided by Chebyshev's lemma is typically:
8. The standard error of the sample mean is calculated as σ/√n. If the sample size is quadrupled, how does the standard error change?
9. If the sample size is small, and the population standard deviation is unknown, which distribution is typically used for inference regarding the population mean?
10. What is the primary condition under which the Central Limit Theorem applies to the sum of *non-identically* distributed random variables?
11. The Weak Law of Large Numbers implies that for a large sample, the sample mean is a 'good' estimator of the population mean. What does 'good' mean in this context?
12. Consider a random variable X with mean μ. Chebyshev's inequality states P(|X - μ| ≥ k) ≤ Var(X)/k². If we set k = 3 and Var(X) = 9, what is the maximum probability that X is outside the interval (μ-3, μ+3)?
13. Which of the following statements about standard error is FALSE?
14. If a sample of size n is drawn from a population with mean μ and standard deviation σ, the standard error of the sample mean is:
15. What is the role of the Central Limit Theorem in statistical inference?
16. For the Weak Law of Large Numbers to hold, is it sufficient for the random variables to be independent but not identically distributed?
17. The Strong Law of Large Numbers (SLLN) is a stronger result than the Weak Law of Large Numbers (WLLN). What type of convergence does the SLLN guarantee?
18. Chebyshev's lemma provides a bound that is:
19. In the context of the Central Limit Theorem, what does 'i.i.d.' stand for?
20. What is the standard error of a regression coefficient in linear regression?
21. If Z is a standard normal random variable, and X̄n is the sample mean of n i.i.d. random variables with mean μ and standard deviation σ, which of the following is approximately true for large n?
22. The Central Limit Theorem is often stated for sums of random variables. For a sum S_n = X₁ + ... + Xn of i.i.d. random variables with mean μ and variance σ², the standardized sum Z_n = (S_n - nμ) / (σ√n) converges in distribution to:
23. Consider a sequence of random variables Xn such that E[Xn] = 0 for all n and Var(Xn) = 1/n. Does this sequence converge in probability to 0?
24. The Weak Law of Large Numbers guarantees convergence in probability. What is the key difference between convergence in probability and almost sure convergence?
25. Chebyshev's lemma can be used to derive a bound for the error in approximating the population mean by the sample mean. If we want the probability of the sample mean being within ε of the population mean to be at least 0.9, what is the maximum possible value for σ/ε?
26. Which statistical concept is most directly related to the standard error of a statistic?
27. The concept of standard error is crucial for constructing confidence intervals. A wider confidence interval is associated with:
28. What is the standard error of the sample proportion (p̂) in a large sample, assuming the population proportion is p?
29. If we have a sample of size n = 100 from a population with standard deviation σ = 10, what is the standard error of the sample mean?
30. When the population standard deviation (σ) is unknown, how is the standard error of the sample mean typically estimated?
31. The standard error quantifies the variability of a sample statistic. For the sample mean, what does the standard error represent?
32. What is the standard error of the sample mean (X̄n)?
33. The CLT is powerful because it allows us to make inferences about population parameters using sample statistics, even when the population distribution is unknown. Which distribution is typically used for hypothesis testing and confidence intervals when the CLT applies?
34. The Central Limit Theorem is often stated for the sum S_n = X₁ + X₂ + ... + Xn. As n becomes large, what distribution does S_n approximate?
35. What is the variance of the sampling distribution of the sample mean X̄n, according to the Central Limit Theorem, for i.i.d. random variables with variance σ²?
36. What is the mean of the sampling distribution of the sample mean X̄n, according to the Central Limit Theorem, for i.i.d. random variables with mean μ?
37. For the Central Limit Theorem to apply to a sequence of i.i.d. random variables X₁, X₂, ..., Xn, what is the crucial condition related to the individual variables?
38. The Central Limit Theorem (CLT) is a cornerstone of statistics. What does the CLT state about the distribution of the sum or average of a large number of independent random variables?
39. A common proof of the Weak Law of Large Numbers utilizes Chebyshev's inequality applied to the sample mean. What property of the sample mean is essential for this proof?
40. The Weak Law of Large Numbers is a fundamental result in probability theory because it justifies the use of sample averages to estimate population parameters. What does it imply about large samples?
41. Mathematically, the Weak Law of Large Numbers states that for a sequence of i.i.d. random variables X₁, X₂, ..., Xn with E[Xᵢ] = μ and Var(Xᵢ) = σ², the sample mean X̄n converges in probability to μ. This is expressed as:
42. What are the typical conditions required for the Weak Law of Large Numbers to hold for a sequence of independent and identically distributed (i.i.d.) random variables?
43. The Weak Law of Large Numbers (WLLN) states that under certain conditions, the sample mean converges to the population mean. In what sense does this convergence occur?
44. Consider a random variable X with mean μ and standard deviation σ. According to Chebyshev's lemma, what is the maximum probability that X falls outside the interval (μ - 2σ, μ + 2σ)?
45. Chebyshev's lemma is particularly useful when the distribution of the random variable is:
46. What is the primary implication of Chebyshev's lemma regarding the concentration of probability around the mean?
47. In Chebyshev's lemma, what does 'k' represent in the inequality P(|X - μ| ≥ kσ) ≤ 1/k²?
48. Chebyshev's lemma provides a bound on the probability that a random variable deviates from its expected value. What is the form of this inequality?