Chebyshev's lemma, weak law of large numbers, central limit theorem for i.i.d. variables, standard errors - One Line Questions

1. What is the standard error of the sample proportion (p̂) in a large sample, assuming the population proportion is p? √(p(1-p)/n)
2. What is the standard error of the difference between two independent sample means (X̄₁ - X̄₂), assuming equal variances σ²? √(σ²/n₁ + σ²/n₂)
3. Chebyshev's lemma can be used to derive a bound for the error in approximating the population mean by the sample mean. If we want the probability of the sample mean being within ε of the population mean to be at least 0.9, what is the maximum possible value for σ/ε? 1/√10
4. Consider a random variable X with mean μ and standard deviation σ. According to Chebyshev's lemma, what is the maximum probability that X falls outside the interval (μ - 2σ, μ + 2σ)? 1/4
5. Consider a random variable X with mean μ. Chebyshev's inequality states P(|X - μ| ≥ k) ≤ Var(X)/k². If we set k = 3 and Var(X) = 9, what is the maximum probability that X is outside the interval (μ-3, μ+3)? 1/3
6. If we have a sample of size n = 100 from a population with standard deviation σ = 10, what is the standard error of the sample mean? 1
7. In Chebyshev's lemma, what does 'k' represent in the inequality P(|X - μ| ≥ kσ) ≤ 1/k²? A constant greater than 0
8. The Central Limit Theorem is often stated for the sum S_n = X₁ + X₂ + ... + Xn. As n becomes large, what distribution does S_n approximate? A normal distribution with mean nμ and variance nσ²
9. The concept of standard error is crucial for constructing confidence intervals. A wider confidence interval is associated with: A larger standard error
10. The Central Limit Theorem is often stated for sums of random variables. For a sum S_n = X₁ + ... + Xn of i.i.d. random variables with mean μ and variance σ², the standardized sum Z_n = (S_n - nμ) / (σ√n) converges in distribution to: A standard normal distribution
11. The Weak Law of Large Numbers guarantees convergence in probability. What is the key difference between convergence in probability and almost sure convergence? Almost sure convergence is a stronger form of convergence.
12. Which statistical concept is most directly related to the standard error of a statistic? Variance of the sampling distribution
13. When the population standard deviation (σ) is unknown, how is the standard error of the sample mean typically estimated? By using the sample standard deviation (s) in place of σ.
14. The CLT is powerful because it allows us to make inferences about population parameters using sample statistics, even when the population distribution is unknown. Which distribution is typically used for hypothesis testing and confidence intervals when the CLT applies? Normal distribution (or standard normal)
15. The Weak Law of Large Numbers (WLLN) states that under certain conditions, the sample mean converges to the population mean. In what sense does this convergence occur? Convergence in probability
16. The Strong Law of Large Numbers (SLLN) is a stronger result than the Weak Law of Large Numbers (WLLN). What type of convergence does the SLLN guarantee? Almost sure convergence
17. If a sample of size n is drawn from a population with mean μ and standard deviation σ, the standard error of the sample mean is: Directly proportional to σ
18. What are the typical conditions required for the Weak Law of Large Numbers to hold for a sequence of independent and identically distributed (i.i.d.) random variables? Finite mean
19. In the context of the Central Limit Theorem, what does 'i.i.d.' stand for? Independent and Identically Distributed
20. What is the role of the Central Limit Theorem in statistical inference? It allows us to approximate probabilities for sums/averages of random variables using the normal distribution.
21. Which of the following statements about standard error is FALSE? It is the same as the standard deviation of the population.
22. What is the primary implication of Chebyshev's lemma regarding the concentration of probability around the mean? It provides an upper bound on the probability of a value being far from the mean.
23. The Weak Law of Large Numbers implies that for a large sample, the sample mean is a 'good' estimator of the population mean. What does 'good' mean in this context? It is likely to be close to the population mean.
24. What is the standard error of a regression coefficient in linear regression? It measures the variability of the coefficient estimate across different samples.
25. The standard error of the sample mean is calculated as σ/√n. If the sample size is quadrupled, how does the standard error change? It is halved.
26. A common proof of the Weak Law of Large Numbers utilizes Chebyshev's inequality applied to the sample mean. What property of the sample mean is essential for this proof? Its variance is finite and decreases as n increases.
27. Chebyshev's lemma is particularly useful when the distribution of the random variable is: Unknown or non-normal
28. Mathematically, the Weak Law of Large Numbers states that for a sequence of i.i.d. random variables X₁, X₂, ..., Xn with E[Xᵢ] = μ and Var(Xᵢ) = σ², the sample mean X̄n converges in probability to μ. This is expressed as: lim (n→∞) P(|X̄n - μ| ≥ ε) = 0 for any ε > 0
29. Chebyshev's lemma is a general result. Compared to the actual distribution of the sum of random variables, the bound provided by Chebyshev's lemma is typically: Less precise
30. If the sample size is small, and the population standard deviation is unknown, which distribution is typically used for inference regarding the population mean? t-distribution
31. If X₁, X₂, ..., Xn are i.i.d. random variables with mean μ and variance σ², the distribution of the sample mean X̄n for large n is approximately: Normal with mean μ and variance σ²/n
32. Chebyshev's lemma provides a bound on the probability that a random variable deviates from its expected value. What is the form of this inequality? P(|X - μ| ≥ kσ) ≤ 1/k²
33. The Weak Law of Large Numbers is a fundamental result in probability theory because it justifies the use of sample averages to estimate population parameters. What does it imply about large samples? The sample average is likely to be close to the population mean.
34. Which of the following is a direct consequence of Chebyshev's lemma? The probability of a random variable being far from its mean is bounded.
35. The Central Limit Theorem allows us to approximate the sampling distribution of the sample mean with a normal distribution. This approximation improves as: The sample size increases
36. The standard error quantifies the variability of a sample statistic. For the sample mean, what does the standard error represent? The typical deviation of sample means from the population mean.
37. The Central Limit Theorem (CLT) is a cornerstone of statistics. What does the CLT state about the distribution of the sum or average of a large number of independent random variables? The sum/average will approach a normal distribution, regardless of the original distribution.
38. What is the primary condition under which the Central Limit Theorem applies to the sum of *non-identically* distributed random variables? The Lyapunov condition or Lindeberg condition must be met.
39. For the Central Limit Theorem to apply to a sequence of i.i.d. random variables X₁, X₂, ..., Xn, what is the crucial condition related to the individual variables? They must have finite variance.
40. Chebyshev's lemma provides a bound that is: Generally loose but universally applicable
41. The Weak Law of Large Numbers is essential for the concept of statistical estimation. It provides theoretical justification for: Using the sample mean to estimate the population mean.
42. The Weak Law of Large Numbers is a statement about the behavior of the sample mean as the sample size approaches infinity. It states that the sample mean converges to the population mean: In probability
43. If Z is a standard normal random variable, and X̄n is the sample mean of n i.i.d. random variables with mean μ and standard deviation σ, which of the following is approximately true for large n? X̄n ≈ μ + σZ/√n
44. Consider a sequence of random variables Xn such that E[Xn] = 0 for all n and Var(Xn) = 1/n. Does this sequence converge in probability to 0? Yes, by Chebyshev's inequality.
45. For the Weak Law of Large Numbers to hold, is it sufficient for the random variables to be independent but not identically distributed? No, they must also be identically distributed or satisfy certain moment conditions.
46. What is the mean of the sampling distribution of the sample mean X̄n, according to the Central Limit Theorem, for i.i.d. random variables with mean μ? μ
47. What is the standard error of the sample mean (X̄n)? σ / √n
48. What is the variance of the sampling distribution of the sample mean X̄n, according to the Central Limit Theorem, for i.i.d. random variables with variance σ²? σ²/n