One-Sample t-Test and Confidence Interval with Dot Chart in Small Samples
One-Sample t-Test and Confidence Interval with Dot Chart in Small Samples
The dot chart represents a random sample of size from a normal distribution, shown in blue, with mean +δ and standard deviation . This is the true distribution. This Demonstration focuses on the null hypothesis, : . For hypothesis testing, it is assumed that the sample is from a normal population with unknown mean and unknown variance. The hypothetical distribution, , is shown in green. When , the null distribution and true distribution are the same, but otherwise they are different.
n=9
μ
0
σ
H
0
μ=
μ
0
N(,σ)
μ
0
δ=0
The gray curve shows the sampling distribution. The two-sided confidence interval based on the random sample is shown below with . The confidence interval is colored red, to indicate that the hypothesized mean is not included in the interval; otherwise the color is blue. So when , this confidence interval will be blue about of the time and for larger this happens less frequently.
(1-α)
%
α=0.05
μ
0
δ=0
100(1-α)%
|δ|
The observed two-sided -value is shown at the top.
p
By using the "random seed" slider, we can see that the -values are random and depend on the random sample. The location and width of the confidence interval as well as the sampling distribution also vary and depend on the random sample. Both of these widths tend to decrease as the sample size increases but there is considerable variation due to random sampling. Similarly, when is increased or decreased the width of the confidence interval tends to increase or decrease.
p
α
The sample mean is represented by the thin magenta line extending from the midpoint of the confidence interval to the center value of the sampling density.
The width of the confidence tends to increase if is decreased, although due to the small samples there is a large variation simply due to random sampling. This is noticeable by changing the random seed.
α
The confidence interval also tends to increase if the sample size is decreased as does the width of the sampling distribution. Due to the small samples, there are large variations in the width of the confidence interval and sampling distribution.
n
Details
Details
We focus on small samples, to avoid resizing and thus distorting the graphic, which is an important consideration for dynamic plots.
n=3,…,12
Snapshot 1: A new sample with instead of . The width of the confidence interval is slightly larger than in the thumbnail as might be expected. But click the "random seed" slider "+" button and then click the play button to see there is considerable variation in the size of the confidence interval. This is because the t-test is used. If a test were used, the width of the confidence interval would only depend on and and not on the actual data.
n=12
n=9
Z
n
α
Snapshot 2: Same setting as snapshot 1 but a new sample. Notice the sampling distribution has changed and is not quite so centered over the true distribution. In this case, the confidence interval is actually wider than snapshot 1 and even wider than the case when . This is due to randomness.
n=9
Snapshot 3: This scenario provides a teaching simulation. The instructor might say, "I think the average height of men in this class is about 5.5 feet". The null distribution with = is shown. The dot chart shows the results of a simulated sample of size 3. In this case, all the observations are greater than .
μ
0
′
5.5
μ
0
Snapshot 4: The 95% confidence and the -value are now shown. The 95% confidence interval includes and the -value is 0.1888 so there is evidence against finding could easily be due to chance. We have used a two-sided test, which is more conservative than one-sided alternatives. In general, as recommended in[1] §1.8, one-sided tests may, in actual practice, too easily result in spurious findings and so are not recommended.
p
μ
0
p
H
0
Snapshot 5: Increasing the size of sample to provides strong evidence that is not true.
n=8
H
0
Snapshot 6: Let and denote the probability of a type II error and power, respectively. The power curve, versus , for the two-sample t-test when and is shown. By symmetry, the curve is only shown for . Green is used to indicate the power at the set value of , in this case . In planned experiments, usually a minimum power of 90% is desired and the green lines indicate the size of needed to attain 90% power. So from the plot we see that , and that to achieve 90% we would need . Another way 90% could be achieved is by increasing the sample size . Slide up to 12 and you see that we can attain about 90% with . The computation of power in the one-sample t-test is discussed in many textbooks (see also Noncentral t-distribution). To exit the power curve display, uncheck the checkbox.
β
1-β
1-β
δ/σ
n=8
α=0.05
δ/σ≥0
δ
δ/σ=1
δ/σ
δ/σ=1
1-β≈0.68
δ/σ=1.35
n
n
n=12
Snapshot 7: When is selected, we can explore how the t-test behaves when the null hypothesis is true. In this case the -value is uniformly distributed between 0 and 1. When the "random seed" slider is changed, fresh -values and confidence intervals are generated. If is increased, the -values are still random but tend to be smaller reflecting the fact that becomes less tenable.
δ=0
p
p
δ
p
H
0
Snapshot 8: Similar to snapshot 7, but we just show the true distribution and the sampling distribution and ignore the hypothesis testing.
Many other scenarios that offer illuminating insights may be obtained by experimenting with other settings.
References
References
[1] G. van Belle, Statistical Rules of Thumb, 2nd ed., New York: Wiley, 2008.
External Links
External Links
Permanent Citation
Permanent Citation
Douglas Woolford, Ian McLeod
"One-Sample t-Test and Confidence Interval with Dot Chart in Small Samples"
http://demonstrations.wolfram.com/OneSampleTTestAndConfidenceIntervalWithDotChartInSmallSample/
Wolfram Demonstrations Project
Published: August 30, 2011