A randomized control double-blind study is conducted on the efficacy of 2 sulfonylureas. The study concluded that medication 1 was more efficacious in lowering fasting blood glucose than medication 2 (p ≤ 0.05; 95% CI: 14 [10-21]). Which of the following is true regarding a 95% confidence interval (CI)?

If the same study were repeated multiple times, approximately 95% of the calculated confidence intervals would contain the true population parameter.

The 95% confidence interval is the probability chosen by the researcher to be the threshold of statistical significance.

When a 95% CI for the estimated difference between groups contains the value ‘0’, the results are significant.

It represents the probability that chance would not produce the difference shown, 95% of the time.

The study is adequately powered at the 95% confidence interval.

The mean, median, and mode weight of 37 newborns in a hospital nursery is 7 lbs 2 oz. In fact, there are 7 infants in the nursery that weigh exactly 7 lbs 2 oz. The standard deviation of the weights is 2 oz. The weights follow a normal distribution. A newborn delivered at 10 lbs 2 oz is added to the data set. What is most likely to happen to the mean, median, and mode with the addition of this new data point?

The mean will increase; the median will stay the same; the mode will stay the same

The mean will increase; the median will increase; the mode will stay the same

The mean will stay the same; the median will increase; the mode will stay the same

The mean will increase; the median will increase; the mode will increase

The mean will stay the same; the median will increase; the mode will increase

Two research groups independently study the same genetic variant's association with diabetes. Study A (n=5,000) reports OR=1.25, 95% CI: 1.05-1.48, p=0.01. Study B (n=50,000) reports OR=1.08, 95% CI: 1.02-1.14, p=0.006. Both studies are methodologically sound. Synthesize these findings to determine the most likely true effect and evaluate implications for clinical and research interpretation.

The true effect is likely modest (closer to Study B's estimate); Study A likely overestimated due to smaller sample size, but both show statistical significance with clinically marginal effects

Study B is definitive because of its larger sample size and should replace Study A's findings

The study with the lower p-value (Study B) is automatically more reliable

The studies are contradictory and no conclusions can be drawn

Study A is correct because it was published first

A prestigious journal publishes a trial showing a new cancer drug extends survival by 2 months (p=0.001, 95% CI: 1.5-2.5 months). The drug costs $150,000 per patient and causes Grade 3-4 toxicity in 60% of patients. Three prior unpublished trials showed non-significant results (all p>0.20). Synthesize these findings to evaluate the evidence base.

This pattern suggests publication bias; the significant result may be a false positive among multiple trials, and the modest benefit must be weighed against substantial toxicity and cost

The confidence interval proves the drug should be standard of care

P-values below 0.01 override concerns about prior negative studies

The published study's highly significant p-value validates the drug's efficacy

The three unpublished trials are irrelevant to evaluating the published study

A pharmaceutical company conducts 20 different analyses on their trial data, testing for effects on various secondary outcomes. One analysis shows a significant benefit (p=0.03) on hospital readmission rates. The primary outcome (mortality) showed p=0.12. The company seeks FDA approval based on the readmission data. Evaluate the validity and implications of this approach.

This represents multiple testing without correction, inflating Type I error; the significant result may be due to chance and selective reporting

Secondary outcomes are more important than primary outcomes when significant

The p=0.03 result is valid and supports approval regardless of the primary outcome

Any p<0.05 in a clinical trial justifies approval

The mortality p-value of 0.12 is close enough to significance to support both findings

Relationship between CIs and hypothesis testing for USMLE Step 3: High-Yield Biostatistics Lessons

CIs & Hypothesis Testing - The Significance Rule

Core Principle: A 95% Confidence Interval (CI) provides a range of plausible values for a true population parameter.
- If the 95% CI for a measure of association excludes the null value, the result is statistically significant (p < 0.05).
- If the 95% CI includes the null value, the result is not statistically significant (p ≥ 0.05).

Metric	Null Value (No Effect)	Interpretation of 95% CI that Excludes Null
Difference in Means	0	The means of the two groups are significantly different.
Odds Ratio (OR)	1	There is a significant association between exposure and outcome.
Relative Risk (RR)	1	There is a significant association between exposure and outcome.

CI Advantages - Precision & Clinical Context

More than a p-value: CIs provide the direction, strength, and precision of an effect.
- Effect Size & Direction: The range of values within the CI indicates the plausible magnitude of the true effect.
- Precision: The width of the CI reflects the level of uncertainty.
  - Narrow CI: High precision (often from a large sample size).
  - Wide CI: Low precision (often from a small sample size).
📌 Mnemonic: A NARROW CI is the ARROW that points precisely to the truth.

Confidence intervals for TV watching in UK vs USA

Clinical Interpretation Flowchart:

⭐ A statistically significant result (e.g., p=0.04) with a very wide CI that ranges from a trivial to a large effect may not be clinically significant due to the imprecision of the estimate.

High‑Yield Points - ⚡ Biggest Takeaways

If a 95% CI includes the null value, the result is not statistically significant (p > 0.05).

The null value is 0 for a mean difference and 1 for an odds ratio (OR) or relative risk (RR).

If a 95% CI excludes the null value, the result is statistically significant (p < 0.05).

Wider CIs indicate lower precision; narrower CIs suggest higher precision.

Increasing sample size narrows the CI, increasing precision.

Continue reading on Oncourse

CONTINUE READING — FREE

or get the app

App Store|Google Play