A randomized control double-blind study is conducted on the efficacy of 2 sulfonylureas. The study concluded that medication 1 was more efficacious in lowering fasting blood glucose than medication 2 (p ≤ 0.05; 95% CI: 14 [10-21]). Which of the following is true regarding a 95% confidence interval (CI)?

If the same study were repeated multiple times, approximately 95% of the calculated confidence intervals would contain the true population parameter.

The 95% confidence interval is the probability chosen by the researcher to be the threshold of statistical significance.

When a 95% CI for the estimated difference between groups contains the value ‘0’, the results are significant.

It represents the probability that chance would not produce the difference shown, 95% of the time.

The study is adequately powered at the 95% confidence interval.

You submit a paper to a prestigious journal about the effects of coffee consumption on mesothelioma risk. The first reviewer lauds your clinical and scientific acumen, but expresses concern that your study does not have adequate statistical power. Statistical power refers to which of the following?

The probability of detecting an association when an association does exist.

The probability of detecting an association when no association exists.

The probability of not detecting an association when an association does exist.

The square root of the variance.

A pharmaceutical company reports a new antihypertensive drug reduces cardiovascular events with an NNT of 50 over 5 years based on a trial of 10,000 patients. An independent analysis reveals the benefit was driven entirely by a subgroup with resistant hypertension (20% of participants, NNT=15), while the remaining 80% showed no benefit over standard therapy (NNT approaching infinity). Evaluate the ethical and regulatory implications of reporting the overall NNT.

The overall NNT is misleading; approval should be restricted to resistant hypertension population where benefit is demonstrated

Conduct a new trial in the general hypertensive population to validate efficacy before broader approval

The subgroup analysis represents data dredging; only the overall NNT should be used for clinical decisions

The overall NNT of 50 is statistically valid and appropriate for regulatory approval and marketing

Report both overall and subgroup NNTs; allow clinicians to determine appropriate use based on patient characteristics

A public health agency must allocate a fixed budget between two interventions for diabetes prevention. Program A (intensive lifestyle modification): NNT=7, cost $3,500/person. Program B (metformin): NNT=14, cost $1,000/person. Both prevent one case of diabetes over 3 years. The budget allows treating 1,000 people with Program A or 3,500 people with Program B. Evaluate the optimal allocation strategy to maximize population health impact.

Choose based on cost per case prevented: Program A ($24,500) vs Program B ($14,000), favoring Program B

Choose Program B exclusively: higher population reach (3,500 vs 1,000) and lower cost per person treated maximizes prevention (250 cases) despite higher NNT

Allocate budget equally between programs: provides both high-efficacy and broad-reach approaches

Choose Program A for high-risk individuals and Program B for moderate-risk: risk-stratified approach optimizes NNT

Choose Program A exclusively: lower NNT means superior efficacy, preventing 143 cases versus 250 with Program B

A 45-year-old woman with a strong family history of breast cancer (lifetime risk 25%) is considering chemoprevention with tamoxifen. A trial shows tamoxifen reduces breast cancer incidence from 5% to 3% over 5 years in high-risk women, but increases endometrial cancer from 0.2% to 0.6% and thromboembolic events from 0.5% to 1.5%. Evaluate whether she should be recommended this therapy based on comprehensive risk-benefit analysis.

Recommend tamoxifen only if patient values breast cancer prevention significantly more than other risks, given similar absolute risk magnitudes

Recommend alternative screening strategies as chemoprevention shows no net benefit when all outcomes are considered

Recommend tamoxifen: NNT=50 for breast cancer prevention outweighs combined NNH=250 for endometrial cancer and NNH=100 for thromboembolism

Insufficient data to make recommendation without knowing patient's personal values and quality-of-life preferences

Recommend against tamoxifen: The harms (2 complications per 100 treated) outweigh benefits (2 cancers prevented per 100 treated)

Confidence intervals for NNT/NNH for USMLE Step 3: High-Yield Biostatistics Lessons

Confidence intervals for NNT/NNH - Precision & Significance

The 95% Confidence Interval (CI) for an NNT or NNH indicates the precision of the point estimate. A narrow CI implies a precise estimate; a wide CI suggests more uncertainty.
Calculation: The CI for NNT/NNH is the reciprocal of the CI for the Absolute Risk Reduction (ARR) or Absolute Risk Increase (ARI).
- Formula: $CI_{NNT} = [1/CI_{upper}(ARR), 1/CI_{lower}(ARR)]$.
- Note the endpoints are inverted, which can be counter-intuitive.
Interpretation of Significance:
- The key is whether the CI for the ARR/ARI crosses 0.
- If the CI for ARR/ARI contains 0, the corresponding CI for NNT/NNH will span to infinity (∞).
- An NNT/NNH confidence interval that contains ∞ is not statistically significant.

⭐ If a single 95% CI for an outcome measure contains values for both benefit (NNT) and harm (NNH), it means the underlying CI for ARR/ARI crossed zero. The result is therefore not statistically significant, and we cannot be confident if the intervention is helpful, harmful, or has no effect.

Death risk confidence intervals for APSAC and Heparin

Interpretation Algorithm - Decoding the Data

Step 1: Start with the CI for Risk Difference.
- The CI for NNT/NNH is the reciprocal of the CI for the Absolute Risk Reduction (ARR) or Absolute Risk Increase (ARI).
- First, calculate the CI for the risk difference (e.g., 95% CI for ARR is 0.05 to 0.15).
- Then, invert the bounds to find the CI for NNT:
  - $CI_{NNT} = [1/ARR_{upper}, 1/ARR_{lower}]$
Step 2: Check for Statistical Significance.
- The key question: Does the CI for ARR/ARI cross 0?
  - No (Significant): The effect is real. The CI for NNT/NNH will be a simple range of positive numbers (e.g., NNT of 7 to 20).
  - Yes (Not Significant): The effect is not statistically significant. The CI for NNT/NNH becomes discontinuous.
Step 3: Interpret the NNT/NNH CI.

⭐ When a 95% CI for an effect includes values for both benefit and harm (e.g., NNT of 10 to NNH of 15), it means the CI for the underlying risk difference crossed zero. This renders the result statistically non-significant, and we cannot be confident if the intervention helps or hurts.

High‑Yield Points - ⚡ Biggest Takeaways

The 95% CI for NNT/NNH is the reciprocal of the 95% CI for the ARR/ARI.

If the CI for the risk difference (ARR/ARI) crosses zero, the NNT/NNH's CI will include infinity.

An NNT/NNH CI that includes infinity is not statistically significant.

This implies the true effect could range from benefit to harm.

A wide CI indicates poor precision of the NNT/NNH point estimate.

Continue reading on Oncourse

CONTINUE READING — FREE

or get the app

App Store|Google Play