Relationship with false positive/negative rates

Relationship with false positive/negative rates

Relationship with false positive/negative rates

On this page

The 2x2 Table - Truth vs. Test

2x2 Contingency Table for Diagnostic Test Evaluation

  • The 2x2 table is the foundation for calculating a test's accuracy against a gold standard "truth."
Disease PresentDisease Absent
Test PositiveTrue Positive (TP)False Positive (FP)
Test NegativeFalse Negative (FN)True Negative (TN)
-   $Sensitivity = \frac{TP}{TP + FN}$
-   Related Error: False Negative Rate ($1 - Sensitivity$)
  • Specificity: Ability to detect true absence of disease (True Negative Rate).
    • $Specificity = \frac{TN}{TN + FP}$
    • Related Error: False Positive Rate ($1 - Specificity$)

⭐ Increasing a test's cutoff threshold ↑ Specificity but ↓ Sensitivity. Lowering the cutoff has the opposite effect.

📌 Mnemonic: SPIN & SNOUT

  • A SPecific test, when Positive, rules IN disease.
  • A SNensitive test, when Negative, rules OUT disease.

Sensitivity & Specificity - SNOUT & SPIN

  • Sensitivity: Probability of a positive test in patients with the disease. Ability to correctly identify true positives (TP).

    • Formula: $Sensitivity = TP / (TP + FN)$
    • Related to False Negative Rate (FNR): $FNR = 1 - Sensitivity$.
    • 📌 SNOUT: A highly SeNsitive test, when Negative, rules OUT the disease.
  • Specificity: Probability of a negative test in patients without the disease. Ability to correctly identify true negatives (TN).

    • Formula: $Specificity = TN / (TN + FP)$
    • Related to False Positive Rate (FPR): $FPR = 1 - Specificity$.
    • 📌 SPIN: A highly SPecific test, when Positive, rules IN the disease.

2x2 Contingency Table for Diagnostic Test Evaluation

⭐ Increasing a test's cut-off value (making it harder to test positive) will increase specificity but decrease sensitivity. This is a fundamental trade-off visualized by the ROC curve.

The Inverse Relationship - Errors & ROC Curves

  • Sensitivity & False Negatives (FN): Inversely related.

    • Sensitivity = $1 - \text{False Negative Rate (FNR)}$.
    • A highly sensitive test, if negative, helps rule out a disease. 📌 SNOUT (SeNsitive test, Negative, rules OUT).
  • Specificity & False Positives (FP): Inversely related.

    • Specificity = $1 - \text{False Positive Rate (FPR)}$.
    • A highly specific test, if positive, helps rule in a disease. 📌 SPIN (Specific test, Positive, rules IN).
  • Receiver Operating Characteristic (ROC) Curve:

    • Plots Sensitivity (TPR) vs. 1 - Specificity (FPR) for various cut-off points.
    • Area Under the Curve (AUC) reflects test accuracy:
      • AUC = 1.0: Perfect test.
      • AUC = 0.5: No better than chance.

ROC curve: Sensitivity vs. 1-Specificity highlighted)

⭐ Adjusting a test's cut-off point creates a trade-off. Lowering the threshold to catch more cases (↑ True Positives) also increases false alarms (↑ False Positives). This results in ↑ Sensitivity but ↓ Specificity.

High-Yield Points - ⚡ Biggest Takeaways

  • Sensitivity is inversely related to the false-negative rate (FNR); a high sensitivity means a low FNR (Sensitivity = 1 − FNR).
  • Specificity is inversely related to the false-positive rate (FPR); a high specificity means a low FPR (Specificity = 1 − FPR).
  • The SNOUT mnemonic: a highly Sensitive test, when Negative, helps to rule OUT a disease.
  • The SPIN mnemonic: a highly Specific test, when Positive, helps to rule IN a disease.
  • Both are intrinsic properties of a diagnostic test and are not affected by disease prevalence.

Practice Questions: Relationship with false positive/negative rates

Test your understanding with these related questions

A scientist in Chicago is studying a new blood test to detect Ab to EBV with increased sensitivity and specificity. So far, her best attempt at creating such an exam reached 82% sensitivity and 88% specificity. She is hoping to increase these numbers by at least 2 percent for each value. After several years of work, she believes that she has actually managed to reach a sensitivity and specificity much greater than what she had originally hoped for. She travels to China to begin testing her newest blood test. She finds 2,000 patients who are willing to participate in her study. Of the 2,000 patients, 1,200 of them are known to be infected with EBV. The scientist tests these 1,200 patients' blood and finds that only 120 of them tested negative with her new exam. Of the patients who are known to be EBV-free, only 20 of them tested positive. Given these results, which of the following correlates with the exam's specificity?

1 of 5

Flashcards: Relationship with false positive/negative rates

1/10

_____ is the probability that when the disease is present, the test is positive

TAP TO REVEAL ANSWER

_____ is the probability that when the disease is present, the test is positive

Sensitivity

browseSpaceflip

Enjoying this lesson?

Get full access to all lessons, practice questions, and more.

Start Your Free Trial