ROC curves — MCQs

A researcher is trying to determine whether a newly discovered substance X can be useful in promoting wound healing after surgery. She conducts this study by enrolling the next 100 patients that will be undergoing this surgery and separating them into 2 groups. She decides which patient will be in which group by using a random number generator. Subsequently, she prepares 1 set of syringes with the novel substance X and 1 set of syringes with a saline control. Both of these sets of syringes are unlabeled and the substances inside cannot be distinguished. She gives the surgeon performing the surgery 1 of the syringes and does not inform him nor the patient which syringe was used. After the study is complete, she analyzes all the data that was collected and performs statistical analysis. This study most likely provides which level of evidence for use of substance X?

A scientist in Boston is studying a new blood test to detect Ab to the parainfluenza virus with increased sensitivity and specificity. So far, her best attempt at creating such an exam reached 82% sensitivity and 88% specificity. She is hoping to increase these numbers by at least 2 percent for each value. After several years of work, she believes that she has actually managed to reach a sensitivity and specificity even greater than what she had originally hoped for. She travels to South America to begin testing her newest blood test. She finds 2,000 patients who are willing to participate in her study. Of the 2,000 patients, 1,200 of them are known to be infected with the parainfluenza virus. The scientist tests these 1,200 patients’ blood and finds that only 120 of them tested negative with her new test. Of the following options, which describes the sensitivity of the test?

An investigator is measuring the blood calcium level in a sample of female cross country runners and a control group of sedentary females. If she would like to compare the means of the two groups, which statistical test should she use?

A 27-year-old man interested in pre-exposure therapy for HIV (PrEP) is being evaluated to qualify for a PrEP study. In order to qualify, patients must be HIV- and hepatitis B- and C-negative. Any other sexually transmitted infections require treatment prior to initiation of PrEP. The medical history is positive for a prior syphilis infection and bipolar affective disorder, for which he takes lithium. On his next visit, the liver and renal enzymes are within normal ranges. HIV and hepatitis B and C tests are negative. Which of the following about the HIV test is true?

A pharmaceutical corporation is developing a research study to evaluate a novel blood test to screen for breast cancer. They enrolled 800 patients in the study, half of which have breast cancer. The remaining enrolled patients are age-matched controls who do not have the disease. Of those in the diseased arm, 330 are found positive for the test. Of the patients in the control arm, only 30 are found positive. What is this test’s sensitivity?

In 2013 the national mean score on the USMLE Step 1 exam was 227 with a standard deviation of 22. Assuming that the scores for 15,000 people follow a normal distribution, approximately how many students scored above the mean but below 250?

A 28-year-old male presents to his primary care physician with complaints of intermittent abdominal pain and alternating bouts of constipation and diarrhea. His medical chart is not significant for any past medical problems or prior surgeries. He is not prescribed any current medications. Which of the following questions would be the most useful next question in eliciting further history from this patient?

You are reviewing raw data from a research study performed at your medical center examining the effectiveness of a novel AIDS screening examination. The study enrolled 250 patients with confirmed AIDS, and 240 of these patients demonstrated a positive screening examination. The control arm of the study enrolled 250 patients who do not have AIDS, and only 5 of these patients tested positive on the novel screening examination. What is the NPV of this novel test?

A pharmaceutical company develops a sequential testing protocol for a rare genetic disorder (prevalence 0.01%). Initial screening test has sensitivity 95% and specificity 90%. Positive results undergo confirmatory testing with sensitivity 99% and specificity 99.5%. The company claims this approach achieves PPV >80% for the final positive result. Evaluate this claim and the rationale for sequential testing in this context.

A hospital system is implementing a sepsis screening algorithm using clinical criteria with sensitivity of 92% and specificity of 75%. False positives result in unnecessary antibiotics, cultures, and ICU evaluations costing $3,000 per case. Missing true sepsis cases (false negatives) results in average increased mortality and morbidity costs of $50,000 per case. Hospital sepsis prevalence is 8%. Evaluate the optimal threshold adjustment strategy.