Weakening with missing cases and bad data

Weakening with missing cases and bad data

Published September 28, 2026

Weakening with missing cases and bad data

On this page

Find the Missing Case: Put the Claimed Arrow Under Pressure

“Why doesn’t this example prove the cause?” The fastest answer is a case the argument cannot explain.

First, state the argument’s causal claim:

Cause → Effect

Then search in two directions:

  • Cause and not Effect: the alleged cause occurred, but the predicted result did not.
  • Effect and not Cause: the result occurred even though the alleged cause was absent.

These are not automatically decisive. One exception may barely affect a claim such as “usually causes.” Ask whether the exception is large, comparable, and reliably recorded.

For a claim that a medication prevents migraines, these are the pressure points:

  • Many patients took the medication and still suffered migraines.
  • Many patients suffered migraines without taking the medication.

The first attacks the medication’s ability to prevent the effect; the second shows the effect can occur without the cause. If the argument says the medication eliminates migraines, even one well-established counterexample may be devastating. If it says the medication reduces migraines, look for a meaningful pattern, not merely an exception.

When evaluating an answer choice, run three checks:

  1. Does it identify the cause and effect correctly?
  2. Does it supply the missing combination-cause with no effect, or effect with no cause?
  3. Is the case large or representative enough to matter?

A choice saying “some people disagreed” is not enough. One identifying many comparable failures pressures the causal claim.

Audit the Numbers: A Rate Can Be Correctly Calculated and Still Mislead

When an answer attacks data, audit what was counted before judging the conclusion.

Check the unit first. Are the numbers people, accidents, households, purchases, or accidents per driver? Then check the denominator. A raw count can fall while the rate rises if the population shrinks. Next check whether the groups were measured in the same way: same definitions, time period, reporting rules, and inclusion criteria.

Also inspect collection. A study can exclude dropouts or people who never returned for measurement. It can rely on self-reports for one group and official records for another. It can report an average that conceals a different distribution. These defects matter because the apparent effect may come from measurement rather than the alleged cause.

Use this sequence:

  1. Write down the comparison the argument uses.
  2. Name its numerator and denominator.
  3. Ask whether the groups contain the same kinds of cases.
  4. Ask whether “success,” “failure,” or the effect was recorded consistently.
  5. Recalculate or reframe the comparison if necessary.

A bad statistic weakens most when correcting the defect removes the apparent improvement or reverses it. A choice saying the sample was “small” may tempt you, but size alone is not fatal if the sample is representative and the pattern is large. A choice showing relevant cases were counted differently attacks the evidence at its foundation.

One Audit in Action: Reject the Attractive Percentage

A delivery company required its drivers to complete a new safety course. In the year before the course, the company recorded 12 crashes among 100 drivers. In the year after the course, it recorded 10 crashes among 100 drivers who had completed the course. The company concluded that the course reduced crashes.

Practice

Which one of the following, if true, most seriously weakens the company’s conclusion?

High-Yield Points - ⚡ Biggest Takeaways

Search for cause-without-effect or effect-without-cause cases. Audit the numerator, denominator, definitions, and included cases before trusting a statistic. Prefer a data flaw that removes the apparent difference over a vague alternative explanation.

Unlock the full lesson and continue reading

Signup to continue reading this lesson and unlimited access questions, flashcards, AI notes, and more

Scan to download app

Scan to download
UNLOCK FREE ACCESS

Practice Questions: Weakening with missing cases and bad data

  1. 1. Operations manager: During the past year, teams that used a written agenda for every weekly meeting completed projects an average of five days sooner than teams that did not. The agendas themselves therefore account for the difference. Consequently, requiring every team to use a written agenda will reduce the organization’s average project-completion time. Which one of the following is an assumption on which the operations manager’s argument depends?

    • A. Teams currently using written agendas do not miss any deadlines.
    • B. Teams using written agendas were not already faster for reasons independent of the agendas.
    • C. No other change in meeting practices can shorten a team’s project time.
    • D. Teams using and not using written agendas have exactly the same number of employees.
    • E. Shorter project times are more valuable than allowing teams to choose their meeting practices.
    Show answer

    Answer: B. Teams using written agendas were not already faster for reasons independent of the agendas.

    Teams using written agendas were not already faster for reasons independent of the agendas. - The manager attributes the five-day difference to written agendas, so the argument depends on ruling out an independent reason agenda-using teams were faster. - If those teams were already faster for other reasons, the observed difference would not establish that requiring agendas will reduce average project-completion time. Teams currently using written agendas do not miss any deadlines. - The evidence compares average completion times, not whether teams meet deadlines. - Agenda-using teams could miss deadlines and still finish projects five days sooner on average. No other change in meeting practices can shorten a team’s project time. - The prediction requires agendas to shorten project times, not to be the only practice capable of doing so. - Another effective meeting practice would not, by itself, explain away the observed difference. Teams using and not using written agendas have exactly the same number of employees. - Exact equality in team size is unnecessary for agendas to account for the difference. - Unequal team sizes would matter only if they offered an independent explanation for the faster completions. Shorter project times are more valuable than allowing teams to choose their meeting practices. - The conclusion predicts an effect on completion time, not that the policy is worth adopting. - Teams could value autonomy more highly even if requiring agendas would shorten projects.

  2. 2. Production supervisor: Last year our factory produced 20,000 appliances, 4 percent of which were defective. This year only 3 percent of the appliances produced were defective. Therefore, the factory produced fewer defective appliances this year than it did last year. Which one of the following, if assumed, enables the production supervisor's conclusion to be properly drawn?

    • A. The factory's average sale price per appliance was the same in both years.
    • B. The factory sold fewer appliances this year than it sold last year.
    • C. The factory produced at least 10 percent more appliances this year than last year.
    • D. The factory produced no more than 25,000 appliances this year.
    • E. Fewer than 3 percent of this year's night-shift appliances were defective.
    Show answer

    Answer: D. The factory produced no more than 25,000 appliances this year.

    The factory produced no more than 25,000 appliances this year. - Last year, 4% of 20,000 appliances were defective, for a total of 800. - At most 3% of 25,000, or 750, were defective this year, so this year's total was lower. The factory's average sale price per appliance was the same in both years. - Sale price does not establish how many appliances the factory produced this year. - Without a limit on this year's output, a 3% defect rate could still yield 800 or more defective appliances. The factory sold fewer appliances this year than it sold last year. - Appliances sold need not equal appliances produced, because inventory can change. - Fewer sales therefore do not establish that this year's 3% defect rate produced fewer than 800 defective appliances. The factory produced at least 10 percent more appliances this year than last year. - A 10% increase from 20,000 would mean 22,000 appliances, with 660 defective at a 3% rate. - But at least sets no upper limit: production could exceed 26,666 appliances, yielding more than 800 defective appliances. Fewer than 3 percent of this year's night-shift appliances were defective. - The night shift covers only part of this year's production and supplies no total production figure. - Even with that shift's lower defect rate, this year's stated overall 3% rate could yield 800 or more defective appliances.

  3. 3. Cafeteria manager: Last month, our cafeteria began serving takeout meals in reusable containers. During that month, the amount of discarded packaging per meal was 20 percent lower than during the preceding month. Therefore, the reusable-container program caused the reduction in discarded packaging per meal. Which one of the following, if true, most weakens the cafeteria manager's argument?

    • A. Shortly before the program began, the cafeteria replaced individually wrapped side dishes with food served from bulk containers.
    • B. Most surveyed customers said that they approved of the cafeteria's reusable-container program.
    • C. The reusable containers cost the cafeteria more per unit than the disposable containers had cost.
    • D. Waste per meal at a comparable cafeteria without reusable containers remained approximately constant during the same period.
    • E. The cafeteria served substantially more meals during the month after the reusable-container program began.
    Show answer

    Answer: A. Shortly before the program began, the cafeteria replaced individually wrapped side dishes with food served from bulk containers.

    Shortly before the program began, the cafeteria replaced individually wrapped side dishes with food served from bulk containers. - Serving side dishes from bulk containers could reduce discarded packaging per meal independently of the reusable-container program. - Because both changes occurred around the same time, the 20 percent decline does not establish which change caused it. Most surveyed customers said that they approved of the cafeteria's reusable-container program. - Customer approval does not explain the measured decline in discarded packaging per meal. - The survey gives no evidence that another change, rather than reusable containers, caused the decline. The reusable containers cost the cafeteria more per unit than the disposable containers had cost. - Unit cost does not determine how much packaging was discarded per meal. - The containers could cost more yet still reduce packaging waste as the manager claims. Waste per meal at a comparable cafeteria without reusable containers remained approximately constant during the same period. - A stable rate at a comparable cafeteria makes a general decline in packaging waste less likely to explain this cafeteria’s decline. - This comparison tends to support, rather than weaken, the manager’s claim that a change at this cafeteria caused the reduction. The cafeteria served substantially more meals during the month after the reusable-container program began. - The manager’s measure is packaging discarded per meal, not total packaging discarded. - Serving more meals does not by itself explain why each meal was associated with less discarded packaging.

  4. 4. A proposal is eligible for accelerated review only if it either receives unanimous endorsement from the technical panel or has an emergency designation. Any unanimously endorsed proposal that lacks an impact statement is ineligible for accelerated review. Any proposal with an emergency designation can receive funding only if an impact statement has been filed. Proposal R is eligible for accelerated review, but no impact statement has been filed for it. Which one of the following must be true?

    • A. Proposal R received unanimous endorsement but cannot receive funding.
    • B. Proposal R has an emergency designation and cannot receive funding.
    • C. Proposal R has an emergency designation and received unanimous endorsement.
    • D. Proposal R can receive funding only if it loses its accelerated-review eligibility.
    • E. Proposal R received neither unanimous endorsement nor an emergency designation.
    Show answer

    Answer: B. Proposal R has an emergency designation and cannot receive funding.

    Proposal R has an emergency designation and cannot receive funding. - Eligibility requires unanimous endorsement or an emergency designation, but unanimous endorsement without an impact statement would make R ineligible, so R must have an emergency designation. - An emergency-designated proposal can receive funding only if an impact statement has been filed; none has been filed for R, so it cannot receive funding. Proposal R received unanimous endorsement but cannot receive funding. - R cannot have received unanimous endorsement: without an impact statement, that would make it ineligible for accelerated review. - The funding conclusion is true, but it does not make the claim about endorsement true. Proposal R has an emergency designation and received unanimous endorsement. - R must have an emergency designation to be eligible without an impact statement. - Unanimous endorsement would make R ineligible without an impact statement, contradicting the stem. Proposal R can receive funding only if it loses its accelerated-review eligibility. - The funding rule requires an impact statement for an emergency-designated proposal, not the loss of review eligibility. - R cannot receive funding while no statement has been filed, but the rules do not say that filing one would end its eligibility. Proposal R received neither unanimous endorsement nor an emergency designation. - An eligible proposal must have unanimous endorsement or an emergency designation. - Because R is eligible, it cannot lack both; indeed, the missing impact statement rules out unanimous endorsement and requires an emergency designation.

  5. 5. Principle: An institution is justified in using an indirect indicator to make a consequential decision only if directly measuring the relevant quality is impracticable and evidence shows that the indicator reliably tracks that quality in the population affected. Which one of the following most closely conforms to the principle?

    • A. A scholarship committee uses a test validated for its applicant population because individually assessing thousands of applicants would be impracticable.
    • B. A supervisor uses punctuality to assess work quality because attendance records are easier to consult than completed work.
    • C. A translation agency uses typing speed because typing speed predicts productivity among workers who enter numerical data.
    • D. A small firm uses a validated questionnaire even though it can readily observe each employee performing the relevant tasks.
    • E. A college uses neighborhood of residence because interviewing every applicant would be impracticable, though the indicator has not been validated.
    Show answer

    Answer: A. A scholarship committee uses a test validated for its applicant population because individually assessing thousands of applicants would be impracticable.

    A scholarship committee uses a test validated for its applicant population because individually assessing thousands of applicants would be impracticable. - Individually assessing thousands of applicants is impracticable, so the committee has a reason to use an indirect test. - Validation for its applicant population supplies evidence that the test reliably tracks the relevant quality among those affected. A supervisor uses punctuality to assess work quality because attendance records are easier to consult than completed work. - Records being easier to consult does not establish that assessing completed work is impracticable. - Nothing shows that punctuality reliably tracks work quality. A translation agency uses typing speed because typing speed predicts productivity among workers who enter numerical data. - Evidence about numerical data-entry workers does not establish that typing speed predicts productivity among translators. - The choice also gives no reason that directly assessing translators’ work is impracticable. A small firm uses a validated questionnaire even though it can readily observe each employee performing the relevant tasks. - The validated questionnaire may satisfy the reliability requirement. - Because the firm can readily observe the relevant tasks, direct assessment is not impracticable. A college uses neighborhood of residence because interviewing every applicant would be impracticable, though the indicator has not been validated. - Impracticable interviews satisfy the principle’s condition concerning direct assessment. - Without validation, there is no evidence that neighborhood of residence reliably tracks the relevant quality in the applicant population.

  6. 6. Every report reviewed by the ethics panel contains a conflict-of-interest disclosure. This report contains such a disclosure. Therefore, this report was reviewed by the ethics panel. The flawed pattern of reasoning in the argument above is most similar to that in which one of the following?

    • A. Every registered vehicle displays a license plate. This vehicle displays no license plate, so it is not registered.
    • B. Every employee with a master key signed the security log. Ren signed the log, so Ren has a master key.
    • C. No bronze sculpture in the collection is lightweight. This sculpture is bronze, so it is not lightweight.
    • D. Every late application receives manual review. This application was not late, so it did not receive manual review.
    • E. Some certified farms operate greenhouses. Leto Farm operates a greenhouse, so Leto Farm is certified.
    Show answer

    Answer: B. Every employee with a master key signed the security log. Ren signed the log, so Ren has a master key.

    Every employee with a master key signed the security log. Ren signed the log, so Ren has a master key. - The report argument treats a disclosure, which is necessary for panel review, as proof that review occurred. - Likewise, signing the log is necessary for employees with master keys, but Ren could have signed it without having a master key. Every registered vehicle displays a license plate. This vehicle displays no license plate, so it is not registered. - This reasoning uses the contrapositive: a registered vehicle would display a plate, so one without a plate cannot be registered. - Unlike the report argument, it infers the absence of the first condition from the absence of its required consequence. No bronze sculpture in the collection is lightweight. This sculpture is bronze, so it is not lightweight. - The rule applies to bronze sculptures in the collection, but the premise establishes only that this sculpture is bronze. - Its gap is the missing collection membership, not the report argument’s inference from a required consequence back to its cause. Every late application receives manual review. This application was not late, so it did not receive manual review. - This argument denies the antecedent: an application might receive manual review even if it was not late. - The report argument instead affirms a consequence—having a disclosure—to infer panel review. Some certified farms operate greenhouses. Leto Farm operates a greenhouse, so Leto Farm is certified. - Some certified farms operating greenhouses establishes only that at least one farm has both properties. - It provides no universal rule connecting greenhouse operation to certification, unlike the report argument’s rule about every reviewed report.

  7. 7. Restaurant manager: Before we began sending reservation reminders, 18 percent of reservations resulted in customers failing to appear or cancel. During the three months after reminders began, that figure was only 10 percent. Thus, sending reminders caused the reduction in our no-show rate. Which one of the following, if true, most weakens the restaurant manager's argument?

    • A. The restaurant's total number of reservations increased after the reminders were introduced.
    • B. The restaurant simultaneously began charging customers who missed reservations without canceling.
    • C. Most customers who received reminders opened them before their scheduled reservations.
    • D. Some nearby restaurants send reservation reminders even though their no-show rates remain high.
    • E. Customers who canceled after receiving reminders were usually replaced from a waiting list.
    Show answer

    Answer: B. The restaurant simultaneously began charging customers who missed reservations without canceling.

    The restaurant simultaneously began charging customers who missed reservations without canceling. - The new charge could have prompted customers to appear or cancel, independently of the reminders. - Because the charge began at the same time as the reminders, the decline from 18 percent to 10 percent does not establish which change caused it. The restaurant's total number of reservations increased after the reminders were introduced. - An increase in the number of reservations does not, by itself, explain why the percentage resulting in a failure to appear or cancel fell. - The manager compares no-show rates before and after reminders, not the total number of no-shows. Most customers who received reminders opened them before their scheduled reservations. - Opening the reminders makes it more plausible that customers saw them in time to act. - This supports the manager’s proposed explanation rather than supplying an alternative cause for the lower rate. Some nearby restaurants send reservation reminders even though their no-show rates remain high. - A high no-show rate elsewhere does not show that reminders failed to reduce the rate at this restaurant. - Those restaurants could have had even higher rates without reminders, so their current rates do not test the manager’s causal claim. Customers who canceled after receiving reminders were usually replaced from a waiting list. - Replacing a canceled reservation concerns table occupancy, not whether the original customer failed to appear or cancel. - The manager’s figure counts failures to appear without canceling; filling tables after cancellations does not explain why that figure fell.

  8. 8. Principle: A public agency should require people to provide personal information only when that information is necessary to deliver the service they request. Whenever such information is required, the agency should delete it as soon as that service has been completed. Which one of the following most closely conforms to the principle?

    • A. A library requires reading histories for basic borrowing, although it uses them only to generate optional recommendations, and deletes them annually.
    • B. A permit office requires a mailing address needed to deliver each permit but retains the address indefinitely after delivery.
    • C. A community clinic requires every visitor's occupation even though occupation does not affect the services provided, and deletes it after each visit.
    • D. A ferry service requires a payment identifier needed to process a requested refund and deletes it once the refund is settled.
    • E. A public park requires emergency contacts from unguided day visitors, although the contacts are not needed for admission, and deletes them at closing.
    Show answer

    Answer: D. A ferry service requires a payment identifier needed to process a requested refund and deletes it once the refund is settled.

    A ferry service requires a payment identifier needed to process a requested refund and deletes it once the refund is settled. - The payment identifier is necessary to process the refund the person requested. - Deleting it once the refund is settled satisfies the requirement to delete personal information as soon as the service is completed. A library requires reading histories for basic borrowing, although it uses them only to generate optional recommendations, and deletes them annually. - Reading histories are used for optional recommendations, not needed for the basic borrowing service requested. - Annual deletion also does not ensure deletion as soon as borrowing is completed. A permit office requires a mailing address needed to deliver each permit but retains the address indefinitely after delivery. - The mailing address is necessary to deliver the requested permit. - Keeping it indefinitely after delivery violates the requirement to delete it when that service is completed. A community clinic requires every visitor's occupation even though occupation does not affect the services provided, and deletes it after each visit. - Occupation is unnecessary because it does not affect the clinic services provided. - Deleting it after each visit does not justify requiring it in the first place. A public park requires emergency contacts from unguided day visitors, although the contacts are not needed for admission, and deletes them at closing. - Emergency contacts are not needed for the admission service requested by unguided day visitors. - Deleting them at closing does not cure the violation of requiring unnecessary information.

Flashcards: Weakening with missing cases and bad data

  1. 1. How can a change in measurement methods create a false causal impression?

    Show answer

    The apparent increase or decrease in an effect may result from better detection, altered definitions, or different reporting rather than from the proposed cause.

  2. 2. Why does finding the effect when the proposed cause is absent weaken a causal claim?

    Show answer

    It shows that the effect can arise without the proposed cause, pointing to another explanation.

  3. 3. Why does finding the proposed cause without the predicted effect weaken a causal claim?

    Show answer

    It suggests the cause may not reliably produce the effect. The weakening is stronger when the relevant circumstances are otherwise similar.

  4. 4. What is the fastest way to test if a word or phrase in a stimulus is signaling a causal relationship?

    Show answer

    Replace the suspected wording with 'makes' or 'is explained by.' If the sentence's intended meaning is preserved, it's likely causal.

  5. 5. Identify three types of words or phrases that can be mistaken for causal signals but typically are not.

    Show answer

    Words indicating time/sequence (e.g., after, during), correlation/association (e.g., correlated with, linked to), or inference/conclusion (e.g., therefore, thus).

  6. 6. What is the primary strategy for strengthening a causal argument by ruling out other explanations, as described in the 'alternative-explanation audit'?

    Show answer

    The primary strategy is to systematically identify and eliminate competing explanations for the observed effect, ensuring the proposed cause is the only important change that could have produced the result.

  7. 7. In a causal argument, if a principal concludes that a new tutoring period caused an increase in math scores 'rather than any other change,' what must the principal assume about other potential factors?

    Show answer

    The principal must assume that no other change or factor at the school provides a sufficient explanation for the observed increase in math scores.

  8. 8. What words commonly signal that an argument is making a causal claim?

    Show answer

    Signals include “causes,” “leads to,” “produces,” “results in,” “is responsible for,” and “because of.”

  9. 9. What kind of evidence strengthens a causal claim by eliminating alternatives?

    Show answer

    Evidence that relevant groups were alike except for the proposed cause, or that other plausible causes were absent, makes the causal explanation more credible.

Everything you need for LSAT prep

Get full Oncourse access with lessons, practice questions, flashcards and AI study tools.

GET STARTED FOR FREE
75% OFFLimited time offer
GET 75% OFF