Confirming and Disconfirming Case Sampling

When to use Confirming and Disconfirming Case Sampling

Use this method when you want to explore existing patterns and test assumptions about a population.

What it solves

Confirmation bias; Overlooking contradictory evidence.

How to run Confirming and Disconfirming Case Sampling, step by step

1. Identify existing patterns or theories about the population. (15 min)
2. Select cases that confirm these patterns. (20 min)
3. Select cases that disconfirm these patterns. (20 min)
4. Analyze and compare the confirming and disconfirming cases. (30 min)
5. Refine the initial patterns or theories based on the analysis. (15 min)

Materials needed

• Whiteboard or virtual whiteboard
• Markers or digital pens
• Case studies or data points

Facilitator tips

• Actively seek out disconfirming evidence to avoid confirmation bias.
• Clearly define the criteria for confirming and disconfirming cases.

Common pitfalls

• Confirmation bias leading to selective interpretation of evidence. Actively seek out and consider disconfirming evidence.
• Ignoring or dismissing disconfirming cases. Thoroughly analyze and understand disconfirming cases.

Variations

• Use a mixed-methods approach to gather both qualitative and quantitative data.
• Involve multiple stakeholders in the analysis to reduce bias.

Running it online or hybrid

Use virtual whiteboards to document patterns and discrepancies.

What it produces

A comparative analysis of confirming and disconfirming cases, highlighting patterns and discrepancies.

Origin

Adapted from BetterEvaluation.org — source

Build a session around Confirming and Disconfirming Case Sampling

METODIC places Confirming and Disconfirming Case Sampling inside a complete, timed session plan — agenda, worksheets, facilitator guide and slides — matched to your group and goal.

Generate a session with Confirming and Disconfirming Case Sampling · Try METODIC free