HSCI 841 — Lesson 2

Research Questions, Theory & the Literature

Qualitative Research Methods & Analysis in Public Health

Kiffer G. Card, PhD, Faculty of Health Sciences, Simon Fraser University

Learning objectives for this lesson:

  • Distinguish exploratory from confirmatory research questions in qualitative work
  • Apply the four screening questions (interest, empirical answerability, resources, ethics) to a candidate question
  • Recognize the four contemporary paradigms (positivism/postpositivism, interpretivism, critical, pragmatism) and locate yourself within them
  • Translate a public-health concern into a focused, defensible qualitative research question
  • Conduct a qualitative-evidence literature search and distinguish it from a systematic review for quantitative evidence
  • Identify the major qualitative-evidence synthesis approaches (meta-ethnography, thematic synthesis, qualitative meta-summary)
  • Apply REB / TCPS 2 considerations to qualitative health research designs
  • Produce the Week 2 capstone milestone: research question + 1-page literature framing for the loneliness capstone

This course was developed by Kiffer G. Card, PhD, as a companion to Bernard, H. R., Wutich, A., & Ryan, G. W. (2017). Analyzing Qualitative Data: Systematic Approaches (2nd ed.). SAGE.

Section 1 of 5

Exploratory vs. Confirmatory Research — and the Four Screening Questions

⏱ Estimated reading time: 25 minutes

Introduction and Overview

Every empirical study you have ever read began with a research question. Most introductory methods courses devote a single lecture to question formulation and then move on, as if the rest of the design followed mechanically once the question was set. Bernard, Wutich, and Ryan take the opposite view: the question is the single most consequential choice a researcher makes, and a defensible qualitative project is one in which every later decision — sampling, instrument, analytic method, write-up — can be traced back to a well-specified research question. This lesson is about doing that upstream work well.

In the prior epidemiology sequence you were given research questions to answer with established designs (case-control, cohort, regression). In HSCI 841 the question is yours to formulate, and the texture of your data — 20 loneliness transcripts collected with a semi-structured guide — both enables and constrains what you can defensibly ask.

Learning Objectives for Section 1

  • Distinguish exploratory from confirmatory qualitative research.
  • Apply Bernard, Wutich, and Ryan's four screening questions (personal interest, empirical answerability, resources, ethics) to a candidate research question.
  • Recognize that “exploratory” is not a synonym for “loose” or “unfocused.”
  • Write a research question that the loneliness dataset can actually support.

1.1 Exploratory and Confirmatory Qualitative Research

The two terms describe the epistemic position of the researcher at the start of the study, not the analytic technique they use. An exploratory question is one for which the researcher does not yet have a candidate answer (or has only weak, ill-formed candidates). A confirmatory question is one for which the researcher has a specific candidate answer (a hypothesis, a model, a theory-derived prediction) and is testing it against data.

Qualitative work has historically been most associated with exploration. The reason is that qualitative methods are particularly good at discovering categories — what counts as a thing, what its dimensions are, how it differs across people — and discovery is the natural mode when you do not yet know what to measure. Bernard, Wutich, and Ryan are careful, however, not to collapse qualitative work into exploration. Grounded theory's later phases (Charmaz, 2006), analytic induction, and qualitative comparative analysis are confirmatory qualitative techniques (Module 11 will return to them). The point is that the same dataset can be analyzed exploratorily or confirmatorily, and you owe the reader an explicit statement of which posture your study is taking.

An exploratory and a confirmatory question on the same dataset

Exploratory: “What dimensions do British Columbian adults use when they describe their own experiences of loneliness?”

Confirmatory: “Cacioppo and colleagues (Hawkley & Cacioppo, 2010) propose that loneliness is qualitatively different from being alone. Do the 20 transcripts in the HSCI 841 dataset support, complicate, or contradict that distinction?”

Notice that both questions can be answered from the same 20 transcripts. The first asks the data to teach you the categories; the second asks the data to evaluate a category already proposed in the literature.

1.2 The Four Screening Questions

+
Importance
Tap to reveal
+
Answerability
Tap to reveal
+
Originality
Tap to reveal
+
Defensibility
Tap to reveal

Before you commit to a research question, Bernard, Wutich, and Ryan recommend running it through four screening questions. Each one is a different kind of feasibility check, and a question that fails any one of them is not yet a good question.

Screening questionWhat it checksWhat failure looks like
1. Personal interestWill you still care about this question in month 11 of a 12-month project?You picked a topic because it seemed publishable, not because you wanted to know the answer.
2. Empirical answerabilityCan the question, as stated, be answered with data — any data?The question is about value (“is loneliness a moral failing?”) rather than fact.
3. ResourcesDo you have the time, money, access, language, and skills the question requires?You would need 200 ethnographic interviews with policymakers in three provinces.
4. EthicsCan the study be conducted in a way that respects participants and meets REB / TCPS 2 standards?The question requires you to elicit traumatic disclosures without offering support.

Many students arrive at this course with a topic, not a research question. The four screens are most useful as a movement from topic to question. “Loneliness” is a topic. “How do recently-bereaved older women in British Columbia describe the shape of their loneliness, and what social, material, and embodied features of their daily lives are they identifying as constitutive of it?” is a research question. Note how the second one specifies who, what, where, and what kind of answer it expects.

1.3 What Makes a Question Defensible for the Capstone Dataset

The capstone dataset constrains the questions you can defensibly ask. Some constraints are obvious and some are less so.

The dataset has 20 transcripts. Twenty in-depth transcripts is a defensible qualitative sample size for descriptive and interpretive work (Sandelowski, 1995). That means questions about prevalence (“how common is…?”) are off-limits. So are questions that require dense subgroup contrasts (a question that splits the dataset 15 ways will have one or two transcripts per cell, which is not enough to characterize anything). Questions about kinds (what kinds of loneliness exist? how is each kind structured?), processes (how do people come to recognize their loneliness? what do they do when it shows up?), and meanings (what does loneliness signify to them?) are well-supported.

The dataset was collected using a specific semi-structured guide. Topics the guide asked about (definitions of loneliness, triggers, coping, social world, stigma, policy preferences) will be richly represented across transcripts. Topics the guide did not directly ask about (clinical symptomatology, family-of-origin attachment styles, neurobiological correlates) will appear only sporadically. A defensible question concentrates on what the guide elicited.

The dataset is synthetic. This is unusual and your methods section must acknowledge it. The transcripts are pedagogically valuable and analytically coherent, but you cannot draw causal claims from them, and you should be cautious about claims that depend on real-world demographic representativeness (since the synthetic composites were designed for analytic variation, not for representative sampling).

Questions that fit the dataset well

  • What dimensions of loneliness do participants name in their own accounts?
  • How do participants distinguish (or fail to distinguish) loneliness from being alone?
  • What kinds of triggers do participants identify, and do these vary across life-stage or social position?
  • What coping strategies do participants report, and which do they describe as helpful, unhelpful, or ambivalent?
  • How do participants' accounts of loneliness compare to the constructs in the Cacioppo and Patrick (2008) framework?
  • What policy or systems-level interventions do participants propose when asked, and how do these vary?

Reflection

Draft a candidate research question for your capstone (one sentence). Then run it through the four screening questions yourself. Which screen does your question pass most clearly? Which one is the closest call?

Model answerA strong response (a) drafts a specific question (not a topic), and (b) honestly identifies the weakest screen. Example: “My question is: How do British Columbian adults describe the relationship between loneliness and being alone, and under what circumstances do they treat the two as the same or different? The clearest screen is personal interest — this question is what drew me to the course. The closest call is resources — the question is dataset-feasible (the interview guide explicitly asks the alone/lonely contrast) but I will need to develop a coding scheme to handle the conditional structure of the question, which adds time. Empirical answerability and ethics are both clean (the dataset is synthetic, the question is about descriptive patterns in accounts).” The reflection is succeeding when it names a specific question AND names a specific screen that is doing real work.

Minimum 20 characters required.

✓ Reflection saved
Knowledge Check — Section 1

Question 1: Which best characterizes the difference between exploratory and confirmatory research?

The exploratory/confirmatory distinction is about the researcher's epistemic position at the start of the study, not the analytic technique. Qualitative work can do both; quantitative work can do both.

Question 2: Which of the following is NOT one of the four screening questions Bernard, Wutich, and Ryan recommend for evaluating a candidate research question?

The four screens are personal interest, empirical answerability, resources, and ethics. Publishability is not one of them — Bernard, Wutich, and Ryan are critical of using publishability as a screening criterion, because it tends to push researchers toward fashionable rather than important questions.

Question 3: A student proposes the research question: “What percentage of British Columbians experience loneliness?” for their capstone. Which screen does this question most clearly fail?

A prevalence question requires probability sampling and a representative sample. A 20-transcript purposive dataset cannot answer it — this is an empirical-answerability mismatch between the question and the available data. (Resources is related but secondary; the deeper issue is that no amount of resources applied to this dataset can produce a prevalence estimate.)
Section 2 of 5

The Role of Theory in Qualitative Health Research

⏱ Estimated reading time: 25 minutes

Introduction and Overview

In the prior courses theory often appeared as background: the biological model of disease, the social-ecological model, the proportionate-universalism framing of inequity. You used theory to motivate a study and to interpret findings, but you rarely had to declare which theoretical tradition you were working within. Qualitative research is different. The methodological tradition expects you to name your paradigm and to align your method to it. This section walks through the four paradigms most commonly named in contemporary public-health qualitative research and shows how the same loneliness question would be approached differently in each.

Learning Objectives for Section 2

  • Define paradigm and explain why qualitative research expects you to declare yours.
  • Distinguish positivism/postpositivism, interpretivism/constructivism, critical/critical-realist, and pragmatist paradigms.
  • Recognize that the same dataset can be analyzed coherently under more than one paradigm, but the analyses will differ in what they treat as data, what they treat as findings, and what they treat as the role of the researcher.
  • Begin to locate your own paradigm-of-default and consider whether it serves your research question.

2.1 What a Paradigm Is

A paradigm is a bundle of commitments about three things: ontology (what kind of thing is the social world?), epistemology (how can we know about it?), and axiology (what role do values play in research?). The bundles are not all internally consistent in every detail, but they cohere enough that researchers within a paradigm tend to agree on what counts as a good study.

You may find paradigm-talk uncomfortable if your training is quantitative. The discomfort is legitimate — quantitative epidemiology rarely makes you say out loud that you believe in an external reality knowable through measurement, because almost everyone in the room is already a postpositivist. Qualitative research, by contrast, draws practitioners from very different positions, so the convention is that you declare yours.

2.2 Positivism / Postpositivism

Positivism holds that a single objective reality exists and is knowable through systematic observation. Researchers should minimize their influence; method is the route to validity. The dominant epistemology of mid-20th-century clinical and behavioural science.

Postpositivism softens this: reality exists but is only imperfectly knowable; researchers cannot stand outside the social world; falsification, triangulation, and disclosed assumptions are the route to defensible claims.

Interpretivism / constructivism holds that meaning is co-constructed by participants and researchers, and there are multiple realities shaped by context, culture, and history. Truth is not located in objective measurement but in defensible interpretation of social meaning. The dominant paradigm of contemporary qualitative inquiry.

Critical paradigms (critical theory, feminist standpoint, decolonial, postcolonial) hold that research takes place within power relations that shape what can be known and by whom. The purpose of research is not only description but emancipation — surfacing structures that produce injustice and informing change.

Pragmatism rejects the question 'what is reality?' as unanswerable and instead asks 'what works to answer this question?' Methods are chosen for fit with the problem; paradigm wars are an obstacle to useful work. The de-facto paradigm of mixed-methods research.

The view that an external reality exists and is, in principle, knowable. Strict positivism (rare today) treats social facts as fully observable; postpositivism — the dominant position in quantitative epidemiology — accepts that our access to reality is fallible and shaped by our instruments, while still treating reality as the target. A postpositivist qualitative study of loneliness would treat participants' accounts as imperfect windows onto an underlying phenomenon and would prioritize procedures (intercoder reliability, triangulation, transparency) that increase the credibility of the inference from accounts to phenomenon.

2.3 Interpretivism / Constructivism

The view that the social world is constituted through meaning-making, and that the researcher's job is to understand those meanings rather than to extract underlying facts behind them. An interpretivist qualitative study of loneliness would treat the accounts as the data — the loneliness of interest is the loneliness as constructed in talk, not a hypothetical thing behind the talk (Thorne, Kirkham, & MacDonald-Emes, 1997). Charmaz's constructivist grounded theory (Charmaz, 2006; Module 7) is the most widely cited contemporary interpretivist methodology in health research.

2.4 Critical and Critical-Realist Paradigms

Frameworks that explicitly attend to power, structural inequality, and the historical embeddedness of phenomena. Feminist, anti-racist, decolonial, Marxist, and critical-realist approaches share the commitment that research is not neutral and that part of the researcher's job is to make visible the structural conditions that produce the phenomenon. A critical loneliness study might foreground how policy choices (housing affordability, immigration restrictions, healthcare under-funding, long-term-care austerity) produce specific patterns of isolation, and would treat participants' accounts as evidence about structural conditions, not only about individual experience.

2.5 Pragmatism

Key insight - The paradigm war is over (mostly)

The 'paradigm wars' of the 1980s-90s — in which positivist and constructivist researchers spent decades arguing past each other — have largely ended in a working detente. The contemporary consensus, particularly in mixed-methods public health, is that paradigm choice is downstream of research question. A descriptive ethnography of a clinic and a randomized trial of a vaccine require different paradigms because they are answering different kinds of questions. Methodological pluralism is now mainstream. Treat the older paradigm rhetoric as historical context, not as something you have to take sides in.

A meta-stance that picks methods to fit the question rather than committing in advance to one paradigm. Pragmatist researchers will mix methods, draw on different paradigms in different parts of a project, and ground decisions in “what works for this question.” Pragmatism is common in applied health-services and implementation-science research. Its critics worry that it can become an excuse for non-disclosure; its defenders argue that strict paradigm-fidelity can produce studies that are philosophically clean but practically irrelevant.

ParadigmSame question (loneliness in BC adults), different framing
PostpositivistWhat patterns in loneliness experience can be inferred from these 20 transcripts, with what credibility, accounting for the fallibility of self-report?
InterpretivistHow do these 20 participants construct loneliness in their own narratives, and what meaning-making work are they doing in the telling?
CriticalWhat structural conditions (immigration policy, housing precarity, racialization, gendered caregiving) are visible in these accounts, and how do they pattern who experiences which kinds of loneliness?
PragmatistWhat can these 20 transcripts contribute to the design of a loneliness intervention or to the refinement of an existing measurement instrument, drawing on whichever analytic moves are most fit for purpose?

Practical advice

For most students in HSCI 841, the paradigm conversation is less about choosing the “correct” one and more about recognizing the one you are already in and being able to defend it in your methods section. Most epidemiology-trained students arrive postpositivist by default. That is a defensible position, but it is a choice, not a neutral starting point, and your methods section should acknowledge it.

Reflection

Which of the four paradigms most closely matches the default stance you brought to this course from your epidemiology training? What would it cost you, methodologically, to remain in that paradigm for your capstone — and what might you gain by deliberately working in a different one?

Model answerFor most epidemiology-trained students the default is postpositivism: you treat accounts as imperfect signals about an underlying loneliness, and your analytic discipline is aimed at improving the credibility of the inference. Staying in postpositivism is defensible and many excellent qualitative health papers do so. What it costs: a postpositivist reading tends to flatten the meaning-making work participants do in interviews — the metaphors, the silences, the refusals — into noise around a signal, when those features may themselves be the most informative data. What you might gain from an interpretivist move: better fidelity to how participants are actually using language; more theoretical traction on phenomena like “wahda” (Amira) or the “empty chair” (Linda) that resist translation into variables. A strong answer names the default, names the cost honestly, and names the gain specifically.

Minimum 20 characters required.

✓ Reflection saved
Knowledge Check — Section 2

Question 1: A research paradigm is best characterized as a bundle of commitments about:

A paradigm bundles together ontology, epistemology, and axiology. These three commitments tend to cohere within a paradigm and to be contested between paradigms.

Question 2: A study frames its analysis as: “Participants' accounts of loneliness are the empirical object of analysis; what loneliness is for these participants is constructed in their narratives, not behind them.” This is most consistent with which paradigm?

Interpretivism / constructivism treats accounts as the data — meaning is constituted in talk, not extracted from behind it. Postpositivism would treat accounts as imperfect windows onto an underlying construct.

Question 3: What is the most common default paradigm for students arriving from quantitative epidemiology training, according to this lesson?

Postpositivism is the dominant paradigm in quantitative epidemiology and the default students typically bring to a qualitative methods course. The lesson's point is that this default is a choice and should be acknowledged in writing.
Section 3 of 5

The Literature Search for Qualitative Evidence

⏱ Estimated reading time: 25 minutes

Introduction and Overview

In HSCI 230 L2 you learned to conduct a systematic review for quantitative evidence: PRISMA, PICO, MeSH terms, risk-of-bias instruments. The literature search for qualitative evidence works on a similar logic but with important differences. The searchable concepts are different, the databases are partly different, the inclusion criteria are different, and the synthesis methods are very different. This section walks through what is the same, what is different, and how to conduct a defensible qualitative-evidence search for your capstone.

Learning Objectives for Section 3

  • Adapt your existing systematic-review skills to qualitative evidence.
  • Identify databases that index qualitative health research.
  • Recognize the major qualitative-evidence synthesis methods (meta-ethnography, thematic synthesis, qualitative meta-summary, framework synthesis).
  • Conduct a focused literature search for the loneliness capstone and produce a one-page literature framing.

3.1 What Is the Same as a Quantitative Review

The basic discipline of a systematic search transfers directly. You still:

  • Specify your search question in advance, using a structured frame (PICO can be adapted; SPIDER — Sample, Phenomenon of Interest, Design, Evaluation, Research type — is purpose-built for qualitative searches (Cooke, Smith, & Booth, 2012)).
  • Search multiple databases.
  • Document your search strings, dates, and result counts.
  • Apply inclusion and exclusion criteria with audit trail.
  • Screen titles/abstracts, then full text, with a second reviewer if possible.
  • Extract data into a structured table.
  • Appraise the quality of included studies.

The PRISMA flow diagram (or its qualitative variants — eMERGe for meta-ethnography, ENTREQ for transparency in reporting synthesis) is still the convention. For reporting your own primary qualitative study, the two dominant standards are COREQ (Tong, Sainsbury, & Craig, 2007) for interview and focus-group studies and SRQR (O'Brien, Harris, Beckman, Reed, & Cook, 2014) for qualitative research more broadly.

3.2 What Is Different

The differences are substantive enough that doing a qualitative search using a quantitative-review playbook will produce a worse search.

The search terms are different. Qualitative studies are not always indexed with reliable terms like “qualitative” or “interview” in their titles or abstracts. The Cochrane Qualitative and Implementation Methods Group has published validated search filters for several databases that you should use rather than improvising. Common useful terms include qualitative, interview, focus group, ethnography, grounded theory, phenomenology, lived experience, narrative, plus methodologically specific terms.

The databases are partly different. MEDLINE and Embase still matter, but CINAHL (nursing), PsycINFO (psychology), Sociological Abstracts, and ASSIA (Applied Social Sciences Index and Abstracts) are particularly important for qualitative health research. Several databases have dedicated qualitative-research filters built in. Grey literature (theses, reports, working papers) is more important in qualitative reviews because qualitative studies are over-represented in unpublished form.

The quality appraisal is different. The Cochrane risk-of-bias tool is not the right instrument. The Critical Appraisal Skills Programme (CASP) qualitative checklist, the Joanna Briggs Institute qualitative checklist, and the Walsh and Downe (2006) criteria are the most widely used.

The synthesis is profoundly different. You do not pool effect sizes. The next subsection turns to what you do instead.

3.3 The Major Qualitative-Evidence Synthesis Methods

Meta-ethnography (Noblit & Hare, 1988)v

The original method for qualitative evidence synthesis. Produces a new interpretation by comparing key metaphors and concepts across primary studies. Three logical operations: reciprocal translation (concepts that are equivalent), refutational translation (concepts that contradict), lines of argument (concepts that combine into a new account).

Thematic synthesis (Thomas & Harden, 2008)v

Adapts thematic-analysis logic (Braun & Clarke, 2006) to a body of studies. Three stages: line-by-line coding of primary studies, development of descriptive themes across studies, development of analytical themes that go beyond the primary studies. Currently the most widely used qualitative-synthesis method in health research.

Critical interpretive synthesis (Dixon-Woods et al., 2006)v

Designed for messy, methodologically heterogeneous bodies of literature where formal systematic review would exclude most of what is useful. Iterative searching, purposive sampling of studies, and construction of 'synthesizing arguments' — new theoretical claims grounded in but not limited to the primary studies.

Realist synthesis (Pawson, 2002)v

For evaluating complex interventions in healthcare and social policy. Asks not 'does it work?' but 'what works, for whom, in what circumstances, why?'. The output is a set of context-mechanism-outcome configurations that explain heterogeneity rather than averaging it out.

Five approaches dominate the qualitative-evidence synthesis literature. They differ in epistemology and in how aggressively they reduce findings.

MethodKey referenceWhat it does
Meta-ethnographyNoblit & Hare (1988)Translates concepts across studies to produce a third-order interpretation — the most interpretive synthesis approach.
Thematic synthesisThomas & Harden (2008)Codes the findings of included studies, develops descriptive themes, then generates analytical themes that go beyond any single study.
Qualitative meta-summarySandelowski & Barroso (2007)Aggregates findings and computes effect-size analogues (frequency and intensity) for findings across studies — the most quantitative end.
Framework synthesisBrunton, Oliver & Thomas (2020)Uses an a priori conceptual framework to organize findings — useful when there is an existing theory the synthesis aims to refine.
Critical interpretive synthesisDixon-Woods et al. (2006)Mixes systematic searching with interpretive reading; designed for complex, contested topics where a tidy synthesis is misleading.

For your Week 2 capstone literature framing you are not being asked to conduct a synthesis. You are being asked to summarize what is known about loneliness from qualitative research, identify the gap your study would address, and locate your candidate research question in that landscape. A one-page framing with eight to twelve cited sources is the target.

🔎 Hands-on: A focused qualitative-evidence search
  1. Open MEDLINE (Ovid or PubMed) and one of CINAHL or PsycINFO.
  2. Search using a SPIDER-style frame for your candidate question. Example for loneliness: Sample = adults; Phenomenon of Interest = experiences of loneliness; Design = interviews or focus groups; Evaluation = themes, meanings, descriptions; Research type = qualitative.
  3. Use a validated qualitative filter (e.g., the Cochrane filter for MEDLINE).
  4. Screen titles/abstracts for the top 30 hits.
  5. Identify 8–12 sources for your literature framing.

Useful starting points: Cochrane Qualitative and Implementation Methods Group · CASP qualitative checklist.

Ethics of social research — brief preview

Bernard, Wutich, and Ryan devote a section in Ch. 2 to ethics. The Canadian standard is the Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans (TCPS 2). For qualitative health research, REB attention concentrates on (a) informed consent for emergent or sensitive topics, (b) confidentiality and de-identification of rich-detail accounts, (c) the risk of secondary harm from re-traumatization, and (d) the obligations of care that follow disclosure during interviews. Your capstone dataset is synthetic so the REB issues do not apply directly, but your methods section should still discuss what they would be for a comparable real-world study.

Reflection

What is the single gap in the qualitative loneliness literature you believe your capstone might most credibly address? Be specific about what is missing — a population, a phenomenological dimension, a setting, a comparison — rather than vaguely saying “more research is needed.”

Model answerThe strongest gap statements name a specific population, phenomenon, or comparison that the existing literature has under-described and that your dataset is well-positioned to address. Example: “The qualitative loneliness literature is rich on older bereaved adults (Cacioppo & Patrick, 2008; Hawkley & Cacioppo, 2010) and is increasingly attentive to immigrant loneliness (Mansfield et al., 2021), but it has not yet adequately characterized the loneliness inside companionship — the experience of being lonely with a partner present, an adult disabled child present, or a dementia-affected parent present. Two of the HSCI 841 transcripts (P03 Sarah, P07 Diana, P17 Jacob) describe this configuration directly, and a third (P14 Kenji) describes its inverse (the loneliness of leaving a relationship one was lonely inside). A focused analysis of these accounts could contribute a defensible typology of companioned loneliness to the literature.” Vague answers (“loneliness has not been studied enough”) do not pass; specific gaps tied to dataset features do.

Minimum 20 characters required.

✓ Reflection saved
Knowledge Check — Section 3

Question 1: Which structured frame is purpose-built for qualitative-evidence search questions?

SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type) was developed specifically for qualitative and mixed-method search questions. PICO works adequately but does not fit qualitative work as naturally.

Question 2: Which is the most interpretive among the major qualitative-evidence synthesis methods?

Meta-ethnography (Noblit & Hare, 1988) translates concepts across studies to produce a third-order interpretation that goes beyond what any single study claims — the most interpretive end of the synthesis spectrum. Qualitative meta-summary is the most quantitative end.

Question 3: Which quality-appraisal tool is most commonly used for qualitative studies in a systematic review?

The CASP qualitative checklist (and the JBI qualitative checklist) is purpose-built for appraising qualitative studies. The other options are quantitative tools (Cochrane RoB for RCTs, Newcastle-Ottawa for observational, Jadad for RCT methodological quality).
Section 4 of 5

From Topic to Capstone Question — A Worked Example

⏱ Estimated reading time: 25 minutes

Introduction and Overview

This section walks through the process of moving from a public-health topic to a defensible capstone research question, using a worked example. It then sets up the Week 2 capstone deliverable.

Learning Objectives for Section 4

  • Follow the movement from topic to focused research question in a worked example.
  • Identify the moves that turn a vague intention into a defensible question.
  • Begin to draft your own capstone research question.
  • Understand the Week 2 capstone deliverable.

4.1 Worked Example: From “Loneliness in Older People” to a Capstone Question

A typical student arrives at the course with a topic like “loneliness in older people” or “immigrant loneliness.” Each of these is a starting point, not a research question. The work of question formulation is to narrow, specify, and ground the topic.

Step 1: From topic to question stub. What about loneliness in older people interests you? “How older people describe the experience of loneliness.” That is closer to a question, but still vague — “describe” could mean anything from clinical phenomenology to social-network mapping.

Step 2: Specify the kind of answer. What do you want to know that you do not now know? “What dimensions and triggers of loneliness do older participants name in their own accounts, and how do these compare to younger participants' accounts?” Now the question has a comparison built in and is asking for content that the dataset can provide.

Step 3: Ground the question in the dataset. Can the 20 transcripts answer this? Five of the 20 participants are over 65 (P05 Linda, P11 Helen, P14 Kenji, P17 Jacob, P20 Frank). Five is enough for descriptive characterization but not for fine-grained subgroup work. The question is dataset-feasible if you accept that “older” will be defined by those five and that comparison to younger participants will be at the level of patterns, not statistical contrasts.

Step 4: Locate in the literature. The qualitative literature on older-adult loneliness is well-developed (Cacioppo & Patrick, 2008; Hawkley & Cacioppo, 2010; the Cardona et al. 2025 review). What can your capstone add? A defensible answer: a comparison across life-stage from a single, methodologically consistent dataset, where most prior qualitative work has studied life-stages separately.

Step 5: Run the four screens. Personal interest (you do care). Empirical answerability (the dataset can support the question, with stated caveats about sample size). Resources (12 weeks is sufficient for a five-vs-fifteen-transcript comparative analysis). Ethics (the dataset is synthetic, so the question is REB-clean for instructional purposes).

Final question: “How do older British Columbian adults (age 65+) describe the dimensions and triggers of their loneliness, and in what ways do their accounts pattern differently from those of younger adults in the same dataset?”

What makes this final question defensible

  • It specifies the population (older BC adults, 65+).
  • It specifies what kind of answer it expects (dimensions and triggers, with comparison).
  • It is grounded in what the dataset actually contains.
  • It can be answered with descriptive and comparative qualitative methods that the course teaches in Modules 5–7.
  • It has a defensible relationship to existing literature.
  • It passes all four screens.

4.2 Your Capstone Question

ACTIVITY Try it - Screen your capstone question against four tests

Take your current draft capstone question (or any question you might investigate). Answer all four screening tests in 1-2 sentences each:

  1. Importance: Who would care about the answer and why?
  2. Answerability: What data would you need? Do you have access to those data?
  3. Originality: What does a 30-minute literature search tell you about prior work?
  4. Defensibility: What is the most likely reviewer objection, and how would you handle it?

If any test fails, the question is not yet ready. The point is to find this out before committing months to it.

You are now ready to draft your own. Use the worked example as scaffolding, not as a template. The question you arrive at should be specific enough that another reader could predict, in broad terms, what your methods section will say.

4.3 Ethics of Qualitative Research — What Your Methods Section Will Address

Even with a synthetic dataset, your methods section is expected to address what the ethical considerations would be for a real-world study. The TCPS 2 framework asks you to address:

  • Free and informed consent — what would participants be told? How would consent be obtained for sensitive topics? How would withdrawal work?
  • Confidentiality — how would identifying details be removed from transcripts? What is your data-storage plan? How will quoted excerpts be presented?
  • Risk of harm — what is the risk of re-traumatization from an interview about loneliness? What support resources would be provided?
  • Justice in subject selection — who is included, who is excluded, and on what grounds?
  • Researcher obligations of care — what does the researcher owe a participant who discloses something distressing during an interview?

Bernard, Wutich, and Ryan (Ch. 2, pp. 23–26) are good on the ethics framing. The Canadian-specific operationalization is in TCPS 2 (2022).

Reflection

Write the current version of your capstone research question in one sentence. Then write one sentence explaining what kind of answer you expect to find — not what you hope to find, but what kind of finding will count as having answered the question.

Model answerA strong response distinguishes “what I hope to find” from “what kind of answer will count.” Example: “Question: How do recently-bereaved older women describe the shape of their loneliness, and what features of their daily lives do they identify as constitutive of it? Expected kind of answer: A defensible characterization of two to four dimensions of the bereavement-loneliness experience, with illustrative excerpts from at least three transcripts per dimension, and a comparison to non-bereaved older participants that supports a claim about what is distinctive of bereavement loneliness vs. older-age loneliness more generally.” Notice the answer specifies the form of the finding (dimensions, comparison, excerpt density) without pre-judging its content. That is the move Bernard, Wutich, and Ryan recommend.

Minimum 20 characters required.

✓ Reflection saved
Knowledge Check — Section 4

Question 1: Which of the following is the strongest characterization of a defensible capstone research question?

A defensible question is specific (named population), forward-clear (you can predict what the methods section will say), and dataset-feasible (the data can support it). Personal interest is necessary but not sufficient; novelty is desirable but not the screening criterion; dramatic phrasing is not a methodological virtue.

Question 2: Under the Canadian TCPS 2 framework, which of the following is NOT one of the standard ethical considerations for a qualitative interview study?

Statistical power applies to quantitative inferential studies. The TCPS 2 ethical considerations for qualitative interview research focus on consent, confidentiality, risk of harm (including re-traumatization), justice in selection, and researcher obligations of care.

Question 3: A student's draft question is: “How do people experience loneliness?” Why does this question need narrowing before it can serve as a capstone question?

The question is vague on three dimensions: population (which people?), kind of answer (what counts as “how”?), and dataset alignment (what can these 20 transcripts say?). Narrowing fixes all three at once.
Section 5 of 5

Final Assessment

⏱ Estimated time: 25 minutes

Bringing It All Together

Lesson 2 has done the upstream design work: you have moved from a topic to a defensible research question, named the paradigm you will work in, and located the question in the qualitative loneliness literature. This work feels disproportionate to its concrete output (a paragraph and a page), but it determines what every later step of the course can do for you. A vague question produces a vague methods section, a vague analysis, and a vague paper. A precise question makes everything that follows possible.

Lessons 3 and 4 turn to the design infrastructure your methods section will be written in: sampling logic (already partly fixed for the capstone, but you still must document it defensibly) and data collection (also partly fixed, but the methodological vocabulary is what makes the dataset legible to your reader). Lessons 5 onward begin analysis proper.

Key Takeaways from Lesson 2

  • Exploratory and confirmatory describe epistemic position, not method: a qualitative project can be either, and your methods section should declare which.
  • Four screening questions filter candidate questions: personal interest, empirical answerability, resources, ethics. Publishability is not a screen.
  • Paradigm matters and must be named: postpositivism, interpretivism, critical, pragmatism — each implies different things about data, findings, and the role of the researcher.
  • Qualitative literature search transfers the discipline but changes the tools: SPIDER instead of PICO, CASP instead of Cochrane RoB, CINAHL and PsycINFO in addition to MEDLINE, qualitative-evidence synthesis methods instead of meta-analysis.
  • A defensible research question is specific, dataset-feasible, and forward-clear: a reader should be able to predict, in broad terms, what your methods section will say.
  • TCPS 2 ethics applies to your methods section even with a synthetic dataset: consent, confidentiality, risk of harm, justice, and obligations of care.
  • The Week 2 capstone milestone is the question + literature framing + paradigm statement — the upstream design infrastructure on which the rest of the capstone is built.

Core Concepts Reviewed

Section 1: Exploratory vs. confirmatory research; the four screening questions; the dataset-feasibility constraints of a 20-transcript synthetic corpus; the move from topic to question.

Section 2: Paradigm as ontology + epistemology + axiology; the four contemporary paradigms (postpositivism, interpretivism, critical, pragmatism) and their implications; the convention of naming your paradigm explicitly.

Section 3: SPIDER vs. PICO; databases for qualitative health research; CASP and JBI appraisal tools; the five major qualitative-evidence synthesis methods (meta-ethnography, thematic synthesis, qualitative meta-summary, framework synthesis, critical interpretive synthesis); TCPS 2 ethics for qualitative work.

Section 4: The five-step movement from topic to defensible question; the worked older-adult-loneliness example; the Week 2 capstone deliverable (question, literature framing, paradigm statement).

The final reflection below asks you to articulate the question that will anchor your capstone for the remaining ten weeks. Make it as good as you can — you will return to it every week.

Final Reflection

State your capstone research question, your paradigm, and the single most important methodological concession you are making for the dataset to be able to support the question. Be specific. You will refine this every week, but a strong draft now saves work later.

Model answerA strong final-reflection response will have three named elements. Example: “Question: How do British Columbian adults describe loneliness inside companionship — the experience of feeling lonely in the presence of a partner, an adult dependent, or another co-resident — and what features of those relationships do they identify as producing the loneliness? Paradigm: Postpositivist with interpretivist allowances — I treat the accounts as partial windows onto experience (postpositivist) but I attend closely to the meaning-making moves participants use when they describe relational loneliness (interpretivist). Concession: The synthetic dataset limits what I can claim about real-world prevalence or causal patterning; my findings will be characterizations of the configuration of companioned loneliness as it appears in these accounts, not claims about how common it is.” The honesty about the concession is what most distinguishes a strong draft from a weak one.

Minimum 30 characters required.

✓ Reflection saved
Final Assessment — Lesson 2: Research Questions, Theory & the Literature (15 Questions)

Question 1: The exploratory/confirmatory distinction describes:

Exploratory and confirmatory describe the researcher's epistemic stance. Both can be qualitative or quantitative, and the same dataset can be analyzed either way.

Question 2: Which is NOT one of the four screening questions for a candidate research question?

The four screens are personal interest, empirical answerability, resources, and ethics. Statistical significance is a feature of an analysis, not of a question.

Question 3: Which question is best suited to the HSCI 841 capstone dataset?

Only the second question is dataset-feasible. The others require representative samples (prevalence), an experimental design (intervention), or biological data (genetics).

Question 4: A paradigm bundles together three kinds of commitments. They are:

Paradigms are commitments about what reality is like (ontology), how we can know it (epistemology), and the role of values (axiology).

Question 5: A researcher writes: “Participants' accounts are imperfect windows onto an underlying loneliness phenomenon; my analytic procedures aim to improve the credibility of inference from accounts to phenomenon.” This is most consistent with which paradigm?

Postpositivism: an external reality exists, access is fallible, methodological discipline aims to improve credibility of inference. This is the dominant paradigm in quantitative epidemiology.

Question 6: A researcher writes: “Loneliness as it appears in these accounts is the empirical object; I am not trying to recover a loneliness behind the accounts but to understand the meaning-making participants do in describing it.” This is:

Interpretivism / constructivism treats the accounts as the data; the loneliness of interest is the loneliness as constructed in talk.

Question 7: Which database is particularly important for qualitative health research in addition to MEDLINE?

CINAHL (nursing) and PsycINFO (psychology) index much of the qualitative health literature that MEDLINE underweights. Sociological Abstracts and ASSIA are also relevant.

Question 8: Which structured frame was developed specifically for qualitative-evidence search questions?

SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type) was developed for qualitative and mixed-method searches.

Question 9: Which qualitative-evidence synthesis method translates concepts across studies to produce a third-order interpretation?

Meta-ethnography (Noblit & Hare, 1988) produces a third-order interpretation that goes beyond what any single study claims.

Question 10: Which appraisal tool is appropriate for qualitative studies in a systematic review?

CASP (Critical Appraisal Skills Programme) qualitative checklist or the JBI qualitative checklist are the standard tools. The other options are quantitative.

Question 11: The Canadian framework for research ethics involving humans is:

TCPS 2 is the Canadian framework, issued by the three federal research-funding agencies. Belmont is American, Helsinki is the international medical-research declaration, Nuremberg is the post-war foundational document.

Question 12: A student's draft question is: “How does loneliness happen?” The most defensible feedback is:

The question is too vague on multiple dimensions. Narrowing the population, specifying what kind of answer counts, and aligning with the dataset are all standard moves to make a topic-question into a research question.

Question 13: What is the role of a paradigm statement in a qualitative methods section?

The paradigm statement makes the researcher's commitments explicit so the reader can judge whether the rest of the methods section is coherent with them. It is a transparency move, not decoration.

Question 14: Pragmatism, as a methodological stance, is most commonly criticized for:

Critics worry that pragmatism, by refusing paradigmatic commitment in advance, can produce studies that are philosophically inconsistent and can serve as cover for non-disclosure. Its defenders argue paradigm-fidelity sometimes produces philosophically clean but practically irrelevant studies.

Question 15: The Week 2 capstone deliverable is:

Week 2 is the upstream design deliverable: question, literature framing, and paradigm statement. The codebook comes in Week 5, analysis later, and a full systematic review is far beyond the scope of one week.
✦ Complete the final reflection above before submitting

Congratulations!

You have successfully completed Lesson 2: Research Questions, Theory & the Literature.

You can now distinguish exploratory from confirmatory work, apply the four screens, name your paradigm, and conduct a defensible qualitative-evidence literature search. The Week 2 deliverable is the upstream design infrastructure on which the rest of the capstone depends.

Next up — Lesson 3: Sampling in Qualitative Research, which gives you the vocabulary your methods section will use to defend the structure of the capstone dataset.

Reference

Glossary — Key Terms, Methods & People

📚 Reference page — available throughout the lesson

This glossary collects the key concepts, methods, and people introduced in Lesson 2. Type in the search box to filter entries.

Question Formulation
Exploratory ResearchResearch conducted when no candidate answer to the question yet exists. Aims to discover categories, dimensions, and mechanisms. Qualitative methods dominate exploration.
Confirmatory ResearchResearch conducted to test a specific candidate answer (hypothesis, model, theory-derived prediction). Less common in qualitative work but real — analytic induction and QCA are confirmatory qualitative techniques.
Four Screening QuestionsPersonal interest, empirical answerability, resources, and ethics. Bernard, Wutich, and Ryan's recommended filter for moving from candidate question to defensible research question.
SPIDERSample, Phenomenon of Interest, Design, Evaluation, Research type. A structured frame for qualitative-evidence search questions, developed as an alternative to PICO.
PICOPopulation, Intervention, Comparison, Outcome. The structured frame for systematic reviews of quantitative intervention evidence. Adaptable but not ideal for qualitative work.
Paradigms
ParadigmA bundle of commitments about ontology, epistemology, and axiology. The convention in qualitative research is that you name yours.
PostpositivismAn external reality exists; access to it is fallible and shaped by instruments; methodological discipline aims to improve credibility of inference. Dominant in quantitative epidemiology.
Interpretivism / ConstructivismReality is co-constituted through meaning-making. The researcher's job is to understand meanings rather than to extract underlying facts behind them.
Critical Theory / Critical-RealistFrameworks (feminist, anti-racist, decolonial, Marxist, critical-realist) that explicitly attend to power and structural inequality in both research question and analysis.
PragmatismA meta-stance that picks methods to fit the question rather than committing in advance to one paradigm.
Qualitative-Evidence Synthesis
Meta-Ethnography (Noblit & Hare, 1988)Translates concepts across qualitative studies to produce a third-order interpretation. The most interpretive synthesis approach.
Thematic Synthesis (Thomas & Harden, 2008)Codes the findings of included studies, develops descriptive themes, then generates analytical themes.
Qualitative Meta-Summary (Sandelowski & Barroso, 2007)Aggregates findings and computes effect-size analogues across studies. The most quantitative end of qualitative-evidence synthesis.
Framework SynthesisUses an a priori conceptual framework to organize findings across studies.
Critical Interpretive Synthesis (Dixon-Woods et al., 2006)Mixes systematic searching with interpretive reading; designed for complex, contested topics.
CASP Qualitative ChecklistThe Critical Appraisal Skills Programme's checklist for appraising qualitative studies. The most widely used appraisal tool in qualitative systematic reviews.
PRISMA / ENTREQ / eMERGeReporting standards: PRISMA for systematic reviews generally; ENTREQ for enhancing transparency in reporting qualitative-evidence synthesis; eMERGe for meta-ethnography specifically.
Ethics
TCPS 2 (Tri-Council Policy Statement)The Canadian ethical framework for research involving humans, issued by CIHR, NSERC, and SSHRC. The 2022 revision is current.
REB (Research Ethics Board)The Canadian counterpart to an IRB. Reviews and approves human-participant research at universities and other institutions.
ReflexivityOngoing examination of how the researcher's social position and assumptions shape what gets seen and how. Standard expectation in qualitative health research.
Key People
George Noblit & R. Dwight HareAuthors of Meta-Ethnography: Synthesizing Qualitative Studies (1988), the foundational text for qualitative-evidence synthesis.
James Thomas & Angela HardenDeveloped thematic synthesis (Thomas & Harden, 2008), one of the most widely used qualitative-evidence synthesis methods in health research.
Margarete Sandelowski & Julie BarrosoDeveloped qualitative meta-summary and meta-synthesis (Sandelowski & Barroso, 2007). Nursing-research foundations of contemporary qualitative-evidence synthesis.
John Cacioppo & Louise HawkleyEstablished loneliness as a public-health and biomedical concern. Their distinction between loneliness and being alone (Cacioppo & Patrick, 2008) is a major theoretical reference for your capstone.
No matching entries. Try a different search term.