NR-701 Week 4 Appraising Qualitative Evidence: How to Write It

What NR-701 Week 4 asks for

A telehealth program can see exactly how many patients stop attending video visits after the second appointment. It cannot see why, and no amount of additional counting will tell it. An interview study of eighteen patients who disengaged, analyzed thematically, reports that most had no difficulty with the technology and every difficulty with what the visit was for: they could not tell whether anything had been decided, and nobody had told them what the next appointment would change. That finding cannot be produced by a trial, and it is the finding that would determine whether a redesign works.

Appraising this kind of evidence requires a different set of hinges. Methodological congruence asks whether the stated approach, the question, the sampling, the data collection and the analysis form one coherent design; a study announcing phenomenology and then reporting frequency counts of codes has broken it. Sampling adequacy asks whether the people interviewed could plausibly have the experience being studied and whether variation was sought deliberately. Analytic transparency asks whether you can follow the route from raw data to themes, usually visible in whether coding is described concretely and whether the data extracts presented actually support the claims made about them.

Trustworthiness has recognizable components you can write about by name: credibility, whether the interpretation fits the participants' accounts; dependability, whether the process is documented well enough to be followed; confirmability, whether the findings are grounded in data rather than in the researcher's expectations; and transferability, which is the reader's judgment rather than the author's claim and depends on how thickly the context is described. Reflexivity, meaning an explicit account of who the researcher was in relation to the participants, is treated as a strength in this literature rather than as an admission.

Mixed methods adds one further question that students routinely skip: integration. A study that reports a survey and then reports interviews has not mixed anything. Look for where the two strands meet, whether through a joint display, an explanatory sequence in which the qualitative strand explains a quantitative result, or an exploratory sequence in which qualitative work builds the instrument. Expect a written appraisal of one qualitative or mixed methods study, and possibly a board post on what the study contributes that numbers cannot. Post the contribution rather than the summary: posts do not reopen once submitted in Canvas.

The NR-701 Week 4 method, step by step

Six analytic moves for appraising qualitative work on its own terms.

1. Name the tradition and check it against the question

   Phenomenology pursues the meaning of lived experience, grounded theory builds explanatory process, ethnography studies culture in context, descriptive qualitative work reports what participants said with minimal theoretical framing. Say which one and whether the question suits it.

2. Interrogate sampling as a design decision rather than a number

   Ask who was recruited, on what basis, and whether the strategy was purposive, maximum variation, theoretical or convenient. Eighteen participants chosen for range can be stronger than sixty chosen for availability, and saying why is the appraisal.

3. Follow the data from collection to theme

   Check whether interviews were recorded and transcribed, whether a guide is described, who coded, whether coding was checked, and whether the paper shows the steps between codes and themes. Vagueness here is the most common weakness in published qualitative work.

4. Test the extracts against the claims

   Read the quotations offered as evidence and ask whether each one actually demonstrates the theme it is attached to. Quotations that restate the theme rather than illustrating it are a sign the analysis stayed at the surface.

5. Assess reflexivity and its consequences

   Note whether the authors state their relationship to participants and setting, and reason about what that position could have done to the data. A clinician interviewing her own patients is not disqualified, but the effect on what people felt able to say deserves a sentence.

6. Judge transferability to your setting explicitly

   Compare context: population, service model, payment environment, staffing. Then say what the findings can be expected to carry into your setting and what they cannot, which is the practice-doctorate version of a verdict.

A layout and word budget for a qualitative appraisal

Our frame for appraising one qualitative or mixed methods study, sized for roughly 1,500 to 1,900 words. It is our own outline rather than anything the university issues, and your week's rubric outranks it wherever the two disagree.

Evidence craft for qualitative appraisal

Use an appraisal tool designed for qualitative work. Applying a trials checklist to an interview study produces a list of absences that were never supposed to be present, and doctoral graders read that as a category error rather than as rigour.

Never criticize a qualitative study for lacking generalizability. It was not attempting it. The corresponding question is transferability, which depends on how richly context was described and is decided by you as the reader, so write it that way.

Quote sparingly and attribute precisely. Where you reproduce a participant extract from a published study, keep it short, mark it as a quotation and cite the source. The analysis should be your sentences, not a chain of other people's.

Report sample composition in numbers. Eighteen participants, of whom eleven were interviewed within a month of disengaging, is a description a reader can weigh. A diverse sample is a claim without a shape.

Say what the study contributes to translation. Qualitative findings usually inform acceptability, workflow fit and the reasons a change is resisted, which are exactly the determinants an implementation plan has to answer. Naming that contribution keeps the appraisal aligned with the degree.

Five mistakes that cost points in this week's territory

• Judging by trial standards. Complaining about the absence of a control group or a power calculation shows the study was appraised with the wrong instrument.
• Counting themes. Reporting that most participants said something turns interpretive work into weak quantification and misses what the design was for.
• Ignoring the analysis trail. Sampling and findings are easy to describe; the coding process is where rigour lives and where most appraisals go quiet.
• Reflexivity skipped. Where the authors say nothing about their position, silence is a finding worth reporting rather than a section to omit.
• No decision consequence. An appraisal that ends without saying what the finding would change in your setting has left the practice question unanswered.

Before you submit

• The qualitative appraisal tool used is named and attributed
• The methodological tradition is identified and checked against the question
• Sampling strategy, not just sample size, is appraised
• The route from data to themes is described or its absence noted
• At least two themes are tested against the extracts offered
• Transferability is discussed as your judgment about context
• The close states what the finding would change in practice

Questions students ask about this stage

Keep going