NR-716 · Week 4 of 8 · Appraising non-research evidence

NR-716 Week 4 Appraising Non-Research Evidence: How to Write It

The short answer

Translation projects run heavily on evidence that is not a study, and this stage of NR-716 teaches you to judge it. Clinical practice guidelines, consensus statements, quality improvement reports, registry and surveillance data, benchmarking figures, organizational policy and expert panel opinion all carry information a project needs, and each has its own failure modes. Appraising them is not softer work than appraising a trial; it is different work with different questions. The verdict you owe on each source is what it can be relied on for, stated explicitly. Your section may print this as NR 716 or NR716; it is the same course. Chamberlain publishes no syllabi outside Canvas. The placement here is our teaching judgment from the course's catalog arc; your section's rubric decides what your week actually asks.

NR-716 Week 4 grading scale at Chamberlain, the criterion levels this assessment is scored on, from Chamberlain Tutors
How Chamberlain grades NR-716 Week 4, visualized by Chamberlain Tutors.

What NR-716 Week 4 asks for

Take a pediatric practice trying to act on recommendations about measuring and interpreting blood pressure in children, where the reference values depend on age, sex and height percentile and almost nothing in the workflow makes that easy. The evidence a project like this rests on is mostly not trials. It is a guideline with graded recommendations, a set of reference tables, several improvement reports from practices that automated the calculation, and a professional statement about screening intervals. Judging that material well is the difference between a defensible plan and a plan built on whatever document appeared first.

The territory begins with guidelines, and the central insight is that a guideline is an argument with a method behind it. A well-developed guideline names its panel and their conflicts of interest, describes how evidence was identified and rated, links each recommendation to the strength of evidence supporting it, and states when it will be reviewed. A weak one asserts recommendations with no visible chain back to evidence. Structured appraisal instruments for guidelines exist precisely to make that distinction systematic, and using one by name is what a doctoral reader expects here.

Quality improvement reports are the second category and the one nursing students most often misuse. They are enormously valuable for implementation detail: what was actually done, in what sequence, with what staffing, and what went wrong. They are weak evidence of effect, because a single site changing over time cannot separate the intervention from everything else that changed. Reporting standards for improvement work exist and a report following one is far more usable than a narrative account.

Registry, surveillance and benchmarking data form the third category, useful for magnitude and comparison, limited by how the data were collected and by who is missing from them. Expect a written appraisal of several non-research sources, often with an evidence table, sometimes with a posted response. Posts do not reopen after submission in Canvas.

The NR-716 Week 4 method, step by step

Six moves for appraising evidence that is not a study.

  1. Classify the source before you judge it

    Guideline, consensus statement, improvement report, registry output, benchmarking figure or organizational policy. Each class has its own appraisal questions, and applying trial criteria to a guideline produces a critique that misses everything that matters.

  2. Trace each recommendation back to its evidence

    For a guideline, find the recommendation you intend to use and follow its grade, its supporting citations and the panel's own statement of certainty. A strong recommendation on low-certainty evidence is a real thing and it changes how you should write about it.

  3. Check who wrote it and who paid

    Panel composition, disciplines represented, whether patients or families were involved, declared conflicts and funding. Note it without treating industry involvement as automatic disqualification, and say where a composition gap might have shaped a recommendation.

  4. Date it and check for successors

    Guidance is revised. Find the publication year, the stated review cycle and whether a newer version or an amendment exists. Building a project on a superseded document is a failure a reader will find in one search.

  5. Read improvement reports for the how, not the whether

    Extract the implementation detail: sequence, staffing, tools, adaptations, what failed first. Then state plainly that the design cannot establish effect, and use the report for feasibility rather than for the size of any benefit.

  6. Write a use verdict for every source

    One sentence saying what this document can be relied on for in your project and what it cannot. That sentence is the graded output of the whole exercise, and appraisals that describe without deciding lose the row every time.

A layout and word budget for a non-research appraisal

Our frame for appraising a small set of non-research sources, sized for roughly 1,300 to 1,700 words plus a table. It is our own outline rather than anything the university issues, and your week's rubric outranks it wherever the two disagree.

SectionWhat belongs in itWord target
What the set containsThe sources by class, why each was retained, and what job each is expected to do in the project.180 to 220
Guideline appraisalNamed instrument, panel and conflicts, evidence identification method, recommendation grading, currency.320 to 380
The recommendation you will useThe specific recommendation traced to its grade and supporting evidence, quoted precisely with attribution.180 to 220
Improvement reportsWhat each did, in what setting, with what implementation detail, and why effect cannot be attributed.280 to 330
Registry and benchmarking dataHow the data were collected, who is represented, who is missing, and what comparison it can support.220 to 270
Use verdictsOne explicit sentence per source on what it can and cannot be relied on for.180 to 220
Evidence tableSource, class, appraisal instrument, key finding, strength, and the use you will make of it.Table

Evidence craft for non-research sources

Name the appraisal instrument you used for each class. Structured tools exist for guidelines and for improvement reporting, and naming one lets a grader check your reasoning against a standard rather than against your judgment alone.

Quote recommendations exactly, with their grade attached. Paraphrase drifts, and a recommendation restated slightly more strongly than it was written is a fabricated official fact. Quote it, cite it, and give the strength language the guideline itself used.

Report improvement results with counts, denominators and periods. A report describing a rise from 143 of 402 eligible visits to 268 of 391 over six months tells you something. The same result reported as a percentage improvement tells you almost nothing about the base or the volume.

Say who is missing from registry and surveillance data. Children without a usual source of care, families who moved between reporting periods, and practices that do not submit all shape what the data can support. Naming the absence is doctoral practice.

Keep expert opinion labelled as expert opinion. It has a place, particularly where evidence is thin and a decision is still required, but it should never be presented at the same weight as graded recommendations, and the distinction should be visible in your prose rather than only in a table column.

Five mistakes that cost points in this week's territory

  • Appraising a guideline as though it were a study. Sample size and blinding are the wrong questions; development method, grading and currency are the right ones.
  • Treating an improvement report as proof of effect. One site changing over time cannot separate the intervention from everything else that moved, and saying otherwise misuses the design.
  • Using a superseded guideline. A project built on last edition's recommendation fails on a detail a reader will check first.
  • Paraphrasing recommendations upward. Turning may be considered into is recommended invents an official fact and is one of the most serious errors available here.
  • No verdict. An appraisal that describes each source without saying what it can be relied on for has not done the graded task.

Before you submit

  • Every source is classified before it is appraised
  • A named instrument is used for guidelines and its domains are followed
  • The recommendation you rely on is quoted with its grade and citation
  • Panel composition, conflicts and currency are all reported
  • Improvement reports are used for implementation detail, not for effect size
  • Registry data carries a statement of who is missing
  • Each source closes with an explicit use verdict

Appraising guidance for NR-716?

Send the rubric and your sources out of Canvas. A premium original draft comes back in 24 to 48 hours with each source classified, appraised against a named instrument and given a use verdict, and revisions run until the grade lands.

Questions students ask about this stage

Two guidelines on my topic disagree. Which one do I follow?
Report the disagreement rather than choosing quietly, because how you handle it is the most interesting thing in your appraisal. Start by checking whether the two documents are answering the same question for the same population, since apparent conflicts often dissolve once age ranges or risk groups are compared. If the question really is the same, look at development method, evidence cut-off dates and panel composition, because a difference in what evidence was available or who was in the room usually explains the divergence. Then state which you will follow and why, in terms of currency, method quality and fit to your population. A documented choice between conflicting guidance reads as doctoral judgment; a silent one reads as an oversight.
Can I use a published improvement report as my model?
Yes, and it is often the most practically useful source in the whole set, provided you use it for the right thing. What a good improvement report gives you is the operational anatomy of a change: who did what, in what order, how long each stage took, what the first attempt got wrong, and what it cost in staff time. That is precisely the information trials omit and precisely what your project needs. What it cannot give you is a reliable estimate of how much benefit to expect, because a single site over time has too many rival explanations. Use it to design, use graded guidance and synthesis to justify, and say in writing which source is doing which job.
My organization has its own policy on this. Does it count as evidence?
It counts as context and as a constraint, and occasionally as evidence of local practice, but it does not carry the authority of externally developed guidance. Treat it as a document to appraise like any other: find out when it was written, who wrote it, what it cites, and whether it has been reviewed since the external recommendation changed. A common and valuable finding at this stage is that a local policy predates current guidance and quietly contradicts it, which is itself a translation problem worth naming. Cite the policy accurately, describe its status honestly, and never let an internal document stand in for the external evidence base your project is supposed to be translating.

Keep going

Online now