Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning.

BACKGROUND: Evaluative criteria represent values about characteristics that define a successful evaluand. Criteria direct evaluators' lines of inquiry, including how aims are framed, which questions are asked, and what conclusions are reached. Yet, criteria often remain unstated, and little is known about criteria employed in practice. METHODS: We analyzed 141 evaluations published in Evaluation and Program Planning over four years (2016-2019). Applying a model of criteria domains, we utilized collaborative, interpretive coding to surface and examine the criteria embedded in evaluation aims, questions, and conclusions. We also identified methods used to gather evaluation data. FINDINGS: Analysis illuminated eight criteria domains evident in the sample and revealed how multiple domains were combined within individual evaluations. We found overlap among data collection methods used to investigate different domains. CONCLUSIONS: Findings reveal the variety of criteria employed in practice and how evaluators combine criteria to examine multifaceted evaluands. Findings also highlight the need for evaluators to understand how to adapt methods to investigate different criteria domains. This article contributes to the empirical knowledge base about evaluative criteria and identifies revisions to the criteria model.

Representing the values of program participants: Endogenous evaluative criteria.

Evaluative conclusions are grounded in implicit and explicit criteria that describe a successful or high-quality intervention. Most often, evaluative criteria are drawn from program objectives that reflect the values and priorities of program designers and funders. Yet, an exclusive focus on program goals risks overlooking the values of program participants, the extent to which their actual needs and priorities are addressed, and, in certain types of programs, the choices participants make and agency they exercise. This article presents concepts and methods to guide evaluators in drawing some of the criteria used in an evaluation from program participants. The article outlines a typology of evaluative criteria and seven methods for drawing outcomes-focused criteria from program participants. The article concludes with a discussion of implications and future directions for research and practice.

Infection Prophylaxis for Breast Implant Surgery: Could We Do Better?

Objective: Infective complications following breast implant surgery may result in implant removal. This causes patient distress and is costly to treat. A range of precautions is undertaken at the time of surgery to reduce infection, with varying levels of supporting evidence. This study aimed to determine how frequently and consistently infection prevention precautions are used during breast implant surgery. Methods: Multicenter observational study of surgical practice with real-time data collection during breast implant surgery. Results: From 7 NHS breast units, 121 implant procedures were assessed in 94 patients under the care of 22 consultant surgeons. The commonest procedure was immediate reconstruction (58%; 70/121). All patients were methicillin-resistant Staphylococcus aureus (but not methicillin-sensitive Staphylococcus aureus) screened. Antibiotics were given at surgery in all cases; 92% (85/94) received postoperative antibiotics. Other precautions included closed glove technique (67%; 63/94), door signs to reduce theater traffic (72%; 68/94), glove changing prior to implant handling (98%; 119/121), laminar air flow theaters (55%; 52/94), disposable drapes (94%; 88/94) and gowns (74%; 70/94), and cavity washing (89%; 108/121). Among the 14 consultants evaluated on more than 1 procedure (range, 2-22; median = 5), only 1 consistently used exactly the same precautions when siting an implant. Conclusion: Despite national guidance, infection prevention measures are not applied consistently during breast implant surgery, with variability between surgeons and within individual surgeon's practice. The introduction of an infection prevention checklist for all breast implant procedures could improve the reliability with which these precautions are undertaken.

Atypical Presentation of Acute Freiberg Disease.

Freiberg disease is a chronic progressive condition that results in pain and loss of normal function of the metatarsophalangeal joint (MTPJ). We describe a case of acute Freiberg disease secondary to a short course of oral steroids. The patient presented with an acute metatarsal head fracture that was managed successfully with open reduction and internal fixation. Although a rare complication of corticosteroid use, physicians having patients start taking steroids must remember the risk of osteonecrosis.

Techniques of training in the management of tension pneumothorax: bridging the gap between confidence and competence.

BACKGROUND: Thoracocentesis is a simple procedure with high potential to be life-saving, but is associated with complications if performed incorrectly. The aim of this study was to determine both the ability and confidence of practitioners who would be expected deal with a tension pneumothorax both in and out of hospital. If any shortfall was identified between theoretical and practical knowledge the goal was to develop techniques to overcome that shortfall. METHODS: A total of 51 consenting medical practitioners were recruited to participate in a prospective single-subject crossover applied behavioural analysis study. The primary outcome was the change in accuracy of identification of the correct site for needle thoracocentesis on an anatomical diagram and by verbal description. This was compared before and after the introduction of brief and frequent "life-saving practical skills" training sessions. Participants' confidence was also assessed pre and post intervention. RESULTS: There was a disparity pre-intervention between confidence (79.4% felt able to perform the procedure without assistance) and competence (85.2% of these incorrectly identified the anatomical site). Following intervention, the in-practice correct identification of the site increased from 15.7% to 52.9%. The disparity between confidence and competence still existed by was reduced. CONCLUSIONS: The learning and re-learning of this skill should occur regularly through both theoretical and practical teaching to ensure the adequate ability of practitioners and reduce the danger associated with false confidence.

Small bowel diaphragm disease mimicking malignancy.

Non-steroidal anti-inflammatory drugs (NSAIDs) can produce diaphragm disease where multiple strictures develop in the small bowel. This typically presents with anaemia and symptoms of small bowel obstruction. The strictures develop as a result of circumferential mucosal ulceration with subsequent contraction of rings of scar tissue. We report a case of a 47-year-old woman with a 6-month history of NSAIDs abuse who presented with subacute small bowel obstruction 1 year after stopping NSAIDs. CT and MRI showed multiple ileal strictures with florid locoregional lymphadenopathy. A malignant diagnosis such as lymphoma was considered likely as florid mesenteric lymphadenopathy has not been previously reported in diaphragm disease. Laparotomy with small bowel resection was therefore performed. Histology showed diaphragm disease with the enlarged mesenteric nodes having reactive features. Gross locoregional lymphadenopathy should not deter a diagnosis of diaphragm disease in cases of multiple small bowel strictures where there is a strong history of NSAIDs use.

Would you have laparoscopic Nissen fundoplication again? A patient satisfaction survey in a UK population.

OBJECTIVE: Laparoscopic Nissen fundoplication (LNF) effectively reduces objective gastro-oesophageal reflux. It can however cause side effects which affect quality of life or fail to improve subjective reflux symptoms. This study aims to assess patient satisfaction following LNF by assessing whether patients would have the procedure again. DESIGN: Telephone survey using a structured questionnaire. Participation was voluntary. SETTING: UK Foundation Trust (two university hospitals). PATIENTS: All patients who had LNF performed by a single surgeon between November 2008 and June 2012. MAIN OUTCOME MEASURES: Primarily, current reflux symptoms, antiacid medication requirement and whether participants would choose to have the procedure again (should they still have their initial symptoms). Further measures were conversion to open procedure, need for redo or reversal, and mortality. RESULTS: 99 patients underwent LNF in the quoted period; 71 were contactable and willing to participate. Of the 99, two required redo operations (neither of whom was contactable), and one had a reversal (primary operation included). Median time since the operation was 33 months (range 5-48 months). Compared with preoperatively, 72% rated their current reflux-symptom severity as ≤2/10, 23% as 3-6/10 and 4% as 7-10/10. 75% were not taking any antiacid medication. 89% of patients said that they would have the procedure again. CONCLUSIONS: This study provides supporting evidence that LNF improves reflux symptoms and decreases medication use at intermediate-term follow-up. These results will aid counselling and reassurance of patients regarding the risks and benefits of LNF as the majority of postoperative patients were sufficiently satisfied to choose the operation again.