Objecting to experiments that compare two unobjectionable policies or treatments.

Randomized experiments have enormous potential to improve human welfare in many domains, including healthcare, education, finance, and public policy. However, such "A/B tests" are often criticized on ethical grounds even as similar, untested interventions are implemented without objection. We find robust evidence across 16 studies of 5,873 participants from three diverse populations spanning nine domains-from healthcare to autonomous vehicle design to poverty reduction-that people frequently rate A/B tests designed to establish the comparative effectiveness of two policies or treatments as inappropriate even when universally implementing either A or B, untested, is seen as appropriate. This "A/B effect" is as strong among those with higher educational attainment and science literacy and among relevant professionals. It persists even when there is no reason to prefer A to B and even when recipients are treated unequally and randomly in all conditions (A, B, and A/B). Several remaining explanations for the effect-a belief that consent is required to impose a policy on half of a population but not on the entire population; an aversion to controlled but not to uncontrolled experiments; and a proxy form of the illusion of knowledge (according to which randomized evaluations are unnecessary because experts already do or should know "what works")-appear to contribute to the effect, but none dominates or fully accounts for it. We conclude that rigorously evaluating policies or treatments via pragmatic randomized trials may provoke greater objection than simply implementing those same policies or treatments untested.

The validity of using ICD-9 codes and pharmacy records to identify patients with chronic obstructive pulmonary disease.

BACKGROUND: Administrative data is often used to identify patients with chronic obstructive pulmonary disease (COPD), yet the validity of this approach is unclear. We sought to develop a predictive model utilizing administrative data to accurately identify patients with COPD. METHODS: Sequential logistic regression models were constructed using 9573 patients with postbronchodilator spirometry at two Veterans Affairs medical centers (2003-2007). COPD was defined as: 1) FEV1/FVC <0.70, and 2) FEV1/FVC < lower limits of normal. Model inputs included age, outpatient or inpatient COPD-related ICD-9 codes, and the number of metered does inhalers (MDI) prescribed over the one year prior to and one year post spirometry. Model performance was assessed using standard criteria. RESULTS: 4564 of 9573 patients (47.7%) had an FEV1/FVC < 0.70. The presence of ≥1 outpatient COPD visit had a sensitivity of 76% and specificity of 67%; the AUC was 0.75 (95% CI 0.74-0.76). Adding the use of albuterol MDI increased the AUC of this model to 0.76 (95% CI 0.75-0.77) while the addition of ipratropium bromide MDI increased the AUC to 0.77 (95% CI 0.76-0.78). The best performing model included: ≥6 albuterol MDI, ≥3 ipratropium MDI, ≥1 outpatient ICD-9 code, ≥1 inpatient ICD-9 code, and age, achieving an AUC of 0.79 (95% CI 0.78-0.80). CONCLUSION: Commonly used definitions of COPD in observational studies misclassify the majority of patients as having COPD. Using multiple diagnostic codes in combination with pharmacy data improves the ability to accurately identify patients with COPD.

Effects of sustained audit/feedback on self-reported health status of primary care patients.

PURPOSE: Because limited audit/feedback of health status information has yielded mixed results, we evaluated the effects of a sustained program of audit/feedback on patient health and satisfaction. METHODS: We conducted a group-randomized effectiveness trial in which firms within Veterans Administration general internal medicine clinics served as units of randomization, intervention, and analysis. Respondents to a baseline health inventory were regularly mailed the 36-Item Short Form (SF-36) and, as relevant, questionnaires about six chronic conditions (ischemic heart disease, diabetes, chronic obstructive pulmonary disease, depression, alcohol use, and hypertension) and satisfaction with care. Data were reported to primary providers at individual patient visits and in aggregate during a 2-year period. RESULTS: Baseline forms were mailed to 34,050 patients; of the 22,413 respondents, 15,346 completed and returned follow-up surveys. Over the 2-year study, the difference between intervention and control groups (as measured by difference in average slope) was -0.26 (95% confidence interval [CI]: -0.79 to 0.27; P=0.28) for the SF-36 Physical Component Summary score and -0.53 (95% CI: -1.09 to 0.03; P=0.06) for the SF-36 Mental Component Summary score. No significant differences emerged after adjusting for deaths. There were no significant differences in condition-specific measures or satisfaction between groups after adjustment for provider type, panel size, and number of intervention visits, or after analysis of patients who completed all forms. CONCLUSION: An elaborate, sustained audit/feedback program of general and condition-specific measures of health/satisfaction did not improve outcomes. To be effective, such data probably should be incorporated into a comprehensive chronic disease management program.

Remote monitoring and supervision of urology residents utilizing integrated endourology suites-a prospective study of patients' opinions.

PURPOSE: To report on integrated endourology suites (IES), remote monitoring and supervision (RMS) of urology residents and to evaluate patients' opinions, acceptance, and satisfaction level with IES and RMS. PATIENTS AND METHODS: Patients undergoing flexible cystoscopy in the IES with RMS were surveyed using a questionnaire. All procedures were performed by junior urology residents (UR-1 level) using RMS. Patients were studied using a nine-question survey to evaluate their comfort level, acceptance, and level of satisfaction with RMS. Six questions used a scale of 1 to 10 (1=strongly disagree; 10=strongly agree), and the remaining three questions solicited a "yes" or "no" response. RESULTS: 100 patients were studied (59% Caucasians, 40% African Americans, and 1% Hispanic). Median age was 63 years. The highest level of education was middle school in 2% of patients, high school in 55%, undergraduate in 33%, and postgraduate in 10%. Patients scored a mean of 9.50/10 (highly satisfactory) regarding their comfort with RMS; 96% scored ≥ 7, 4% scored 5 to 6, and none scored <5. Patients were satisfied having a urology resident perform the procedure (9.48/10), other residents and medical students watch the procedure (9.41/10), a video camera in the room (9.40/10), and two-way sound communication (9.40/10). None perceived compromise to their privacy or quality of care. CONCLUSIONS: RMS in IES is highly acceptable to patients undergoing endoscopic procedures. RMS has the potential to positively impact residency training, efficiency, regulatory compliance, safety, and productivity.

Use of medical informatics for management of multiple sclerosis using a chronic-care model.

The mission of the Multiple Sclerosis Centers of Excellence (MSCoEs) is to optimize the services veterans with multiple sclerosis (MS) receive across the U.S. Veterans Health Administration. To accomplish this mission, the MSCoE West has adopted a collaborative chronic-disease management strategy along the lines of the model described by Wagner and colleagues. This model describes an organized, integrated, proactive, and population-based approach to patient care that includes healthcare delivery system change and patient-based self-management. While Wagner's model is described independent of information technology, the majority of actions called for in that model benefit tremendously from the application of a powerful and well-integrated informatics infrastructure designed to serve and support populations with chronic disease. Key elements such as goals and actions encourage high-quality care for those with chronic illnesses.