Machine learning for screening prioritization in systematic reviews: comparative performance of Abstrackr and EPPI-Reviewer.

BACKGROUND: Improving the speed of systematic review (SR) development is key to supporting evidence-based medicine. Machine learning tools which semi-automate citation screening might improve efficiency. Few studies have assessed use of screening prioritization functionality or compared two tools head to head. In this project, we compared performance of two machine-learning tools for potential use in citation screening. METHODS: Using 9 evidence reports previously completed by the ECRI Institute Evidence-based Practice Center team, we compared performance of Abstrackr and EPPI-Reviewer, two off-the-shelf citations screening tools, for identifying relevant citations. Screening prioritization functionality was tested for 3 large reports and 6 small reports on a range of clinical topics. Large report topics were imaging for pancreatic cancer, indoor allergen reduction, and inguinal hernia repair. We trained Abstrackr and EPPI-Reviewer and screened all citations in 10% increments. In Task 1, we inputted whether an abstract was ordered for full-text screening; in Task 2, we inputted whether an abstract was included in the final report. For both tasks, screening continued until all studies ordered and included for the actual reports were identified. We assessed potential reductions in hypothetical screening burden (proportion of citations screened to identify all included studies) offered by each tool for all 9 reports. RESULTS: For the 3 large reports, both EPPI-Reviewer and Abstrackr performed well with potential reductions in screening burden of 4 to 49% (Abstrackr) and 9 to 60% (EPPI-Reviewer). Both tools had markedly poorer performance for 1 large report (inguinal hernia), possibly due to its heterogeneous key questions. Based on McNemar's test for paired proportions in the 3 large reports, EPPI-Reviewer outperformed Abstrackr for identifying articles ordered for full-text review, but Abstrackr performed better in 2 of 3 reports for identifying articles included in the final report. For small reports, both tools provided benefits but EPPI-Reviewer generally outperformed Abstrackr in both tasks, although these results were often not statistically significant. CONCLUSIONS: Abstrackr and EPPI-Reviewer performed well, but prioritization accuracy varied greatly across reports. Our work suggests screening prioritization functionality is a promising modality offering efficiency gains without giving up human involvement in the screening process.

Assessing the utility of genetic tests.

Genetic testing is a rapidly expanding area with many clinical applications. While the introduction of new genetic tests creates tremendous potential for improving patient care, it is essential to adequately evaluate these tests to ensure their accuracy and utility for clinical practice. This article describes a general approach to the evaluation of genetic tests and discusses common challenges that evaluators face. This article's goal was to provide a starting point for those who are concerned with the safety and utility of genetic tests to develop an overall strategy to perform the assessment.

In-facility delirium prevention programs as a patient safety strategy: a systematic review.

Delirium, an acute decline in attention and cognition, occurs among hospitalized patients at rates estimated to range from 14% to 56% and increases the risk for morbidity and mortality. The purpose of this systematic review was to evaluate the effectiveness and safety of in-facility multicomponent delirium prevention programs. A search of 6 databases (including MEDLINE, EMBASE, and CINAHL) was conducted through September 2012. Randomized, controlled trials; controlled clinical trials; interrupted time series; and controlled before-after studies with a prospective postintervention portion were eligible for inclusion. The evidence from 19 studies that met the inclusion criteria suggests that most multicomponent interventions are effective in preventing onset of delirium in at-risk patients in a hospital setting. Evidence was insufficient to determine the benefit of such programs in other care settings. Future comparative effectiveness studies with standardized protocols are needed to identify which components in multicomponent interventions are most effective for delirium prevention.

Stereotactic body radiation therapy: scope of the literature.

Stereotactic body radiation therapy (SBRT) is derived from the techniques of stereotactic radiosurgery used to treat lesions in the brain and spine. It combines multiple finely collimated radiation beams and stereotaxy to deliver a high dose of radiation to an extracranial target in the body in a single dose or a few fractions. This review provides a broad overview of the current state of SBRT for solid malignant tumors. Reviewers identified a total of 124 relevant studies. To our knowledge, no published comparative studies address the relative effectiveness and safety of SBRT versus other forms of external-beam radiation therapy. Stereotactic body radiation therapy seems to be widely diffused as a treatment of various types of cancer, although most studies have focused only on its use for treating thoracic tumors. Comparative studies are needed to provide evidence that the theoretical advantages of SBRT over other radiation therapies actually occur in the clinical setting; this area is currently being studied in only 1 small trial.

Autologous hematopoietic cell transplantation for multiple sclerosis: a systematic review.

BACKGROUND AND OBJECTIVES: The purpose of this systematic review was to evaluate the safety and efficacy of autologous hematopoietic cell transplantation in patients with progressive multiple sclerosis (MS) refractory to conventional medical treatment. METHODS: Eight case series met our a priori inclusion criteria for the primary outcome of progression-free survival. Individual study quality was rated using an 11-item scale for case series. The strength of the overall body of evidence for each outcome was rated using a system developed by the ECRI Institute. Data from different studies were statistically combined using meta-analysis. An additional six studies were included for a summary of mortality and morbidity. RESULTS: For secondary progressive MS, immunoablative therapy with autologous bone marrow/peripheral blood stem cell transplantation was associated with higher progression-free survival (up to 3 years following treatment) when using intermediate-intensity conditioning regimens compared with high-intensity conditioning regimens. The evidence was insufficient to determine whether the treatment was effective in patients with other types of MS. Treatment-related mortality was about 2.7%. CONCLUSIONS: Patients with secondary progressive MS refractory to conventional medical treatment have longer progression-free survival following autologous stem cell transplantation with intermediate-intensity conditioning regimens than with high-intensity conditioning regimens.

Opioid pharmacotherapy for chronic non-cancer pain in the United States: a research guideline for developing an evidence-base.

UNLABELLED: This document reports the consensus of an interdisciplinary panel of research and clinical experts charged with reviewing the use of opioids for chronic noncancer pain (CNCP) and formulating guidelines for future research. Prescribing opioids for chronic noncancer pain has recently escalated in the United States. Contrasting with increasing opioid use are: 1) The lack of evidence supporting long-term effectiveness; 2) Escalating misuse of prescription opioids including abuse and diversion; and 3) Uncertainty about the incidence and clinical salience of multiple, poorly characterized adverse drug events (ADEs) including endocrine dysfunction, immunosuppression and infectious disease, opioid-induced hyperalgesia and xerostomia, overdose, falls and fractures, and psychosocial complications. Chief among the limitations of current evidence are: 1) Sparse evidence on long-term opioid effectiveness in chronic pain patients due to the short-term time frame of clinical trials; 2) Insufficiently comprehensive outcome assessment; and 3) Incomplete identification and quantification of ADEs. The panel called for a strategic interdisciplinary approach to the problem domain in which basic scientists and clinicians cooperate to resolve urgent issues and generate a comprehensive evidence base. It offered 4 recommendations in 3 areas: 1) A research strategy for studying the effectiveness of long-term opioid pharmacotherapy; 2) Improvements in evidence-generation methodology; and 3) Potential research topics for generating new evidence. PERSPECTIVE: Prescribing opioids for CNCP has outpaced the growth of scientific evidence bearing on the benefits and harms of these interventions. The need for a strong evidence base is urgent. This guideline offers a strategic approach to creating a comprehensive evidence base to guide safe and effective management of CNCP.

Long-term opioid management for chronic noncancer pain.

BACKGROUND: Opioid therapy for chronic noncancer pain (CNCP) is controversial due to concerns regarding long-term effectiveness and safety, particularly the risk of tolerance, dependence, or abuse. OBJECTIVES: To assess safety, efficacy, and effectiveness of opioids taken long-term for CNCP. SEARCH STRATEGY: We searched 10 bibliographic databases up to May 2009. SELECTION CRITERIA: We searched for studies that: collected efficacy data on participants after at least 6 months of treatment; were full-text articles; did not include redundant data; were prospective; enrolled at least 10 participants; reported data of participants who had CNCP. Randomized controlled trials (RCTs) and pre-post case-series studies were included. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted safety and effectiveness data and settled discrepancies by consensus. We used random-effects meta-analysis' to summarize data where appropriate, used the I(2) statistic to quantify heterogeneity, and, where appropriate, explored heterogeneity using meta-regression. Several sensitivity analyses were performed to test the robustness of the results. MAIN RESULTS: We reviewed 26 studies with 27 treatment groups that enrolled a total of 4893 participants. Twenty five of the studies were case series or uncontrolled long-term trial continuations, the other was an RCT comparing two opioids. Opioids were administered orally (number of study treatments groups [abbreviated as "k"] = 12, n = 3040), transdermally (k = 5, n = 1628), or intrathecally (k = 10, n = 231). Many participants discontinued due to adverse effects (oral: 22.9% [95% confidence interval (CI): 15.3% to 32.8%]; transdermal: 12.1% [95% CI: 4.9% to 27.0%]; intrathecal: 8.9% [95% CI: 4.0% to 26.1%]); or insufficient pain relief (oral: 10.3% [95% CI: 7.6% to 13.9%]; intrathecal: 7.6% [95% CI: 3.7% to 14.8%]; transdermal: 5.8% [95% CI: 4.2% to 7.9%]). Signs of opioid addiction were reported in 0.27% of participants in the studies that reported that outcome. All three modes of administration were associated with clinically significant reductions in pain, but the amount of pain relief varied among studies. Findings regarding quality of life and functional status were inconclusive due to an insufficient quantity of evidence for oral administration studies and inconclusive statistical findings for transdermal and intrathecal administration studies. AUTHORS' CONCLUSIONS: Many patients discontinue long-term opioid therapy (especially oral opioids) due to adverse events or insufficient pain relief; however, weak evidence suggests that patients who are able to continue opioids long-term experience clinically significant pain relief. Whether quality of life or functioning improves is inconclusive. Many minor adverse events (like nausea and headache) occurred, but serious adverse events, including iatrogenic opioid addiction, were rare.

Alcohol consumption and cancer risk: understanding possible causal mechanisms for breast and colorectal cancers.

OBJECTIVES: The purpose of this report is to systematically examine the possible causal mechanism(s) that may explain the association between alcohol (ethanol) consumption and the risk of developing breast and colorectal cancers. DATA SOURCES: We searched 11 external databases, including PubMed® and Embase, for studies on possible mechanisms. These searches used Medical Subject Headings and free text words to identify relevant evidence. REVIEW METHODS: Two reviewers independently screened search results, selected studies to be included, and reviewed each trial for inclusion. We manually examined the bibliographies of included studies, scanned the content of new issues of selected journals, and reviewed relevant gray literature for potential additional articles. RESULTS: Breast Cancer. Five human and 15 animal studies identified in our searches point to a connection between alcohol intake and changes in important metabolic pathways that when altered may increase the risk of developing breast cancer. Alterations in blood hormone levels, especially elevated estrogen-related hormones, have been reported in humans. Several cell line studies suggest that the estrogen receptor pathways may be altered by ethanol. Increased estrogen levels may increase the risk of breast cancer through increases in cell proliferation and alterations in estrogen receptors. Human studies have also suggested a connection with prolactin and with biomarkers of oxidative stress. Of 15 animal studies, six reported increased mammary tumorigenesis (four administered a co-carcinogen and two did not). Other animal studies reported conversion of ethanol to acetaldehyde in mammary tissue as having a significant effect on the progression of tumor development. Fifteen cell line studies suggested the following mechanisms: Increased hormonal receptor levels. Increased cell proliferation. A direct stimulatory effect. DNA adduct formation. Increase cyclic adenosine monophosphate (camp). Change in potassium channels. Modulation of gene expression. Colorectal Cancer. One human tissue study, 19 animal studies (of which 12 administered a co-carcinogen and seven did not), and 10 cell line studies indicate that ethanol and acetaldehyde may alter metabolic pathways and cell structures that increase the risk of developing colon cancer. Exposure of human colonic biopsies to acetaldehyde suggests that acetaldehyde disrupts epithelial tight junctions. Among 19 animal studies the mechanisms considered included: Mucosal damage after ethanol consumption. Increased degradation of folate. Stimulation of rectal carcinogenesis. Increased cell proliferation. Increased effect of carcinogens. Ten cell line studies suggested: Folate uptake modulation. Tumor necrosis factor modulation. Inflammation and cell death. DNA adduct formation. Cell differentiation. Modulation of gene expression. One study used a combination of animal and cell line and suggested intestinal cell proliferation and disruption of cellular signals as possible mechanisms. CONCLUSIONS: Based on our systematic review of the literature, many potential mechanisms by which alcohol may influence the development of breast or colorectal cancers have been explored but the exact connection or connections remain unclear. The evidence points in several directions but the importance of any one mechanism is not apparent at this time.

Systematic review: comparative effectiveness of core-needle and open surgical biopsy to diagnose breast lesions.

BACKGROUND: Most women undergoing breast biopsy are found not to have cancer. PURPOSE: To compare the accuracy and harms of different breast biopsy methods in average-risk women suspected of having breast cancer. DATA SOURCES: Databases, including MEDLINE and EMBASE, searched from 1990 to September 2009. STUDY SELECTION: Studies that compared core-needle biopsy diagnoses with open surgical diagnoses or clinical follow-up. DATA EXTRACTION: Data were abstracted by 1 of 3 researchers and verified by the primary investigator. DATA SYNTHESIS: 33 studies of stereotactic automated gun biopsy; 22 studies of stereotactic-guided, vacuum-assisted biopsy; 16 studies of ultrasonography-guided, automated gun biopsy; 7 studies of ultrasonography-guided, vacuum-assisted biopsy; and 5 studies of freehand automated gun biopsy met the inclusion criteria. Low-strength evidence showed that core-needle biopsies conducted under stereotactic guidance with vacuum assistance distinguished between malignant and benign lesions with an accuracy similar to that of open surgical biopsy. Ultrasonography-guided biopsies were also very accurate. The risk for severe complications is lower with core-needle biopsy than with open surgical procedures (<1% vs. 2% to 10%). Moderate-strength evidence showed that women in whom breast cancer was initially diagnosed by core-needle biopsy were more likely than women with cancer initially diagnosed by open surgical biopsy to be treated with a single surgical procedure (random-effects odds ratio, 13.7 [95% CI, 5.5 to 34.6]). LIMITATION: The strength of evidence was rated low for accuracy outcomes because the studies did not report important details required to assess the risk for bias. CONCLUSION: Stereotactic- and ultrasonography-guided core-needle biopsy procedures seem to be almost as accurate as open surgical biopsy, with lower complication rates. PRIMARY FUNDING SOURCE: Agency for Healthcare Research and Quality.

Computer-aided detection mammography for breast cancer screening: systematic review and meta-analysis.

CONTEXT: Mammography is generally accepted as the best available breast cancer screening method; however, some cancers detectable on mammography images are missed. Computer-aided detection (CAD) systems for mammography are intended to reduce false negatives by marking suspicious areas of the mammograms for reviewers to consider. Although the prospect of improving the sensitivity of screening mammograms has led to the diffusion of CAD for mammography, little is known about its diagnostic accuracy. OBJECTIVE: To assess the diagnostic performance of CAD for screening mammography in terms of sensitivity and specificity and incremental recall, biopsy, and cancer diagnosis rates. DATA SOURCES: Published literature identified by systematic literature searches of 17 databases, including MEDLINE, EMBASE, and the Cochrane Library, searched through 25 September 2008. STUDY SELECTION: A reviewer and an information specialist selected full-length English-language articles that enrolled asymptomatic women for routine breast cancer screening and provided data needed for our analyses using criteria established a priori. We identified 75 potentially relevant publications, of which 7 (9%) were included. DATA EXTRACTION: Data were extracted and internal validity was assessed by a single review author, and forms were approved by the co-authors. RESULTS: Three studies (n = 347,324) reported sensitivity and specificity, or data to calculate them, and five studies (n = 51,162) reported data to calculate incremental rates of cancer diagnoses and recall and biopsy of women who did not have breast cancer. The pooled sensitivity was 86.0% (95% CI 84.2-87.6%) and specificity was 88.2% (95% CI 88.1-88.3%). Of the 100,000 women screened, CAD yielded an additional 50 (95% CI 30-80) correct breast cancer diagnoses, 1,190 (95% CI 1,090-1,290) recalls of healthy women, and 80 (95% CI 60-100) biopsies of healthy women. A total of 96% (95% CI 93.9-97.3%) of women recalled based upon CAD and 65.1% (95% CI 52.3-76.0%) of women biopsied based upon CAD were healthy. No studies reported patient-oriented clinical outcomes.

Systematic review and meta-analysis of bariatric surgery for pediatric obesity.

OBJECTIVE: The prevalence of morbid obesity has risen sharply in recent years, even among pediatric patients. Bariatric surgery is used increasingly in an effort to induce weight loss, improve medical comorbidities, enhance quality of life, and extend survival. We performed a systematic review and meta-analysis of all published evidence pertaining specifically to bariatric surgery in pediatric patients. METHODS: We systematically searched MEDLINE, EMBASE, 13 other databases, and article bibliographies to identify relevant evidence. Included studies must have reported outcome data for > or =3 patients aged < or =21, representing > or =50% of pediatric patients enrolled at that center. We only included English language articles on currently performed procedures when data were separated by procedure, and there was a minimum 1-year follow-up for weight and body mass index (BMI). RESULTS: Eight studies of laparoscopic adjustable gastric banding (LAGB) reported data on 352 patients (mean BMI 45.8); 6 studies of Roux-en-Y gastric bypass (RYGB) included 131 patients (mean BMI 51.8); 5 studies of other surgical procedures included 158 patients (mean BMI 48.8). Average patient age was 16.8 years (range, 9-21). Meta-analyses of BMI reductions at longest follow-up indicated sustained and clinically significant BMI reductions for both LAGB and RYGB. Comorbidity resolution was sparsely reported, but surgery did appear to resolve some medical conditions including diabetes and hypertension. For LAGB, band slippage and micronutrient deficiency were the most frequently reported complications, with sporadic cases of band erosion, port/tube dysfunction, hiatal hernia, wound infection, and pouch dilation. For RYGB, more severe complications have been documented, such as pulmonary embolism, shock, intestinal obstruction, postoperative bleeding, staple line leak, and severe malnutrition. CONCLUSIONS: Bariatric surgery in pediatric patients results in sustained and clinically significant weight loss, but also has the potential for serious complications.

Bariatric surgery: a systematic review and meta-analysis.

CONTEXT: About 5% of the US population is morbidly obese. This disease remains largely refractory to diet and drug therapy, but generally responds well to bariatric surgery. OBJECTIVE: To determine the impact of bariatric surgery on weight loss, operative mortality outcome, and 4 obesity comorbidities (diabetes, hyperlipidemia, hypertension, and obstructive sleep apnea). DATA SOURCES AND STUDY SELECTION: Electronic literature search of MEDLINE, Current Contents, and the Cochrane Library databases plus manual reference checks of all articles on bariatric surgery published in the English language between 1990 and 2003. Two levels of screening were used on 2738 citations. DATA EXTRACTION: A total of 136 fully extracted studies, which included 91 overlapping patient populations (kin studies), were included for a total of 22,094 patients. Nineteen percent of the patients were men and 72.6% were women, with a mean age of 39 years (range, 16-64 years). Sex was not reported for 1537 patients (8%). The baseline mean body mass index for 16 944 patients was 46.9 (range, 32.3-68.8). DATA SYNTHESIS: A random effects model was used in the meta-analysis. The mean (95% confidence interval) percentage of excess weight loss was 61.2% (58.1%-64.4%) for all patients; 47.5% (40.7%-54.2%) for patients who underwent gastric banding; 61.6% (56.7%-66.5%), gastric bypass; 68.2% (61.5%-74.8%), gastroplasty; and 70.1% (66.3%-73.9%), biliopancreatic diversion or duodenal switch. Operative mortality (< or =30 days) in the extracted studies was 0.1% for the purely restrictive procedures, 0.5% for gastric bypass, and 1.1% for biliopancreatic diversion or duodenal switch. Diabetes was completely resolved in 76.8% of patients and resolved or improved in 86.0%. Hyperlipidemia improved in 70% or more of patients. Hypertension was resolved in 61.7% of patients and resolved or improved in 78.5%. Obstructive sleep apnea was resolved in 85.7% of patients and was resolved or improved in 83.6% of patients. CONCLUSIONS: Effective weight loss was achieved in morbidly obese patients after undergoing bariatric surgery. A substantial majority of patients with diabetes, hyperlipidemia, hypertension, and obstructive sleep apnea experienced complete resolution or improvement.