GPT-4 performance on querying scientific publications: reproducibility, accuracy, and impact of an instruction sheet.

BACKGROUND: Large language models (LLMs) that can efficiently screen and identify studies meeting specific criteria would streamline literature reviews. Additionally, those capable of extracting data from publications would enhance knowledge discovery by reducing the burden on human reviewers. METHODS: We created an automated pipeline utilizing OpenAI GPT-4 32 K API version "2023-05-15" to evaluate the accuracy of the LLM GPT-4 responses to queries about published papers on HIV drug resistance (HIVDR) with and without an instruction sheet. The instruction sheet contained specialized knowledge designed to assist a person trying to answer questions about an HIVDR paper. We designed 60 questions pertaining to HIVDR and created markdown versions of 60 published HIVDR papers in PubMed. We presented the 60 papers to GPT-4 in four configurations: (1) all 60 questions simultaneously; (2) all 60 questions simultaneously with the instruction sheet; (3) each of the 60 questions individually; and (4) each of the 60 questions individually with the instruction sheet. RESULTS: GPT-4 achieved a mean accuracy of 86.9% - 24.0% higher than when the answers to papers were permuted. The overall recall and precision were 72.5% and 87.4%, respectively. The standard deviation of three replicates for the 60 questions ranged from 0 to 5.3% with a median of 1.2%. The instruction sheet did not significantly increase GPT-4's accuracy, recall, or precision. GPT-4 was more likely to provide false positive answers when the 60 questions were submitted individually compared to when they were submitted together. CONCLUSIONS: GPT-4 reproducibly answered 3600 questions about 60 papers on HIVDR with moderately high accuracy, recall, and precision. The instruction sheet's failure to improve these metrics suggests that more sophisticated approaches are necessary. Either enhanced prompt engineering or finetuning an open-source model could further improve an LLM's ability to answer questions about highly specialized HIVDR papers.

How to harness the power of web scraping for medical and surgical research: An application in estimating international collaboration.

The transformative potential of web scraping in surgical research through a comprehensive analysis of its revolutionary applications and profound impact is now within reach. This manuscript unveils the pivotal role of web scraping in driving innovation, enabling more effective management of human capital dynamics, and enhancing patient outcomes in the surgical field. As an example, we demonstrate how web scraping can uncover insights into international collaboration in surgery research revealing limited collaboration between surgeons in developed and developing countries.

An automated process for bulk downloading optical coherence tomography scans.

OBJECTIVE: To develop an automated method for efficiently downloading a large number of optical coherence tomography (OCT) scans obtained using the Heidelberg Spectralis (Heidelberg Engineering, Heidelberg, Germany) platform. METHODS: The electronic medical records and OCT scans were extracted for all patients with age-related macular degeneration treated at the Hadassah University Hospital Retina Clinic between 2010 and 2021. A macro was created using Visual Basic for Applications (VBA) and Microsoft Excel to automate the export process and anonymize the OCT scans in accordance with hospital policy. OCT scans were extracted as proprietary Heidelberg E2E files. RESULTS: The VBA macro was used to export a total of 94,789 E2E files from 2807 patient records, with an average processing time of 4.32 min per volume scan (SD: 3.57 min). The entire export process took a total of approximately 202 h to complete over a period of 24 days. In a smaller sample, using the macro to download the scans was significantly faster than manually downloading the scans, averaging 3.88 vs. 11.08 min/file, respectively (t = 8.59, p < 0.001). Finally, we found that exporting the files during both off-clinic and working hours resulted in significantly faster processing times compared to exporting the files solely during working hours (t = 5.77, p < 0.001). CONCLUSIONS: This study demonstrates the feasibility of using VBA and Excel to automate the process for bulk downloading data from a specific medical imaging platform. The specific steps and techniques will likely vary depending on the software used and hospital constraints and should be determined for each application.

A pragmatic methodology to extract anesthetic and physiological data from the electronic health record.

BACKGROUND/AIMS: Traditional manual methods of extracting anesthetic and physiological data from the electronic health record rely upon visual transcription by a human analyst that can be labor-intensive and prone to error. Technical complexity, relative inexperience in computer coding, and decreased access to data warehouses can deter investigators from obtaining valuable electronic health record data for research studies, especially in under-resourced settings. We therefore aimed to develop, pilot, and demonstrate the effectiveness and utility of a pragmatic data extraction methodology. METHODS: Expired sevoflurane concentration data from the electronic health record transcribed by eye was compared to an intermediate preprocessing method in which the entire anesthetic flowsheet narrative report was selected, copy-pasted, and processed using only Microsoft Word and Excel software to generate a comma-delimited (.csv) file. A step-by-step presentation of this method is presented. Concordance rates, Pearson correlation coefficients, and scatterplots with lines of best fit were used to compare the two methods of data extraction. RESULTS: A total of 1132 datapoints across eight subjects were analyzed, accounting for 18.9 h of anesthesia time. There was a high concordance rate of data extracted using the two methods (median concordance rate 100% range [96%, 100%]). The median time required to complete manual data extraction was significantly longer compared to the time required using the intermediate method (240 IQR [199, 482.5] seconds vs 92.5 IQR [69, 99] seconds, p = .01) and was linearly associated with the number of datapoints (rmanual = .97, p < .0001), whereas time required to complete data extraction using the intermediate approach was independent of the number of datapoints (rintermediate = -.02, p = .99). CONCLUSIONS: We describe a pragmatic data extraction methodology that does not require additional software or coding skills intended to enhance the ease, speed, and accuracy of data collection that could assist in clinician investigator-initiated research and quality/process improvement projects.

An Entity Extraction Pipeline for Medical Text Records Using Large Language Models: Analytical Study.

BACKGROUND: The study of disease progression relies on clinical data, including text data, and extracting valuable features from text data has been a research hot spot. With the rise of large language models (LLMs), semantic-based extraction pipelines are gaining acceptance in clinical research. However, the security and feature hallucination issues of LLMs require further attention. OBJECTIVE: This study aimed to introduce a novel modular LLM pipeline, which could semantically extract features from textual patient admission records. METHODS: The pipeline was designed to process a systematic succession of concept extraction, aggregation, question generation, corpus extraction, and question-and-answer scale extraction, which was tested via 2 low-parameter LLMs: Qwen-14B-Chat (QWEN) and Baichuan2-13B-Chat (BAICHUAN). A data set of 25,709 pregnancy cases from the People's Hospital of Guangxi Zhuang Autonomous Region, China, was used for evaluation with the help of a local expert's annotation. The pipeline was evaluated with the metrics of accuracy and precision, null ratio, and time consumption. Additionally, we evaluated its performance via a quantified version of Qwen-14B-Chat on a consumer-grade GPU. RESULTS: The pipeline demonstrates a high level of precision in feature extraction, as evidenced by the accuracy and precision results of Qwen-14B-Chat (95.52% and 92.93%, respectively) and Baichuan2-13B-Chat (95.86% and 90.08%, respectively). Furthermore, the pipeline exhibited low null ratios and variable time consumption. The INT4-quantified version of QWEN delivered an enhanced performance with 97.28% accuracy and a 0% null ratio. CONCLUSIONS: The pipeline exhibited consistent performance across different LLMs and efficiently extracted clinical features from textual data. It also showed reliable performance on consumer-grade hardware. This approach offers a viable and effective solution for mining clinical research data from textual records.

Training Service Users in the Use of Telehealth: Scoping Review.

BACKGROUND: The use of telehealth has rapidly increased, yet some populations may be disproportionally excluded from accessing and using this modality of care. Training service users in telehealth may increase accessibility for certain groups. The extent and nature of these training activities have not been explored. OBJECTIVE: The objective of this scoping review is to identify and describe activities for training service users in the use of telehealth. METHODS: Five databases (MEDLINE [via PubMed], Embase, CINAHL, PsycINFO, and Web of Science) were searched in June 2023. Studies that described activities to train service users in the use of synchronous telehealth consultations were eligible for inclusion. Studies that focused on health care professional education were excluded. Papers were limited to those published in the English language. The review followed the Joanna Briggs Institute guidelines for scoping reviews and was reported in line with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Titles and abstracts were screened by 1 reviewer (EG). Full texts were screened by 2 reviewers (EG and JH or SC). Data extraction was guided by the research question. RESULTS: The search identified 8087 unique publications. In total, 13 studies met the inclusion criteria. Telehealth training was commonly described as once-off preparatory phone calls to service users before a telehealth visit, facilitated primarily by student volunteers, and accompanied by written instructions. The training content included guidance on how to download and install software, troubleshoot technical issues, and adjust device settings. Older adults were the most common target population for the training. All but 1 of the studies were conducted during the COVID-19 pandemic. Overall, training was feasible and well-received by service users, and studies mostly reported increased rates of video visits following training. There was limited and mixed evidence that training improved participants' competency with telehealth. CONCLUSIONS: The review mapped the literature on training activities for service users in telehealth. The common features of telehealth training for service users included once-off preparatory phone calls on the technical elements of telehealth, targeted at older adults. Key issues for consideration include the need for co-designed training and improving the broader digital skills of service users. There is a need for further studies to evaluate the outcomes of telehealth training activities in geographically diverse areas.

Enhancing clinical data retrieval with Smart Watchers: a NiFi-based ETL pipeline for Elasticsearch queries.

BACKGROUND: The aim is to develop and deploy an automated clinical alert system to enhance patient care and streamline healthcare operations. Structured and unstructured data from multiple sources are used to generate near real-time alerts for specific clinical scenarios, with an additional goal to improve clinical decision-making through accuracy and reliability. METHODS: The automated clinical alert system, named Smart Watchers, was developed using Apache NiFi and Python scripts to create flexible data processing pipelines and customisable clinical alerts. A comparative analysis between Smart Watchers and the legacy Elastic Watchers was conducted to evaluate performance metrics such as accuracy, reliability, and scalability. The evaluation involved measuring the time taken for manual data extraction through the electronic patient record (EPR) front-end and comparing it with the automated data extraction process using Smart Watchers. RESULTS: Deployment of Smart Watchers showcased a consistent time savings between 90% to 98.67% compared to manual data extraction through the EPR front-end. The results demonstrate the efficiency of Smart Watchers in automating data extraction and alert generation, significantly reducing the time required for these tasks when compared to manual methods in a scalable manner. CONCLUSIONS: The research underscores the utility of employing an automated clinical alert system, and its portability facilitated its use across multiple clinical settings. The successful implementation and positive impact of the system lay a foundation for future technological innovations in this rapidly evolving field.

Impact of data extraction errors in meta-analyses on the association between depression and peripheral inflammatory biomarkers: an umbrella review.

BACKGROUND: Accumulating evidence suggests that alterations in inflammatory biomarkers are important in depression. However, previous meta-analyses disagree on these associations, and errors in data extraction may account for these discrepancies. METHODS: PubMed/MEDLINE, Embase, PsycINFO, and the Cochrane Library were searched from database inception to 14 January 2020. Meta-analyses of observational studies examining the association between depression and levels of tumor necrosis factor-α (TNF-α), interleukin 1-ß (IL-1ß), interleukin-6 (IL-6), and C-reactive protein (CRP) were eligible. Errors were classified as follows: incorrect sample sizes, incorrectly used standard deviation, incorrect participant inclusion, calculation error, or analysis with insufficient data. We determined their impact on the results after correction thereof. RESULTS: Errors were noted in 14 of the 15 meta-analyses included. Across 521 primary studies, 118 (22.6%) showed the following errors: incorrect sample sizes (20 studies, 16.9%), incorrect use of standard deviation (35 studies, 29.7%), incorrect participant inclusion (7 studies, 5.9%), calculation errors (33 studies, 28.0%), and analysis with insufficient data (23 studies, 19.5%). After correcting these errors, 11 (29.7%) out of 37 pooled effect sizes changed by a magnitude of more than 0.1, ranging from 0.11 to 1.15. The updated meta-analyses showed that elevated levels of TNF- α, IL-6, CRP, but not IL-1ß, are associated with depression. CONCLUSIONS: These findings show that data extraction errors in meta-analyses can impact findings. Efforts to reduce such errors are important in studies of the association between depression and peripheral inflammatory biomarkers, for which high heterogeneity and conflicting results have been continuously reported.

Nontarget Analysis and Comprehensive Characterization of Iodinated Polyfluoroalkyl Acids in Wastewater and River Water by LC-HRMS with Cascade Precursor-Ion Exclusions and Algorithmic Approach.

Poly- and perfluoroalkyl acids (PFAAs) are a large family of widespread contaminants of worldwide concern and well-known as "forever chemicals". Direct emission of PFAAs from the fluorochemical industry is a crucial source of PFAA pollutants in the environment. This study implemented nontarget analysis and comprehensive characterization for a category of new PFAA contaminants, i.e., iodinated PFAAs (IPFAAs), in fluorochemical industry wastewater and relevant contaminated river water by liquid chromatography-high-resolution mass spectrometry with a cascade precursor ion exclusion (PIE) strategy and in-house developed data extraction and processing algorithms. A total of 26 IPFAAs (including 2 isomers of an IPFAA) were found and identified with tentative molecular structures. Semiquantification of the IPFAAs was implemented, and the total concentrations of IPFAAs were 0.16-285.52 and 0.15-0.17 µg/L in wastewater and river water, respectively. The high concentrations in association with the predicted ecotoxicities and environmental behaviors demonstrate that these IPFAAs are worthy of more concern and further in-depth research. The cascade PIE strategy along with the data extraction and processing algorithms can be extended to nontarget analysis for other pollutants beyond IPFAAs. The nontarget identification and characterization outcomes provide new understanding on the environmental occurrence and pollution status of IPFAAs from a comprehensive perspective.

Effectiveness of eHealth Smoking Cessation Interventions: Systematic Review and Meta-Analysis.

BACKGROUND: Rapid advancements in eHealth and mobile health (mHealth) technologies have driven researchers to design and evaluate numerous technology-based interventions to promote smoking cessation. The evolving nature of cessation interventions emphasizes a strong need for knowledge synthesis. OBJECTIVE: This systematic review and meta-analysis aimed to summarize recent evidence from randomized controlled trials regarding the effectiveness of eHealth-based smoking cessation interventions in promoting abstinence and assess nonabstinence outcome indicators, such as cigarette consumption and user satisfaction, via narrative synthesis. METHODS: We searched for studies published in English between 2017 and June 30, 2022, in 4 databases: PubMed (including MEDLINE), PsycINFO, Embase, and Cochrane Library. Two independent reviewers performed study screening, data extraction, and quality assessment based on the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) framework. We pooled comparable studies based on the population, follow-up time, intervention, and control characteristics. Two researchers performed an independent meta-analysis on smoking abstinence using the Sidik-Jonkman random-effects model and log risk ratio (RR) as the effect measurement. For studies not included in the meta-analysis, the outcomes were narratively synthesized. RESULTS: A total of 464 studies were identified through an initial database search after removing duplicates. Following screening and full-text assessments, we deemed 39 studies (n=37,341 participants) eligible for this review. Of these, 28 studies were shortlisted for meta-analysis. According to the meta-analysis, SMS or app text messaging can significantly increase both short-term (3 months) abstinence (log RR=0.50, 95% CI 0.25-0.75; I2=0.72%) and long-term (6 months) abstinence (log RR=0.77, 95% CI 0.49-1.04; I2=8.65%), relative to minimal cessation support. The frequency of texting did not significantly influence treatment outcomes. mHealth apps may significantly increase abstinence in the short term (log RR=0.76, 95% CI 0.09-1.42; I2=88.02%) but not in the long term (log RR=0.15, 95% CI -0.18 to 0.48; I2=80.06%), in contrast to less intensive cessation support. In addition, personalized or interactive interventions showed a moderate increase in cessation for both the short term (log RR=0.62, 95% CI 0.30-0.94; I2=66.50%) and long term (log RR=0.28, 95% CI 0.04-0.53; I2=73.42%). In contrast, studies without any personalized or interactive features had no significant impact. Finally, the treatment effect was similar between trials that used biochemically verified or self-reported abstinence. Among studies reporting outcomes besides abstinence (n=20), a total of 11 studies reported significantly improved nonabstinence outcomes in cigarette consumption (3/14, 21%) or user satisfaction (8/19, 42%). CONCLUSIONS: Our review of 39 randomized controlled trials found that recent eHealth interventions might promote smoking cessation, with mHealth being the dominant approach. Despite their success, the effectiveness of such interventions may diminish with time. The design of more personalized interventions could potentially benefit future studies. TRIAL REGISTRATION: PROSPERO CRD42022347104; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=347104.

Modeling and Optimization of LoRa Networks under Multiple Constraints.

With the access of massive terminals of the Internet of Things (IoT), the low-power wide-area networks (LPWAN) applications represented by Long Range Radio (LoRa) will grow extensively in the future. The specific Long Range Wide Area Network (LoRaWAN) protocol within the LoRa network considers both low power consumption and long-range communication. It can optimize data transmission to achieve low communication latency, ensuring a responsive system and a favorable user experience. However, due to the limited resources in LoRa networks, if certain terminals have heavy traffic loads, it may result in unfair impacts on other terminals, leading to increased data transmission latency and disrupted operations for other terminals. Therefore, effectively optimizing resource allocation in LoRa networks has become a key issue in enhancing LoRa transmission performance. In this paper, a Mixed Integer Linear Programming (MILP) model is proposed to minimize network energy consumption under the maximization of user fairness as the optimization goal, which considers the constraints in the system to achieve adaptive resource allocation for spreading factor and transmission power. In addition, an efficient algorithm is proposed to solve this optimization problem by combining the Gurobi mathematical solver and heuristic genetic algorithm. The numerical results show that the proposed algorithm can significantly reduce the number of packet collisions, effectively minimize network energy consumption, as well as offering favorable fairness among terminals.

LoRa-Based IoT Network Assessment in Rural and Urban Scenarios.

The implementation of smart networks has made great progress due to the development of the Internet of Things (IoT). LoRa is one of the most prominent technologies in the Internet of Things industry, primarily due to its ability to achieve long-distance transmission while consuming less power. In this work, we modeled different environments and assessed the performances of networks by observing the effects of various factors and network parameters. The path loss model, the deployment area size, the transmission power, the spreading factor, the number of nodes and gateways, and the antenna gain have a significant effect on the main performance metrics such as the energy consumption and the data extraction rate of a LoRa network. In order to examine these parameters, we performed simulations in OMNeT++ using the open source framework FLoRa. The scenarios which were investigated in this work include the simulation of rural and urban environments and a parking area model. The results indicate that the optimization of the key parameters could have a huge impact on the deployment of smart networks.

Rule-based natural language processing for automation of stroke data extraction: a validation study.

PURPOSE: Data extraction from radiology free-text reports is time consuming when performed manually. Recently, more automated extraction methods using natural language processing (NLP) are proposed. A previously developed rule-based NLP algorithm showed promise in its ability to extract stroke-related data from radiology reports. We aimed to externally validate the accuracy of CHARTextract, a rule-based NLP algorithm, to extract stroke-related data from free-text radiology reports. METHODS: Free-text reports of CT angiography (CTA) and perfusion (CTP) studies of consecutive patients with acute ischemic stroke admitted to a regional stroke center for endovascular thrombectomy were analyzed from January 2015 to 2021. Stroke-related variables were manually extracted as reference standard from clinical reports, including proximal and distal anterior circulation occlusion, posterior circulation occlusion, presence of ischemia or hemorrhage, Alberta stroke program early CT score (ASPECTS), and collateral status. These variables were simultaneously extracted using a rule-based NLP algorithm. The NLP algorithm's accuracy, specificity, sensitivity, positive predictive value (PPV), and negative predictive value (NPV) were assessed. RESULTS: The NLP algorithm's accuracy was > 90% for identifying distal anterior occlusion, posterior circulation occlusion, hemorrhage, and ASPECTS. Accuracy was 85%, 74%, and 79% for proximal anterior circulation occlusion, presence of ischemia, and collateral status respectively. The algorithm confirmed the absence of variables from radiology reports with an 87-100% accuracy. CONCLUSIONS: Rule-based NLP has a moderate to good performance for stroke-related data extraction from free-text imaging reports. The algorithm's accuracy was affected by inconsistent report styles and lexicon among reporting radiologists.

Primary care virtual resource use prior and post COVID-19 pandemic onset.

BACKGROUND: The COVID-19 pandemic has been a catalyst for rapid uptake of virtual care through the use of virtual health resources (VHR). In the Department of Veterans Affairs (VA) Healthcare System, virtual care has been critical to maintaining healthcare access for patients during COVID-19. In the current study we describe primary care patient aligned care team (PACT) VHR use patterns within one VA medical center (i.e., hospital facility and five community-based outpatient clinics) pre- and post-COVID-19 onset. METHODS: VHR provider and patient use data from 106 individual PACTs were extracted monthly between September 2019 to September 2020. Data were extracted from VHA web-based project application and tracking databases. Using longitudinal data, mixed effect models were used to compare pre- and post-COVID onset slopes. RESULTS: Findings highlight an increase in patient users of secure messaging (SM) and telehealth. The rate of utilization among these patients increased for SM but not for telehealth visits or online prescription refill (RxRefill) use. Finally, VetLink Kiosk check ins that are done at in person visits, diminished abruptly after COVID-19 onset. CONCLUSIONS: These data provide a baseline of VHR use at the PACT level after the initial impact of the COVID-19 pandemic and can inform healthcare delivery changes within the VA systems over time. Moreover, this project produced a data extraction blueprint, that is the first of its kind to track VA VHR use leveraging secondary data sources.

A Hybrid Architecture (CO-CONNECT) to Facilitate Rapid Discovery and Access to Data Across the United Kingdom in Response to the COVID-19 Pandemic: Development Study.

BACKGROUND: COVID-19 data have been generated across the United Kingdom as a by-product of clinical care and public health provision, as well as numerous bespoke and repurposed research endeavors. Analysis of these data has underpinned the United Kingdom's response to the pandemic, and informed public health policies and clinical guidelines. However, these data are held by different organizations, and this fragmented landscape has presented challenges for public health agencies and researchers as they struggle to find relevant data to access and interrogate the data they need to inform the pandemic response at pace. OBJECTIVE: We aimed to transform UK COVID-19 diagnostic data sets to be findable, accessible, interoperable, and reusable (FAIR). METHODS: A federated infrastructure model (COVID - Curated and Open Analysis and Research Platform [CO-CONNECT]) was rapidly built to enable the automated and reproducible mapping of health data partners' pseudonymized data to the Observational Medical Outcomes Partnership Common Data Model without the need for any data to leave the data controllers' secure environments, and to support federated cohort discovery queries and meta-analysis. RESULTS: A total of 56 data sets from 19 organizations are being connected to the federated network. The data include research cohorts and COVID-19 data collected through routine health care provision linked to longitudinal health care records and demographics. The infrastructure is live, supporting aggregate-level querying of data across the United Kingdom. CONCLUSIONS: CO-CONNECT was developed by a multidisciplinary team. It enables rapid COVID-19 data discovery and instantaneous meta-analysis across data sources, and it is researching streamlined data extraction for use in a Trusted Research Environment for research and public health analysis. CO-CONNECT has the potential to make UK health data more interconnected and better able to answer national-level research questions while maintaining patient confidentiality and local governance procedures.

Automatic data extraction to support meta-analysis statistical analysis: a case study on breast cancer.

BACKGROUND: Meta-analyses aggregate results of different clinical studies to assess the effectiveness of a treatment. Despite their importance, meta-analyses are time-consuming and labor-intensive as they involve reading hundreds of research articles and extracting data. The number of research articles is increasing rapidly and most meta-analyses are outdated shortly after publication as new evidence has not been included. Automatic extraction of data from research articles can expedite the meta-analysis process and allow for automatic updates when new results become available. In this study, we propose a system for automatically extracting data from research abstracts and performing statistical analysis. MATERIALS AND METHODS: Our corpus consists of 1011 PubMed abstracts of breast cancer randomized controlled trials annotated with the core elements of clinical trials: Participants, Intervention, Control, and Outcomes (PICO). We proposed a BERT-based named entity recognition (NER) model to identify PICO information from research abstracts. After extracting the PICO information, we parse numeric outcomes to identify the number of patients having certain outcomes for statistical analysis. RESULTS: The NER model extracted PICO elements with relatively high accuracy, achieving F1-scores greater than 0.80 in most entities. We assessed the performance of the proposed system by reproducing the results of an existing meta-analysis. The data extraction step achieved high accuracy, however the statistical analysis step achieved low performance because abstracts sometimes lack all the required information. CONCLUSION: We proposed a system for automatically extracting data from research abstracts and performing statistical analysis. We evaluated the performance of the system by reproducing an existing meta-analysis and the system achieved a relatively good performance, though more substantiation is required.

Real-Time Energy Data Acquisition, Anomaly Detection, and Monitoring System: Implementation of a Secured, Robust, and Integrated Global IIoT Infrastructure with Edge and Cloud AI.

The industrial internet of things (IIoT), a leading technology to digitize industrial sectors and applications, requires the integration of edge and cloud computing, cyber security, and artificial intelligence to enhance its efficiency, reliability, and sustainability. However, the collection of heterogeneous data from individual sensors as well as monitoring and managing large databases with sufficient security has become a concerning issue for the IIoT framework. The development of a smart and integrated IIoT infrastructure can be a possible solution that can efficiently handle the aforementioned issues. This paper proposes an AI-integrated, secured IIoT infrastructure incorporating heterogeneous data collection and storing capability, global inter-communication, and a real-time anomaly detection model. To this end, smart data acquisition devices are designed and developed through which energy data are transferred to the edge IIoT servers. Hash encoding credentials and transport layer security protocol are applied to the servers. Furthermore, these servers can exchange data through a secured message queuing telemetry transport protocol. Edge and cloud databases are exploited to handle big data. For detecting the anomalies of individual electrical appliances in real-time, an algorithm based on a group of isolation forest models is developed and implemented on edge and cloud servers as well. In addition, remote-accessible online dashboards are implemented, enabling users to monitor the system. Overall, this study covers hardware design; the development of open-source IIoT servers and databases; the implementation of an interconnected global networking system; the deployment of edge and cloud artificial intelligence; and the development of real-time monitoring dashboards. Necessary performance results are measured, and they demonstrate elaborately investigating the feasibility of the proposed IIoT framework at the end.

Establishing a Valid, Reliable, and Efficient Chart Review Process for Research in Pediatric Integrated Primary Care Psychology.

Retrospective chart review is an accessible form of research that is commonly used across medical fields but is underutilized in behavioral health. As a relatively newer area of research, the field of pediatric integrated primary care (IPC) would particularly benefit from guidelines for conducting a methodologically sound chart review study. Here, we use our experiences building a chart review procedure for a pediatric IPC research project to offer strategies for optimizing reliability (consistency), validity (accuracy), and efficiency. We aim to provide guidance for conducting a chart review study in the specific setting of pediatric IPC so that researchers can apply this methodology toward generating research in this field.

Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews.

BACKGROUND: Previous research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews. METHODS: We included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively. RESULTS: Of the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%). CONCLUSIONS: Reporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses.

A new method for testing reproducibility in systematic reviews was developed, but needs more testing.

BACKGROUND: To develop and test an approach to test reproducibility of SRs. METHODS: Case study. We have developed an approach to test reproducibility retrospectively while focusing on the whole conduct of an SR instead of single steps of it. We replicated the literature searches and drew a 25% random sample followed by study selection, data extraction, and risk of bias (ROB) assessments performed by two reviewers independently. These results were compared narratively with the original review. RESULTS: We were not able to fully reproduce the original search resulting in minor differences in the number of citations retrieved. The biggest disagreements were found in study selection. The most difficult section to be reproduced was the RoB assessment due to the lack of reporting clear criteria to support the judgement of RoB ratings, although agreement was still found to be satisfactory. CONCLUSION: Our approach as well as other approaches needs to undergo testing and comparison in the future as the area of testing for reproducibility of SRs is still in its infancy.