Internalizing problems before and during the COVID-19 pandemic in independent samples of Dutch children and adolescents with and without pre-existing mental health problems.

The aim of the study was to assess internalizing problems before and during the pandemic with data from Dutch consortium Child and adolescent mental health and wellbeing in times of the COVID-19 pandemic, consisting of two Dutch general population samples (GS) and two clinical samples (CS) referred to youth/psychiatric care. Measures of internalizing problems were obtained from ongoing data collections pre-pandemic (NGS = 35,357; NCS = 4487) and twice during the pandemic, in Apr-May 2020 (NGS = 3938; clinical: NCS = 1008) and in Nov-Dec 2020 (NGS = 1489; NCS = 1536), in children and adolescents (8-18 years) with parent (Brief Problem Monitor) and/or child reports (Patient-Reported Outcomes Measurement Information System®). Results show that, in the general population, internalizing problems were higher during the first peak of the pandemic compared to pre-pandemic based on both child and parent reports. Yet, over the course of the pandemic, on both child and parent reports, similar or lower levels of internalizing problems were observed. Children in the clinical population reported more internalizing symptoms over the course of the pandemic while parents did not report differences in internalizing symptoms from pre-pandemic to the first peak of the pandemic nor over the course of the pandemic. Overall, the findings indicate that children and adolescents of both the general and clinical population were affected negatively by the pandemic in terms of their internalizing problems. Attention is therefore warranted to investigate long-term effects and to monitor if internalizing problems return to pre-pandemic levels or if they remain elevated post-pandemic.

Assessing the FAIRness of databases on the EHDEN portal: A case study on two Dutch ICU databases.

OBJECTIVE: To address the growing need for effective data reuse in health research, healthcare institutions need to make their data Findable, Accessible, Interoperable, and Reusable (FAIR). A prevailing method to model databases for interoperability is the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM), developed by the Observational Health Data Sciences and Informatics (OHDSI) initiative. A European repository for OMOP CDM-converted databases called the "European Health Data & Evidence Network (EHDEN) portal" was developed, aiming to make these databases Findable and Accessible. This paper aims to assess the FAIRness of databases on the EHDEN portal. MATERIALS AND METHODS: Two researchers involved in the OMOP CDM conversion of separate Dutch Intensive Care Unit (ICU) research databases each manually assessed their own database using seventeen metrics. These were defined by the FAIRsFAIR project as a list of minimum requirements for a database to be FAIR. Each metric is given a score from zero to four based on how well the database adheres to the metric. The maximum score for each metric varies from one to four based on the importance of the metric. RESULTS: Fourteen out of the seventeen metrics were unanimously rated: seven were rated the highest score, one was rated half of the highest score, and five were rated the lowest score. The remaining three metrics were assessed differently for the two use cases. The total scores achieved were 15.5 and 12 out of a maximum of 25. CONCLUSION: The main omissions in supporting FAIRness were the lack of globally unique identifiers such as Uniform Resource Identifiers (URIs) in the OMOP CDM and the lack of metadata standardization and linkage in the EHDEN portal. By implementing these in future updates, the EHDEN portal can be more FAIR.

Determining and assessing characteristics of data element names impacting the performance of annotation using Usagi.

INTRODUCTION: Hospitals generate large amounts of data and this data is generally modeled and labeled in a proprietary way, hampering its exchange and integration. Manually annotating data element names to internationally standardized data element identifiers is a time-consuming effort. Tools can support performing this task automatically. This study aimed to determine what factors influence the quality of automatic annotations. METHODS: Data element names were used from the Dutch COVID-19 ICU Data Warehouse containing data on intensive care patients with COVID-19 from 25 hospitals in the Netherlands. In this data warehouse, the data had been merged using a proprietary terminology system while also storing the original hospital labels (synonymous names). Usagi, an OHDSI annotation tool, was used to perform the annotation for the data. A gold standard was used to determine if Usagi made correct annotations. Logistic regression was used to determine if the number of characters, number of words, match score (Usagi's certainty) and hospital label origin influenced Usagi's performance to annotate correctly. RESULTS: Usagi automatically annotated 30.5% of the data element names correctly and 5.5% of the synonymous names. The match score is the best predictor for Usagi finding the correct annotation. It was determined that the AUC of data element names was 0.651 and 0.752 for the synonymous names respectively. The AUC for the individual hospital label origins varied between 0.460 to 0.905. DISCUSSION: The results show that Usagi performed better to annotate the data element names than the synonymous names. The hospital origin in the synonymous names dataset was associated with the amount of correctly annotated concepts. Hospitals that performed better had shorter synonymous names and fewer words. Using shorter data element names or synonymous names should be considered to optimize the automatic annotating process. Overall, the performance of Usagi is too poor to completely rely on for automatic annotation.

The Case Manager: An Agent Controlling the Activation of Knowledge Sources in a FHIR-Based Distributed Reasoning Environment.

BACKGROUND: Within the CAPABLE project the authors developed a multi-agent system that relies on a distributed architecture. The system provides cancer patients with coaching advice and supports their clinicians with suitable decisions based on clinical guidelines. OBJECTIVES: As in many multi-agent systems we needed to coordinate the activities of all agents involved. Moreover, since the agents share a common blackboard where all patients' data are stored, we also needed to implement a mechanism for the prompt notification of each agent upon addition of new information potentially triggering its activation. METHODS: The communication needs have been investigated and modeled using the HL7-FHIR (Health Level 7-Fast Healthcare Interoperability Resources) standard to ensure proper semantic interoperability among agents. Then a syntax rooted in the FHIR search framework has been defined for representing the conditions to be monitored on the system blackboard for activating each agent. RESULTS: The Case Manager (CM) has been implemented as a dedicated component playing the role of an orchestrator directing the behavior of all agents involved. Agents dynamically inform the CM about the conditions to be monitored on the blackboard, using the syntax we developed. The CM then notifies each agent whenever any condition of interest occurs. The functionalities of the CM and other actors have been validated using simulated scenarios mimicking the ones that will be faced during pilot studies and in production. CONCLUSION: The CM proved to be a key facilitator for properly achieving the required behavior of our multi-agent system. The proposed architecture may also be leveraged in many clinical contexts for integrating separate legacy services, turning them into a consistent telemedicine framework and enabling application reusability.

The effects of COVID-19 on child mental health: Biannual assessments up to April 2022 in a clinical and two general population samples.

Background: The COVID-19 pandemic has had an acute impact on child mental and social health, but long-term effects are still unclear. We examined how child mental health has developed since the start of the COVID-19 pandemic up to 2 years into the pandemic (April 2022). Methods: We included children (age 8-18) from two general population samples (N = 222-1333 per measurement and N = 2401-13,362 for pre-covid data) and one clinical sample receiving psychiatric care (N = 334-748). Behavioral questionnaire data were assessed five times from April 2020 till April 2022 and pre-pandemic data were available for both general population samples. We collected parent-reported data on internalizing and externalizing problems with the Brief Problem Monitor and self-reported data on Anxiety, Depressive symptoms, Sleep-related impairments, Anger, Global health, and Peer relations with the Patient-Reported Outcomes Measurement Information System (PROMIS®). Results: In all samples, parents reported overall increased internalizing problems, but no increases in externalizing problems, in their children. Children from the general population self-reported increased mental health problems from before to during the pandemic on all six PROMIS domains, with generally worst scores in April 2021, and scores improving toward April 2022 but not to pre-pandemic norms. Children from the clinical sample reported increased mental health problems throughout the pandemic, with generally worst scores in April 2021 or April 2022 and no improvement. We found evidence of minor age effects and no sex effects. Conclusions: Child mental health in the general population has deteriorated during the first phase of the COVID-19 pandemic, has improved since April 2021, but has not yet returned to pre-pandemic levels. Children in psychiatric care show worsening of mental health problems during the pandemic, which has not improved since. Changes in child mental health should be monitored comprehensively to inform health care and policy.