Experience with the use of a digital sleep diary in symptom management by individuals with insomnia -a pilot mixed method study.

Background: Insomnia is the most common sleep disorder. The recommended treatment is cognitive behavioural therapy for insomnia (CBTi). A sleep diary is a core tool in CBTi. We have developed a digital sleep diary with a standardised feedback function. Aim: To study feasibility of the digital sleep diary in participants of the Akershus Sleep Apnea (ASAP) cohorts with difficulties falling asleep or maintaining sleep. To describe sleep diary engagement and explore experiences with the digital sleep diary with potential influences in insomnia symptom management. Material and methods: Twenty participants were recruited from the ASAP. All filled out a digital sleep diary up to 12 weeks. Treatment options provided were a self-help book (N = 11) or electroencephalography neurofeedback (N = 9) in addition to the sleep diary standardised feedback function. We collected quantitative data from the sleep diary reports and we sub-divided insomnia by sleep onset insomnia and non-sleep onset insomnia. Finally, we performed qualitative interviews. Results: The median number of entries to the sleep diary was 81 (25th quartile: 26, 75th quartile 84). In the qualitative analysis, we identified two main themes; "structure and overview" and "usability and digital features". Conclusion: The sleep diary was found to be feasible when distributed in combination with a self-help book or electroencephalography neurofeedback. The qualitative results emphasised the importance of a timely graphical overview and visualisations of self-recorded sleep.

An Agile Approach to Accelerate Development and Adoption of Electronic Product Information Standards.

The Medical Product Information found in most medication boxes offer a wealth of information, including terms of active ingredients, excipients, indications, dosage, route of administration, risks, and safety information. Digital health services that help patients, their care givers, and health professionals to manage medication, can be improved with tailored information based on user profile, the patient's Electronic Health Record (EHR) summary, and Medicinal Product Information. The electronic Product information (ePI) comprises the summary of product characteristics, package leaflet, and product label. The European Medicines Agency released in 2021 the first version of the EU proof-of-concept ePI standard based on HL7 FHIR. The Gravitate-Health project uses this common standard as a springboard to implement a federated open-source platform and services that helps advance access, understanding, and adherence by providing trusted medicinal information in an interoperable and scalable way. In this paper, we present the agile technical approach and co-creation process to design, test, and progressively mature interoperability working with the HL7 Vulcan Accelerator and FHIR connectathons.

Neural classification of Norwegian radiology reports: using NLP to detect findings in CT-scans of children.

BACKGROUND: With a motivation of quality assurance, machine learning techniques were trained to classify Norwegian radiology reports of paediatric CT examinations according to their description of abnormal findings. METHODS: 13.506 reports from CT-scans of children, 1000 reports from CT scan of adults and 1000 reports from X-ray examination of adults were classified as positive or negative by a radiologist, according to the presence of abnormal findings. Inter-rater reliability was evaluated by comparison with a clinician's classifications of 500 reports. Test-retest reliability of the radiologist was performed on the same 500 reports. A convolutional neural network model (CNN), a bidirectional recurrent neural network model (bi-LSTM) and a support vector machine model (SVM) were trained on a random selection of the children's data set. Models were evaluated on the remaining CT-children reports and the adult data sets. RESULTS: Test-retest reliability: Cohen's Kappa = 0.86 and F1 = 0.919. Inter-rater reliability: Kappa = 0.80 and F1 = 0.885. Model performances on the Children-CT data were as follows. CNN: (AUC = 0.981, F1 = 0.930), bi-LSTM: (AUC = 0.978, F1 = 0.927), SVM: (AUC = 0.975, F1 = 0.912). On the adult data sets, the models had AUC around 0.95 and F1 around 0.91. CONCLUSIONS: The models performed close to perfectly on its defined domain, and also performed convincingly on reports pertaining to a different patient group and a different modality. The models were deemed suitable for classifying radiology reports for future quality assurance purposes, where the fraction of the examinations with abnormal findings for different sub-groups of patients is a parameter of interest.

On the Right to Science: Recommendations of Selection Criteria for IMIA Scientific Meetings.

The International Medical Informatics Association (IMIA), a non-governmental, not-for-profit, global organization promoting health and biomedical informatics, is committed to the right of communities/populations and individuals to science, comprised of three separate constituent rights: 1) the right to participate in science, 2) the right to benefit from science, and 3) the right to benefit from a person's own contribution to science or inventions. As such, IMIA provides a global platform where scientists, researchers, health information users, vendors, developers, consultants, health care consumers, and suppliers can meet in an environment of cooperation and sharing. In the context of IMIA's conferences, the IMIA board has discussed and identified the important central factors, which are essential considerations to host a scientific meeting. These factors will be used to help vet future contenders applying for the honor to host an IMIA conference: Reasonable safety and security, commitment by the host member society, freedom of travel, scientific freedom, and freedom from discrimination.

The Impact of PACS on Radiograph Interpretations in an Orthopedic Outpatient Clinic.

We found no significant change in the accuracy of clinicians' reading of skeletal radiographs before and after PACS- introduction. The level of inter-rater agreement between clinicians and radiologists was high in both periods, but they disagreed in significantly more cases after PACS.

Identifying the Basis for Clinical Decisions - A Feasibility Study.

This study explored the possibility of defining a set of terms to describe and identify the basis for clinical decisions in a set of transcriptions from clinical encounters with previously identified decisions. The paper presents the considerations behind the exploratory study and considerations for further work.

Can Big Data Solve Small Problems? Paper Use in a Paperless Hospital.

A "Big Data" approach was used in part to study the use of printed paper in a 700 bed paperless hospital, in part to study the usefulness of the approach. Between 1,2 and 1,5 million pages were printed each month, corresponding to 10% of a citizens' monthly paper use. The identified use of printed paper did not seem to be high compared to other organisations. The big data approach was not able to answer all our questions, primarily because we did not get log data for the source programmes for the printing. The approach could consequently not provide the data needed to reduce paper printing.

Radiologist-initiated double reading of abdominal CT: retrospective analysis of the clinical importance of changes to radiology reports.

BACKGROUND: Misinterpretation of radiological examinations is an important contributing factor to diagnostic errors. Consultant radiologists in Norwegian hospitals frequently request second reads by colleagues in real time. Our objective was to estimate the frequency of clinically important changes to radiology reports produced by these prospectively obtained double readings. METHODS: We retrospectively compared the preliminary and final reports from 1071 consecutive double-read abdominal CT examinations of surgical patients at five public hospitals in Norway. Experienced gastrointestinal surgeons rated the clinical importance of changes from the preliminary to final report. The severity of the radiological findings in clinically important changes was classified as increased, unchanged or decreased. RESULTS: Changes were classified as clinically important in 146 of 1071 reports (14%). Changes to 3 reports (0.3%) were critical (demanding immediate action), 35 (3%) were major (implying a change in treatment) and 108 (10%) were intermediate (requiring further investigations). The severity of the radiological findings was increased in 118 (81%) of the clinically important changes. Important changes were made less frequently when abdominal radiologists were first readers, more frequently when they were second readers, and more frequently to urgent examinations. CONCLUSION: A 14% rate of clinically important changes made during double reading may justify quality assurance of radiological interpretation. Using expert second readers and a targeted selection of urgent cases and radiologists reading outside their specialty may increase the yield of discrepant cases.

Double reading of current chest CT examinations: Clinical importance of changes to radiology reports.

OBJECTIVES: Misinterpretation of radiological examinations is an important contributing factor to diagnostic errors. Double reading reduces interpretation errors and increases sensitivity. Consultant radiologists in Norwegian hospitals submit 39% of computed tomography (CT) reports for quality assurance by double reading. Our objective was to estimate the proportion of radiology reports that were changed during double reading and to assess the potential clinical impact of these changes. MATERIALS AND METHODS: In this retrospective cross-sectional study we acquired preliminary and final reports from 1023 consecutive double read chest CT examinations conducted at five public hospitals. The preliminary and final reports were compared for changes in content. Three experienced pulmonologists independently rated the clinical importance of these changes. The severity of the radiological findings in clinically important changes was classified as increased, unchanged, or decreased. RESULTS: Changes were classified as clinically important in 91 (9%) of 1023 reports. Of these: 3 were critical (demanding immediate action), 15 were major (implying a change in treatment) and 73 were intermediate (affecting subsequent investigations). More clinically important changes were made to urgent examinations and less to female first readers. Chest radiologist made more clinically important changes than other second readers. The severity of the radiological findings was increased in 73 (80%) of the clinically important changes. CONCLUSION: A 9% rate of clinically important changes made during double reading may justify quality assurance of radiological interpretation. Using expert second readers and targeting a selection of urgent cases prospectively may increase the yield of discrepant cases and reduce harm to patients.

Double reading rates and quality assurance practices in Norwegian hospital radiology departments: two parallel national surveys.

BACKGROUND: Double reading as a quality assurance (QA) tool is employed extensively in Norwegian hospital radiology departments. The practice is resource consuming and regularly debated. PURPOSE: To investigate the rates of double reading in Norwegian hospital radiology departments, to identify department characteristics associated with double reading rates, and to investigate associations between double reading and other quality improvement. MATERIAL AND METHODS: We issued two parallel national surveys to management and to consultant radiologists, respectively. Management was defined as the chief medical officer and/or the head of the radiology department. The management survey covered staffing, perceived resource situation, double reading, guidelines, and quality improvement. The radiologist survey served to validate management responses concerning double reading. Management survey items concerning practices of quality improvement were organized into three indices reflecting different quality approaches, namely: appropriateness of investigations; personal performance feedback; and system performance feedback. RESULTS: The response rates of the surveys were 100% (45/45) for management and 55% (266/483) for radiologists. Of all exams read by consultants, 33% were double read. The double reading rate was highest in university hospital departments (59%), intermediate in other teaching departments (30%), and lowest in non-teaching departments (11%) (P = 0.01). Among the quality indices, mean scores were highest on appropriateness index (68%), intermediate on the person index (56%), and lowest on system index (37%). There were no correlations between double reading rates and scores on any of the quality indices. CONCLUSION: The rate of double reading in Norwegian hospital radiology is significantly correlated to department teaching status, but not to other practices of quality work.

Do worklists work? A quantitative approach to the assessment of an Electronic Patient Record function.

In this study, a quantitative approach was used to assess an Electronic Patient Record worklist function introduced to prevent radiology reports from being overlooked by the responsible clinicians. The function reduced the rate of overlooked reports, but was not able to eliminate it. Not all reports were identified by the automatic worklist function. Clinicians did not use the worklists to detect new reports. Our results suggest that this was not the result of insufficient user training or user errors, but rather that the worklists function did not comply with the way clinical work was organised and performed. Quantitative methods as used in this study are suggested as supplementary to the traditional qualitative methods.

Does PACS improve diagnostic accuracy in chest radiograph interpretations in clinical practice?

OBJECTIVES: To assess the impact of a Picture Archiving and Communication System (PACS) on the diagnostic accuracy of the interpretation of chest radiology examinations in a "real life" radiology setting. MATERIALS AND METHODS: During a period before PACS was introduced to radiologists, when images were still interpreted on film and reported on paper, images and reports were also digitally stored in an image database. The same database was used after the PACS introduction. This provided a unique opportunity to conduct a blinded retrospective study, comparing sensitivity (the main outcome parameter) in the pre and post-PACS periods. We selected 56 digitally stored chest radiograph examinations that were originally read and reported on film, and 66 examinations that were read and reported on screen 2 years after the PACS introduction. Each examination was assigned a random number, and both reports and images were scored independently for pathological findings. The blinded retrospective score for the original reports were then compared with the score for the images (the gold standard). RESULTS: Sensitivity was improved after the PACS introduction. When both certain and uncertain findings were included, this improvement was statistically significant. There were no other statistically significant changes. CONCLUSION: The result is consistent with prospective studies concluding that diagnostic accuracy is at least not reduced after PACS introduction. The sensitivity may even be improved.

Does improved access to diagnostic imaging results reduce hospital length of stay? A retrospective study.

BACKGROUND: One year after the introduction of Information and Communication Technology (ICT) to support diagnostic imaging at our hospital, clinicians had faster and better access to radiology reports and images; direct access to Computed Tomography (CT) reports in the Electronic Medical Record (EMR) was particularly popular. The objective of this study was to determine whether improvements in radiology reporting and clinical access to diagnostic imaging information one year after the ICT introduction were associated with a reduction in the length of patients' hospital stays (LOS). METHODS: Data describing hospital stays and diagnostic imaging were collected retrospectively from the EMR during periods of equal duration before and one year after the introduction of ICT. The post-ICT period was chosen because of the documented improvement in clinical access to radiology results during that period. The data set was randomly split into an exploratory part used to establish the hypotheses, and a confirmatory part. The data was used to compare the pre-ICT and post-ICT status, but also to compare differences between groups. RESULTS: There was no general reduction in LOS one year after ICT introduction. However, there was a 25% reduction for one group - patients with CT scans. This group was heterogeneous, covering 445 different primary discharge diagnoses. Analyses of subgroups were performed to reduce the impact of this divergence. CONCLUSION: Our results did not indicate that improved access to radiology results reduced the patients' LOS. There was, however, a significant reduction in LOS for patients undergoing CT scans. Given the clinicians' interest in CT reports and the results of the subgroup analyses, it is likely that improved access to CT reports contributed to this reduction.

Introducing PACS to the late majority. A longitudinal study.

The purpose of this study was to study whether the benefits from introducing a picture archiving and communication systems (PACS) reported by innovators and early adopters also can be achieved by a hospital belonging to the "late majority" and to see whether such benefits are sustained, using report turnaround time (RTAT) as an indicator. Activity-related data was retrieved from the radiology information system (RIS) over a 2-year period. The median RTAT for preliminary reports was initially reduced from 12 to 2 h then increased to 3 h. For final reports, the median RTAT was initially reduced from 23 to 13 h then gradually reverted back to 22 h. Innovators and early adopters demonstrate not only that positive results can be achieved but also the importance of involving key personnel. We believe that such involvement and the focus on wider organizational concerns are important when introducing PACS to the late majority, both for achieving and sustaining positive results.

Do clinicians read our reports? Integrating the radiology information system with the electronic patient record: experiences from the first 2 years.

This study aimed to determine how clinicians adapted to and utilized new routines for accessing radiology reports after the integration of an electronic patient record (EPR) with a radiology information system (RIS). Activity-related data describing the availability and receipt of radiology reports were collected from the EPR and the RIS over a period of 2 years. Twelve percent of the final radiology reports had not been opened 4 weeks after they had been entered into the EPR. For opened reports, the median time after a report was available in the EPR until it was first opened by a clinician was less than 1 h for preliminary reports and less than 4 h for final radiology reports. The use of radiology reports was stable during the second observation year. Some reports were not opened for professional as well as technical reasons. The integrated information systems offered a potential for improving routines related to the transmission of radiology reports. Clinicians did not fully take advantage of this potential in the 2 years after its introduction.