Classification and Regression Tree and Computer Adaptive Testing in Cardiac Rehabilitation: Instrument Validation Study.

BACKGROUND: There is a need for shorter-length assessments that capture patient questionnaire data while attaining high data quality without an undue response burden on patients. Computerized adaptive testing (CAT) and classification and regression tree (CART) methods have the potential to meet these needs and can offer attractive options to shorten questionnaire lengths. OBJECTIVE: The objective of this study was to test whether CAT or CART was best suited to reduce the number of questionnaire items in multiple domains (eg, anxiety, depression, quality of life, and social support) used for a needs assessment procedure (NAP) within the field of cardiac rehabilitation (CR) without the loss of data quality. METHODS: NAP data of 2837 CR patients from a multicenter Cardiac Rehabilitation Decision Support System (CARDSS) Web-based program was used. Patients used a Web-based portal, MyCARDSS, to provide their data. CAT and CART were assessed based on their performances in shortening the NAP procedure and in terms of sensitivity and specificity. RESULTS: With CAT and CART, an overall reduction of 36% and 72% of NAP questionnaire length, respectively, was achieved, with a mean sensitivity and specificity of 0.765 and 0.817 for CAT, 0.777 and 0.877 for classification trees, and 0.743 and 0.40 for regression trees, respectively. CONCLUSIONS: Both CAT and CART can be used to shorten the questionnaires of the NAP used within the field of CR. CART, however, showed the best performance, with a twice as large overall decrease in the number of questionnaire items of the NAP compared to CAT and the highest sensitivity and specificity. To our knowledge, our study is the first to assess the differences in performance between CAT and CART for shortening questionnaire lengths. Future research should consider administering varied assessments of patients over time to monitor their progress in multiple domains. For CR professionals, CART integrated with MyCARDSS would provide a feedback loop that informs the rehabilitation progress of their patients by providing real-time patient measurements.

The equity paradox: older patients' participation in patient portal development.

PURPOSE: This paper reflects on ethical concerns to patient portals design and evaluation approaches and provides a comprehensive overview of methodological considerations to advance patient participation of older patients to patient portal research and development. REFLECTION: Barriers to the use of current patient portals experienced by older patients are concentrated on access issues and difficulties with interpretation of medical content. As patient portals' functionalities are being expanded by means of co-creation and user-testing such barriers often remain unrecognized. A main challenge of these patient participation efforts is namely to include a variety of older patients; foremost autonomous patients seem to participate. By selecting autonomous participants in co-creation or user-testing, design solutions are proposed that specifically benefit the autonomy of that patient, whereas it does not do justice to values and interests of patients who are less independent and are confronted with a wider variety of use barriers. Consequently, there is a risk of widening the gap between those who can use and benefit from patient portals and those who cannot. To prevent this from happening, we propose three main methodological aspects to consider in co-creation and user-testing activities that aim to optimize patient portal functionalities. IMPLICATIONS: We encourage policy makers and patient portal developers to use present-day's momentum to include older patients' abilities, needs and context in the decision-making and investments in further advancing patient portals. We further stimulate future research that aims to improve methods to overcome challenges of older patients' participation regarding design and evaluation of eHealth systems.

How do patients value and prioritize patient portal functionalities and usage factors? A conjoint analysis study with chronically ill patients.

BACKGROUND: Patient portal use can be a stimulant for patient engagement. Yet, the heterogeneous landscape of tethered patient portals, is a major barrier to further portal development and implementation. A variety in portal access means, functionalities, usability and usefulness exists; without having accurate sight on patient perspectives. We aimed to get insights on possible coherence between patients' preferred usage factors of portals and patients' prioritization of functionalities, within the complexity of their disease management across different healthcare organizations. METHODS: A conjoint analysis questionnaire was sent to patient panels of two large patient associations in The Netherlands, centered on heart and vascular diseases and lung diseases. RESULTS: Of 1294 patient respondents, 81% were 55+ years old and 49% were 65+ years old. Overall respondents significantly prioritized user-friendly access to a portal, via a laptop or desktop. Patients aged < 65 were less negative about using tablets to access a portal compared to the total respondents. Patients had no preference for a digital interoperable export functionality; most respondents preferred to create printable overviews. Built-in publication delay of two weeks for medical information was not preferred. Our results show no significant preference of patients between 'instant publication' versus 'publication after new information has been explained by a healthcare provider'. Overall respondents and experienced portal users had a strong preference to be able to communicate with their provider via a portal and to use a portal providing information from multiple providers. Lung patients preferred information from one provider and did not require the possibility to ask online questions. CONCLUSIONS: Heart and vascular patients as well as lung patients prefer similar technical patient portal aspects, independent of their medical condition. Yet, in current portals consistency on this matter is lacking. It is highly assumable that offering a more consistent user-experience across the variety of patient portals could help increase patient portal acceptance, ultimately helping to stimulate patient engagement via patient portal use. We further affirm the need for customization on medical information publication and sharing information of various providers through patient portals, where information provision can be adapted to preferences of patients related to their medical condition(s).

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

OBJECTIVE: To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. METHODS: Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. RESULTS: The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). CONCLUSION: In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design.

Exploration of Eye-Tracking Methodologies in Usability Testing of Digital Health Technology: A Rapid Review.

Eye-tracking is deemed a promising methodology for usability evaluation studies in healthcare, however clear theoretical guidance and practice remains lacking. A rapid review was performed on current use of eye tracking as a usability evaluation method on digital health technologies in the period of 2019 to 2024. Usability evaluation studies were included when they described a digital health technology intervention in which eye-tracking technologies were applied. To gain insight into how eye-tracking technologies contributed to measuring digital health technologies' usability, data was extracted on the use of eye-tracking for usability and key study findings. Seventeen papers were included in the review. Findings show that eye-tracking is frequently combined with other usability evaluation methods, with high methodological diversity, to test the usability of DHT. Future research is needed to enhance understanding of the effectiveness of eye-tracking outcomes in DHT usability testing when combined with other usability evaluation methods in order to provide (usability) researchers theoretical guidance on its application.

From Theory to Practice: Practical Applications of the MOLD-US Framework.

The MOLD-US framework has been developed to synthesize knowledge for (usability) researchers on aging- and disease-related barriers that can hamper the use of health information technology (HIT). However, dissemination in terms of practical applications of the framework is currently unknown and could inform industry and researchers for applying MOLD-US in practice, but also provide insights on the use of theoretical frameworks in HIT research. Therefore, a citation analysis was conducted on the paper presenting the MOLD-US framework. Nine of the 241 citations were found to report practical application(s) of the MOLD-US framework in their methods section: (1) qualitative research input (n=3), (2) research design (n=3), (3) design approaches (n=2), and (4) conceptual framework development (n=2). Future work aims to explore MOLDUS-US practical applications in the industry, through for example grey literature, but also continuously monitor novel applications to enhance the development of HIT for the aging population.

An Exploration of Dutch Dermatologists' Experience and Satisfaction With Teledermatology: Sociotechnical and Complex Adaptive System Perspective.

BACKGROUND: Despite the global upscale of teledermatology during the COVID-19 pandemic, persistent barriers, such as the poor anamnesis and photo quality, hinder its effective use in practice. Understanding Dutch dermatologists' experiences and satisfaction with using the teledermatology system in the Dutch health care system is needed. A holistic evaluation may provide valuable insight to understand how barriers interrelate which is deemed necessary for the innovation of teledermatology in practice. OBJECTIVE: Guided by a complex adaptive system perspective, this study aims to understand Dutch dermatologists' experience and satisfaction with their training, support communication, interaction, and usage of a teledermatology platform of a Dutch digital hospital during the COVID-19 pandemic, uncovering insights to improve teledermatology services for the future. METHODS: A web-based questionnaire was sent in December 2021 to Dutch dermatologists who (1) had an active teledermatology platform account, and (2) responded to a teledermatology consultation between October 1, 2019, and September 30, 2021. The questionnaire consisted of the validated Store-and-Forward Telemedicine Service User-satisfaction Questionnaire (SAF-TSUQ) questionnaire, and new questions regarding; demographics of teledermatologists, the use of teledermatology during the COVID-19 pandemic, the performance of teledermatology by general practitioners (GP), and the role of dermatologists in the teledermatology process. The open-ended questions were analyzed by a grounded theory approach guided by a sociotechnical model and complemented by a complex adaptive system perspective. A panel discussion with 3 dermatologists was performed to provide additional insight into the responses to the questionnaire. RESULTS: We obtained responses from 25 out of the 249 (10%) invited dermatologists. Overall, dermatologists had a positive experience with teledermatology. Interestingly, teledermatology use frequency remained unaffected by the COVID-19 pandemic. However, the insufficient quality and incompleteness of the clinical content (photos and anamneses information) of the teledermatology consultation impacted the efficiency of the teledermatology workflow. Dermatologists expressed the need for improvement to avoid time-consuming processes or physical referrals. The panel discussion enriched and confirmed the responses, suggesting solutions like mandatory fields for the GPs for a complete anamnesis. CONCLUSIONS: Dutch Dermatologists view teledermatology as a valuable tool to provide access to dermatology care. However, improvements regarding the quality and completeness of the provided clinical content are necessary for the effectiveness and efficiency of the complex teledermatology system in Dutch health care. This could increase both the dermatologists' satisfaction and the quality of teledermatology services. Managing trade-offs, such as time investments versus image quality, is crucial for teledermatology implementation and should be assessed from a complexity perspective to understand trade-offs and prevent unintended consequences.

The differences between adults and adolescents using a mobile health application for menstrual complaints: A usability and qualitative study.

BACKGROUND: A "Menstruatie Educatie Kalender" application (Menstruation Education Calendar, (MEK-APP)) was developed for adults to evaluate menstrual complaints. The future aim of this app is to use it as a self-diagnostic instrument for menstrual abnormalities for both adults and adolescents. Early identification of the potential of an application for future use by both user groups would increase implementation success and adoption of the application. OBJECTIVE: To compare differences in experienced usability by adults versus adolescents and to identify factors influencing future use for both age groups in one mHealth application (in this study the MEK-APP). METHODS: This study consisted of three phases: (1) usability testing of the MEK-APP for iOS and Android by think-aloud method, (2) two-month daily use and (3) in-depth individual interview. During the think-aloud sessions, twelve tasks were performed in the application while they were thinking aloud. Usability problems were rated for their severity with Nielsen' Severity Scale. Both the think-aloud sessions and in-depth interviews were verbatim transcribed and thematically analyzed to determine the factors influencing future use for both groups. In addition, the System Usability Scale (SUS) and Intrinsic Motivation Inventory (IMI) questionnaires were filled out during the interviews. RESULTS: Seven adults (>18 years) and seven adolescents (14-18 years) evaluated the MEK-APP. There were 14 usability issues and 16 bugs in both groups. There were no differences between adults and adolescents. In the thematic qualitative analysis, the following future use factors were identified: user-expectation, motivation, privacy, understandability, and user-experience. The user-expectation, motivation and privacy differed between both groups but did not influence usage. No differences were observed in SUS and IMI scores between both groups. CONCLUSIONS: There are five factors influencing the future use of a menstrual-related mHealth application for both adults and adolescents. It is possible to serve different age groups with a single application.

Elevating Patient Engagement: Implementing EHR-Integrated Medication Reminders for Kidney Transplant Patients.

Digital health can enhance self-management of patients such as usage of medication reminders, thereby improving health outcomes. However, for successful implementation of such interventions, integration with the electronic health record (EHR) is useful. We evaluated the implementation of an integrated patient portal medication reminder tool in kidney transplant patients. Overall, 40.5% of the patients agreed that integrated EHR medication reminders assisted them in taking their medication on time.

Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study.

BACKGROUND: Dementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies (DHTs). These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of DHTs for this rapidly increasing population. OBJECTIVE: This study aims to apply the DEMIGNED principles in usability evaluation methods to (1) capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with subjective cognitive decline (SCD), mild cognitive impairment (MCI), or dementia, and (2) investigate the realness of usability problems captured by the DEMIGNED principles in expert testing, specifically for mobile websites that act as a means of providing DHTs. METHODS: First, a heuristic evaluation was conducted, with the DEMIGNED principles serving as domain-specific guidelines, with 3 double experts (experienced in both usability and dementia) and 2 usability engineering experts. Second, think-aloud sessions were conducted with patients visiting a memory clinic who were living with SCD, MCI, or dementia. RESULTS: The heuristic evaluation resulted in 36 unique usability problems. A representative sample of 7 people visiting a memory clinic participated in a think-aloud session, including 4 (57%) with SCD, 1 (14%) with MCI, and 2 (29%) with dementia. The analysis of the think-aloud sessions revealed 181 encounters with usability problems. Of these encounters, 144 (79.6%) could be mapped to 18 usability problems identified in the heuristic evaluation. The remaining 37 (20.4%) encounters from the user testing revealed another 10 unique usability problems. Usability problems frequently described in the think-aloud sessions encompassed difficulties with using the search function, discrepancies between the user's expectations and the content organization, the need for scrolling, information overload, and unclear system feedback. CONCLUSIONS: By applying the DEMIGNED principles in expert testing, evaluators were able to capture 79.6% (144/181) of all usability problem encounters in the user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Regarding unique usability problems, 50% (18/36) of the unique usability problems identified during the heuristic evaluation were captured by the user-testing sessions. Future research should look into the applicability of the DEMIGNED principles to other digital health functionalities to increase the accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.

Implementation and Scale-up of Telemonitoring in the Netherlands.

The healthcare system requires reforms for equitable and sustainable care. Telemonitoring offers a solution, yet its implementation lacks research. In the Netherlands, University Medical Centers (UMCs) lead healthcare transformation through the Citrien-2 network, scaling up three telemonitoring programs from 2020 to 2022. An uncontrolled before-after study design was used to evaluate upscaling. Primary outcomes focused on telemonitoring normalization using the Normalisation Process Theory (NoMAD). Secondary outcomes included patient uptake and qualitative analyses. Results show implementation across projects and UMCs, with overall increased patient uptake. Healthcare professionals perceive telemonitoring positively, but challenges persist in integrating it into workflows. Continuous assessment is crucial for addressing implementation complexities and maximizing telemonitoring's impact on healthcare delivery.

Embedding Ethics in the Implementation of a Vital Sign Monitoring Technology.

The implementation of wireless continuous vital sign monitoring (CVSM) technologies changes daily care practices of healthcare professionals, which gives rise to unknown new roles and responsibilities. In this paper we present a study on how we combine the disciplines of medical informatics and ethics in the implementation of the Philips Healthdot, a smart patch for remote CVSM. The aim of this study is to investigate experiences and perspectives on the support levels and roles and responsibilities associated with the integration of smart patches, by conducting interviews with nurses. This interdisciplinary study gives insights into the technological, organizational, and ethical concerns surrounding the implementation of CVSM in healthcare. The findings and analytical approach may provide valuable insights for researching the appropriate implementation of digital health technologies.

Enhancing Inclusive mHealth Design for People Living with Dementia: Examples from Literature.

The availability of mHealth technologies for older adults living with dementia is increasing. However, due to highly complex and varying clinical presentations of dementia, these technologies do not always meet their needs, wishes and capabilities. An exploratory literature review was performed to identify studies that applied evidence-based design principles or provide design choices that aim to improve mHealth design. These were categorized as a unique design choice to tackle barriers to mHealth use related to cognition, perception, physical ability, frame of mind, or speech- and language. Through thematic analysis, themes of design choices were summarized per category in the MOLDEM-US framework. Thirty-six studies were included for data extraction, leading to seventeen categories of design choices. This study pushes the need to further investigate and refine inclusive mHealth design solutions for populations with highly complex symptoms, such as those living with dementia.

Training Healthcare Professionals to Mitigate the Climate Challenge - Development of a Lean Six Sigma E-Learning.

This paper presents the preliminary findings of developing and evaluating a Lean Six Sigma (LSS) e-learning aimed at empowering healthcare professionals in different roles to make healthcare more sustainable. The e-learning was developed with experienced trainers and LSS experts by combining traditional LSS and environmental practices. Participants found the training engaging and confirmed they felt motivated and prepared to start applying the acquired skills and knowledge. We are now following the 39 participants to further investigate the effectiveness of LSS for mitigating the climate challenge in healthcare.

Organizational and Human Factors in Green Medical Informatics - A Case Study in Dutch Hospitals.

Medical Informatics brings methods and solutions that could support reducing healthcare's ecological footprint. Initial frameworks for Green Medical Informatics solutions are available, however these do not address organizational and human factors. Including these factors in evaluation or analysis of (technical) interventions aimed at making healthcare more sustainable, is essential for improving usability as well as effectiveness of these interventions. Interviews with healthcare professionals from Dutch hospitals led to preliminary insights into which organizational and human factors impact the implementation and adoption of sustainable solutions. Results indicate that forming multi-disciplinary teams is considered an important factor for realizing intended outcomes in terms of reducing carbon emissions and waste. Some other key factors mentioned are formalizing tasks, allocating budget and time, creating awareness and changing protocols to promote sustainable diagnosis and treatment procedures.

Identifying Environmental Impact Factors for Sustainable Healthcare: A Scoping Review.

The healthcare industry has a substantial impact on the environment through its use of resources, waste generation and pollution. To manage and reduce its impact, it is essential to measure the pressures of healthcare activities on the environment. However, research on factors that can support these measurement activities is unbalanced and scattered. In order to address this issue, a scoping review was conducted with the aims of (i) identifying and organizing factors that have been used to measure environmental impact in healthcare practice and (ii) analyzing the overview of impact factors in order to identify research gaps. The review identified 46 eligible articles publishing 360 impact factors from original research in PubMed and EBSCO databases. These factors related to a variety of healthcare settings, including mental healthcare, renal service, primary healthcare, hospitals and national healthcare. Environmental impacts of healthcare were characterized by a variety of factors based on three key dimensions: the healthcare setting involved, the measurement component or scope, and the type of environmental pressure. The Healthcare Environmental Impact Factor (HEIF) scheme resulting from this study can be used as a tool for selecting measurable indicators to be applied in quality management and as a starting point for further research. Future studies could focus on standardizing impact factors to allow for cross-organization comparisons and on expanding the HEIF scheme by addressing gaps.

General Practitioners' Perspectives About Remote Dermatology Care During the COVID-19 Pandemic in the Netherlands: Questionnaire-Based Study.

BACKGROUND: The COVID-19 pandemic affected the delivery of primary care and stimulated the use of digital health solutions such as remote digital dermatology care. In the Netherlands, remote store-and-forward dermatology care was already integrated into Dutch general practice before the COVID-19 pandemic. However, it is unclear how general practitioners (GPs) experienced this existing digital dermatology care during the pandemic period. OBJECTIVE: We investigated GPs' perspectives about facilitators and barriers related to store-and-forward digital dermatology care during the COVID-19 pandemic in the Netherlands, using a sociotechnical approach. METHODS: In December 2021, a web-based questionnaire was distributed via email to approximately 3257 GPs who could perform a digital dermatology consultation and who had started a digital consultation (not necessarily dermatology) in the previous 2 years. The questionnaire consisted of general background questions, questions from a previously validated telemedicine service user satisfaction questionnaire, and newly added questions related to the pandemic and use of the digital dermatology service in general practice. The open-ended and free-text responses were analyzed for facilitators and barriers using content analysis, guided by an 8-dimensional sociotechnical model. RESULTS: In total, 71 GPs completed the entire questionnaire, and 66 (93%) questionnaires were included in the data analysis. During the questionnaire distribution period, another national lockdown, social distancing, and stay-at-home mandates were announced; thus, GPs may have had increased workload and limited time to complete the questionnaire. Of the 66 responding GPs, 36 (55%) were female, 25 (38%) were aged 35-44 years, 33 (50%) were weekly platform users, 34 (52%) were working with the telemedicine organization for >5 years, 42 (64%) reported that they used the store-and-forward platform as often during as before the pandemic, 61 (92%) would use the platform again, 53 (80%) would recommend the platform to a colleague, and 10 (15%) used digital dermatology home consultation. Although GPs were generally satisfied with the digital dermatology service, platform, and telemedicine organization, they also experienced crucial barriers to the use of the service during the pandemic. These barriers were GPs' and patients' limited digital photography skills, costs and the lack of appropriate equipment, human-computer interface and interoperability issues on the telemedicine platform, and different use procedures of the digital dermatology service. CONCLUSIONS: Although remote dermatology care was already integrated into Dutch GP practice before the pandemic, which may have facilitated the positive responses of GPs about the use of the service, barriers impeded the full potential of its use during the pandemic. Training is needed to improve the use of equipment and quality of (dermoscopy) images taken by GPs and to inform GPs in which circumstances they can or cannot use digital dermatology. Furthermore, the dermatology platform should be improved to also guide patients in taking photographs with sufficient quality.

Proposing a Novel Hybrid Short-Term Exchange Program in Biomedical and Health Informatics Education.

International student exchange is a valuable opportunity for Biomedical and Health Informatics students to gain new perspectives and experiences. In the past, such exchanges have been made possible through international partnerships between universities. Unfortunately, numerous obstacles such as housing, financial concerns, and environmental implications related to travel, have made it difficult to continue international exchange. Experiences with hybrid and online education during covid-19 paved the way for a new approach that allows for short international exchange with a hybrid online-offline supervision model. This will be initiated with an exploration project between two international universities , each related to their respective institute's research focus.

One Health: Insights from Organizational & Social, Technology Assessment and Human Factors Perspectives.

OBJECTIVES: To offer diverse but complementary perspectives on how biomedical and health informatics can be informed by and help to achieve the vision of One Health. METHODS: Overview of key considerations and critical discussion of common themes, barriers and opportunities, based on collaborative review by International Medical Informatics Association (IMIA) working group members active in related fields. RESULTS: Health and care systems are complex sociotechnical systems that need explicit design and implementation strategies to align with the goals of One Health. The evidence-based health informatics paradigm and associated frameworks for evaluation of digital health technologies need to broaden their scope to take full account of the One Health approach. Informatics has specific contributions to make to One Health, for example by improved user experience reducing energy consumption and effective app design enhancing medication adherence. CONCLUSIONS: One Health is inherently intertwined with ergonomic, sociotechnical and evaluation perspectives in biomedical and health informatics. Health is a planetary issue that requires interdisciplinary collaborative action. The theories and principles of biomedical and health informatics offer many opportunities to transform digital health technology to better serve the One Health agenda.

Clinical guideline representation in a CDS: a human information processing method.

The Dutch Childhood Oncology Group (DCOG) has developed evidence-based guidelines for screening childhood cancer survivors for possible late complications of treatment. These paper-based guidelines appeared to not suit clinicians' information retrieval strategies; it was thus decided to communicate the guidelines through a Computerized Decision Support (CDS) tool. To ensure high usability of this tool, an analysis of clinicians' cognitive strategies in retrieving information from the paper-based guidelines was used as requirements elicitation method. An information processing model was developed through an analysis of think aloud protocols and used as input for the design of the CDS user interface. Usability analysis of the user interface showed that the navigational structure of the CDS tool fitted well with the clinicians' mental strategies employed in deciding on survivors screening protocols. Clinicians were more efficient and more complete in deciding on patient-tailored screening procedures when supported by the CDS tool than by the paper-based guideline booklet. The think-aloud method provided detailed insight into users' clinical work patterns that supported the design of a highly usable CDS system.