RESUMO
BACKGROUND: Many promising artificial intelligence (AI) and computer-aided detection and diagnosis systems have been developed, but few have been successfully integrated into clinical practice. This is partially owing to a lack of user-centered design of AI-based computer-aided detection or diagnosis (AI-CAD) systems. OBJECTIVE: We aimed to assess the impact of different onboarding tutorials and levels of AI model explainability on radiologists' trust in AI and the use of AI recommendations in lung nodule assessment on computed tomography (CT) scans. METHODS: In total, 20 radiologists from 7 Dutch medical centers performed lung nodule assessment on CT scans under different conditions in a simulated use study as part of a 2×2 repeated-measures quasi-experimental design. Two types of AI onboarding tutorials (reflective vs informative) and 2 levels of AI output (black box vs explainable) were designed. The radiologists first received an onboarding tutorial that was either informative or reflective. Subsequently, each radiologist assessed 7 CT scans, first without AI recommendations. AI recommendations were shown to the radiologist, and they could adjust their initial assessment. Half of the participants received the recommendations via black box AI output and half received explainable AI output. Mental model and psychological trust were measured before onboarding, after onboarding, and after assessing the 7 CT scans. We recorded whether radiologists changed their assessment on found nodules, malignancy prediction, and follow-up advice for each CT assessment. In addition, we analyzed whether radiologists' trust in their assessments had changed based on the AI recommendations. RESULTS: Both variations of onboarding tutorials resulted in a significantly improved mental model of the AI-CAD system (informative P=.01 and reflective P=.01). After using AI-CAD, psychological trust significantly decreased for the group with explainable AI output (P=.02). On the basis of the AI recommendations, radiologists changed the number of reported nodules in 27 of 140 assessments, malignancy prediction in 32 of 140 assessments, and follow-up advice in 12 of 140 assessments. The changes were mostly an increased number of reported nodules, a higher estimated probability of malignancy, and earlier follow-up. The radiologists' confidence in their found nodules changed in 82 of 140 assessments, in their estimated probability of malignancy in 50 of 140 assessments, and in their follow-up advice in 28 of 140 assessments. These changes were predominantly increases in confidence. The number of changed assessments and radiologists' confidence did not significantly differ between the groups that received different onboarding tutorials and AI outputs. CONCLUSIONS: Onboarding tutorials help radiologists gain a better understanding of AI-CAD and facilitate the formation of a correct mental model. If AI explanations do not consistently substantiate the probability of malignancy across patient cases, radiologists' trust in the AI-CAD system can be impaired. Radiologists' confidence in their assessments was improved by using the AI recommendations.
RESUMO
Smart home technologies with the ability to learn over time promise to adjust their actions to inhabitants' unique preferences and circumstances. For example, by learning to anticipate their routines. However, these promises show frictions with the reality of everyday life, which is characterized by its complexity and unpredictability. These systems and their design can thus benefit from meaningful ways of eliciting reflections on potential challenges for integrating learning systems into everyday domestic contexts, both for the inhabitants of the home as for the technologies and their designers. For example, is there a risk that inhabitants' everyday lives will reshape to accommodate the learning system's preference for predictability and measurability? To this end, in this paper we build a designer's interpretation on the Social Practice Imaginaries method as developed by Strengers et al. to create a set of diverse, plausible imaginaries for the year 2030. As a basis for these imaginaries, we have selected three social practices in a domestic context: waking up, doing groceries, and heating/cooling the home. For each practice, we create one imaginary in which the inhabitants' routine is flawlessly supported by the learning system and one that features everyday crises of that routine. The resulting social practice imaginaries are then viewed through the perspective of the inhabitant, the learning system, and the designer. In doing so, we aim to enable designers and design researchers to uncover a diverse and dynamic set of implications the integration of these systems in everyday life pose.
RESUMO
Physical inactivity has become a major public health concern and, consequently, the awareness of striving for a healthy lifestyle has increased. As a result, the popularity of recreational sports, such as running, has increased. Running is known for its low threshold to start and its attractiveness for a heterogeneous group of people. Yet, one can still observe high drop-out rates among (novice) runners. To understand the reasons for drop-out as perceived by runners, we investigate potential reasons to quit running among short distance runners (5 km and 10 km) (n = 898). Data used in this study were drawn from the standardized online Eindhoven Running Survey 2016 (ERS16). Binary logistic regressions were used to investigate the relation between reasons to quit running and different variables like socio-demographic variables, running habits and attitudes, interests, and opinions (AIOs) on running. Our results indicate that, not only people of different gender and age show significant differences in perceived reasons to quit running, also running habits, (e.g., running context and frequency) and AIOs are related to perceived reasons to quit running too. With insights into these related variables, potential drop-out reasons could help health professionals in understanding and lowering drop-out rates among recreational runners.