Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review.

BACKGROUND: Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking. OBJECTIVE: This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices. METHODS: We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites. RESULTS: A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation). CONCLUSIONS: The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Assessing operational readiness: Regulatory landscape and compliance in zimbabwe for medical devices and in vitro diagnostic medical devices.

The regulation of medical devices and In Vitro Diagnostic (IVD) medical devices have lagged significantly, especially in low- and middle-income countries. Disparities in regulating medical and IVD medical devices in Africa are below the global average. This may translate to poor access to quality-assured medical and IVD devices, resulting in undesirable health outcomes. Operational readiness to regulate medical and IVD devices at the Medicines Control Authority of Zimbabwe (MCAZ) was assessed. The aim was to determine the strengths and gaps and propose an action plan that can be monitored and evaluated to assess progress over time. We used the World Health Organization (WHO) Global Benchmarking Tool for medical devices and IVDs methodology to evaluate regulatory oversight of these products. Purposive sampling was used for data collection using researcher-administered global benchmarking tool factsheets and document reviews to evaluate the implementation of the regulatory functions. The regulatory functions assessed were the National Regulatory System, Registration and Market Authorization, Vigilance, Market Surveillance and Control, Licensing Establishment, Regulatory Inspection, Laboratory Testing, and Clinical Trials Oversight. The MCAZ attained maturity level 1, with a regulatory system score of 79%, registration and market authorization 44%, vigilance 27%, market surveillance and control 40%, licensing establishment 62%, regulatory inspection 68%, laboratory testing 88%, and clinical trials 18%. Condoms and gloves were the only regulated medical devices in Zimbabwe. IVDs were not regulated by the MCAZ. This review showed that the regulatory system is not robust, fit for purpose, responsive, transparent, or proportionate to the risk classification of medical devices and IVDs. It is crucial to amend the Medicines and Allied Substance Control Act to incorporate the definition and classification of medical devices and IVDs, regulatory authority establishment, licensing and registration, quality management system, conformity assessment, post-market surveillance, labeling and instructions for use, capacity building and training, and international harmonization.

Navigating regulatory landscape: A qualitative exploration of medical devices and in vitro diagnostic medical devices oversight in Zimbabwe through key stakeholder perspectives.

Medical devices and In Vitro Diagnostics (IVDs) are vital for public health and accessible healthcare. Still, there is an imbalance in high-quality products in Low and Middle-Income Countries (LMICs). Zimbabwe's regulatory framework for medical devices and IVDs is unclear, leading to ineffective compliance and surveillance. As a result, there are knowledge gaps regarding pre-market and post-market regulatory elements to ensure the safety, quality and performance of medical devices and IVDs used in Zimbabwe. Our study aimed to explore the current status of medical devices and IVD regulations in Zimbabwe. Semi-structured interviews were conducted with 12 regulators from the Medicines Control Authority of Zimbabwe (MCAZ) National Microbiology Reference Laboratory (NMRL), Medical Laboratory and Clinical Scientists Council (MLCScCZ) to understand the current status of medical devices and IVD regulations in Zimbabwe. Three participants completed a questionnaire to understand the regulatory landscape in Zimbabwe. Three key informant interviews were conducted with three regulators from the South African Health Products Regulatory Authority (SAHPRA), Tanzanian Medicines and Medical Devices Authority (TMDA), and World Health Organization Regulatory Systems Strengthening (WHO RSS) to learn best practices to create a roadmap for Zimbabwe. We analyzed qualitative data using a thematic analysis. The findings reveal significant deficiencies and gaps in the legal framework for regulating medical devices and IVDs, highlighting the need for a legal framework and the absence of more comprehensive regulations. Regulatory entities face capacity limitations, especially in regulating medical devices and IVDs. Conformity assessment processes, medical devices, IVD classification criteria, and post-market surveillance also represent challenges, highlighting the need for a well-defined framework and regulatory procedures. The Zimbabwean regulatory system pathway is reactive, prompting several regulatory initiatives to address needs. Despite facing challenges, there is recognition of the importance of collaboration among regulatory authorities, emphasizing a shared commitment to improving and strengthening medical devices and IVD regulations for improved patient safety. By advocating for a proactive, comprehensive, and legally sound approach, indicating the potential for collaboration and synergy, this study provides a foundation for well-informed policy recommendations to guide enhancements and build a framework for a resilient, efficient, and transparent regulatory environment in the Zimbabwe and African regions as a whole.

Assessing medical devices: a qualitative study from the validate perspective.

OBJECTIVES: Our objective was to explore procedures and methods used at health technology assessment (HTA) agencies for assessing medical devices and the underlying views of HTA practitioners about appropriate methodology to identify challenges in adopting new methodologies for assessing devices. We focused on the role of normative commitments of HTA practitioners in the adoption of new methods. METHODS: An online survey, including questions on procedures, scoping, and assessments of medical devices, was sent to members of the International Network of Agencies for Health Technology Assessment. Interviews were conducted with survey respondents and HTA practitioners involved in assessments of transcatheter aortic valve implantation to gain an in-depth understanding of choices made and views about assessing medical devices. Survey and interview questions were inspired by the "values in doing assessments of health technologies" approach towards HTA, which states that HTA addresses value-laden questions and information. RESULTS: The current practice of assessing medical devices at HTA agencies is predominantly based on procedures, methods, and epistemological principles developed for assessments of drugs. Both practical factors (available time, demands of decision-makers, existing legal frameworks, and HTA guidelines), as well as commitments of HTA practitioners to principles of evidence-based medicine, make the adoption of a new methodology difficult. CONCLUSIONS: There is a broad recognition that assessments of medical devices may need changes in HTA methodology. In order to realize this, the HTA community may require both a discussion on the role, responsibility, and goals of HTA, and resulting changes in institutional context to adopt new methodologies.

Implications of variability on medical device chemical equivalence assessment.

Chemical equivalence testing can be used to assess the biocompatibility implications of a materials or manufacturing change for a medical device. This testing can provide a relatively facile means to evaluate whether the change may result in additional or different toxicological concerns. However, one of the major challenges in the interpretation of chemical equivalence data is the lack established criteria for determining if two sets of extractables data are effectively equivalent. To address this gap, we propose a two-part approach based upon a relatively simple statistical model. First, the probability of a false positive conclusion, wherein there is an incorrectly perceived increase for a given analyte in the comparator relative to the baseline device, can be reduced to a prescribed level by establishing an appropriate acceptance criterion for the ratio of the observed means. Second, the probability of a false negative conclusion, where an actual increase in a given analyte cannot be discerned from the test results, can be minimized by specifying a limiting value of applicability based on the margin of safety (MoS) of the analyte. This approach provides a quantitative, statistically motivated method to interpret chemical equivalence data, despite the relatively high intrinsic variability and small number of replicates typically associated with a chemical characterization evaluation.

Is read-across for chemicals comparable to medical device equivalence and where to use it for conformity assessment?

Novel medical devices must conform to medical device regulation (MDR) for European market entry. Likewise, chemicals must comply with the Registration, Evaluation, Authorization and Restriction of Chemicals (REACh) regulation. Both pose regulatory challenges for manufacturers, but concordantly provide an approach for transferring data from an already registered device or compound to the one undergoing accreditation. This is called equivalence for medical devices and read-across for chemicals. Although read-across is not explicitly prohibited in the process of medical device accreditation, it is usually not performed due to a lack of guidance and acceptance criteria from the authorities. Nonetheless, a scientifically justified read-across of material-based endpoints, as well as toxicological assessment of chemical aspects, such as extractables and leachables, can prevent failure of MDR device equivalence if data is lacking. Further, read-across, if applied correctly can facilitate the standard MDR conformity assessment. The need for read-across within medical device registration should let authorities to reconsider device accreditation and the formulation of respective guidance documents. Acceptance criteria like in the European Chemicals Agency (ECHA) read-across assessment framework (RAAF) are needed. This can reduce the impact of the MDR and help with keeping high European innovation device rate, beneficial for medical device patients.

Detectability of use errors in summative usability tests of medical devices: Impact of the test environment.

The regulations on summative usability evaluations of medical devices (MDs) emphasize that the test environment must have sufficient ecological validity for generalization to real-life use. Here, we examined the influence of environmental fidelity (a component of ecological validity) on the detectability of MD use errors. A total of 140 participants participated in a summative usability evaluation of an anaphylactic shock auto-injector device under either a high-fidelity condition or a condition acceptable from the manufacturer's perspective, lower-fidelity condition. The numbers of errors detected in each condition were compared by applying descriptive statistics and logistic and Poisson multivariate regressions. We found that the level of fidelity did not influence the overall number of use errors detected but did influence the detection of certain use errors. To optimize the test environment and increase the detection of use errors, each environmental feature's role in the test task should first be examined.

Medical device-related pressure injuries in intensive care patients: A prospective and descriptive study.

BACKGROUND: Treatment and care of patients in intensive care units require the use of many medical and technological instruments. Pressure injuries occur when medical devices, which are used more in intensive care patients and are in direct or indirect contact with the skin, cause focal and localized forces on the superficial or deep tissues. OBJECTIVE: In this study, it was aimed to examine the risk factors, incidence and characteristics of medical device-related pressure injuries in intensive care patients. METHODS: This study has a prospective and descriptive design. The study was carried out in the adult intensive care unit of a healthcare institution located in the western Turkey. 138 intensive care patients treated in the level 3 adult intensive care unit were enrolled in the study. The first observations and evaluations of intensive care patients in terms of pressure injuries were made within the first 24 h after admission to the clinic. Observations continued daily during the hospitalization period of the patient. Data were collected with the Intensive Care Patient Information Form, Glasgow Coma Scale, Braden Pressure Ulcer Risk Assessment Scale and Identification Form for Medical device-related Pressure Ulcers. Analysis of data was performed with descriptive statistical methods, Shapiro-Wilk Test, Mann-Whitney U Test and Chi-Square analysis. RESULTS: Medical device-related pressure injury developed in 11.6% (n = 16) of intensive care patients. Anatomically, pressure injury occurred most frequently on the lip (37.5%) and most frequently due to the intubation tube (37.5%). Most of the developed wounds (75.0%) were found to be stage 2. Multinominal logistic regression analysis, which was performed to determine the effect of independent variables on medical device-related pressure injuries in intensive care patients, was found to be statistically significant (X2 = 37.098, p < 0.001). When the regression coefficients were examined, it was found that total hospitalization time in the intensive care unit (ß = 0.948, p < 0.01) and PaCO2 level (ß = 0.923, p < 0.01) had a positive, and duration of aerobic respiration with nasal cannula or mask (ß = -0.920, p < 0.01) and Braden score (ß = -0.948, p < 0.01) had a negative and significant effect on medical device-related pressure injuries. CONCLUSIONS: In this study found that the MDRPIs development rate was lower than other studies. It was observed that pressure injuries due to medical devices developed more frequently in patients with longer hospitalization days, higher PaCO2 levels, shorter duration of oxygenated breathing with nasal cannula or mask, and lower Braden scores.

Medical device-related pressure injuries prevention practices of intensive care unit nurses: A cross-sectional study in Turkey.

AIM: Medical device-related pressure injuries (MDRPIs) are becoming increasingly common across all healthcare services and age groups in terms of both incidence and severity. It is crucial for nurses to be aware that MDRPI is a potential complication of healthcare services. This study aimed to assess the preventive practices of intensive care unit (ICU) nurses in relation to MDRPIs. MATERIALS AND METHODS: This cross-sectional and descriptive study was conducted with 96 nurses between March 10 and April 31, 2021. The "Nurse Information Form" and the "MDRPIs Prevention Practices Questionnaire" form were used for the data collection. RESULTS: The overall practice scores of ICU nurses in preventing MDRPIs were 50.83 ± 12.93. Out of the participants, 57.3% (n = 55) achieved a total practice score of 51 and above out of 68 (considered an acceptable score indicating proficiency in positive practice). The items with the most negative practice levels among nurses were related to statements such as 'I apply hydrocolloid, thin foam, or a silicone-type dressing to prevent MDPRI' (2.86 ± 0.85) and 'I use the normal pressure injury staging when staging the MDRPI' (2.88 ± 0.86). No significant difference was observed between the mean scores of MDRPI prevention practices and the characteristics of ICU nurses, such as education level, years working in the unit, and years of experience in the profession (p > 0.05). Furthermore, a positive correlation was found between age and practice levels in preventing MDRPIs (p < 0.05). CONCLUSION: The study results indicate that the practice levels of ICU nurses in preventing MDRPIs were insufficient. We believe that regular in-service training programs, grounded in clinical practice, are necessary to enhance nurses' awareness and management of MDRPIs.

[Exploration of Application of Essential Principles of Safety and Performance of Medical Devices and IVD Medical Devices: Take Artificial Joint Products as Example].

Through the effective application of Essential Principles of Safety and Performance of Medical Devices and IVD Medical Devices (EP), to continuously improve the corresponding management tools to ensure the safety and effectiveness of medical device in the quality management system, risk management system, evaluation of safety and effectiveness for the supervision departments and manufacturers. The current status of the application of EP and the application issues are analyzed in the study. Take artificial joint products for example, the idea of using EP in quality management system, risk management system and evaluation of safety and effectiveness is investigated, and several thoughts are proposed. Supervision departments should strengthen the unified understanding of EP, develop requirements according to the classification of medical device，and refine specific execution requirements.

Lifecycle evaluation of medical devices: supporting or jeopardizing patient outcomes? A comparative analysis of evaluation models.

OBJECTIVES: Lack of evidence regarding safety and effectiveness at market entry is driving the need to consider adopting a lifecycle approach to evaluating medical devices, but it is unclear what lifecycle evaluation means. This research sought to explore the tacit meanings of "lifecycle" and "lifecycle evaluation" as embodied within evaluation models/frameworks used for medical devices. METHODS: Drawing on qualitative evidence synthesis methods and using an inductive approach, novel methods were developed to identify, appraise, analyze, and synthesize lifecycle evaluation models used for medical devices. Data was extracted (including purpose; audience; characterization; outputs; timing; and type of model) from key texts for coding, categorization, and comparison, exploring embodied meaning across four broad perspectives. RESULTS: Fifty-two models were included in the synthesis. They demonstrated significant heterogeneity of meaning, form, scope, timing, and purpose. The "lifecycle" may represent a single stage, a series of stages, a cycle of innovation, or a system. "Lifecycle evaluation" focuses on the overarching goal of the stakeholder group, and may use a single or repeated evaluation to inform decision-making regarding the adoption of health technologies (Healthcare), resource allocation (Policymaking), investment in new product development or marketing (Trade and Industry), or market regulation (Regulation). The adoption of a lifecycle approach by regulators has resulted in the deferral of evidence generation to the post-market phase. CONCLUSIONS: Using a "lifecycle evaluation" approach to inform reimbursement decision-making must not be allowed to further jeopardize evidence generation and patient safety by accepting inadequate evidence of safety and effectiveness for reimbursement decisions.

Medical device regulatory challenges in the UK are affecting innovation and its potential benefits.

The increase in regulatory challenges on medical technology developed and deployed in the UK is having a negative impact on innovation. In this paper we show how the limited capacity of Approved and Notified Bodies is one more barrier in the innovation pipeline, that could push more teams to consider applying for FDA approval instead of UKCA marking, potentially limiting how much our patients benefit from the world-leading research undertaken in UK universities.

Which value aspects are relevant for the evaluation of medical devices? Exploring stakeholders' views through a Web-Delphi process.

BACKGROUND: Implementation and uptake of health technology assessment for evaluating medical devices require including aspects that different stakeholders consider relevant, beyond cost and effectiveness. However, the involvement of stakeholders in sharing their views still needs to be improved. OBJECTIVE: This article explores the relevance of distinct value aspects for evaluating different types of medical devices according to stakeholders' views. METHODS: Thirty-four value aspects collected through literature review and expert validation were the input for a 2-round Web-Delphi process. In the Web-Delphi, a panel of participants from five stakeholders' groups (healthcare professionals, buyers and policymakers, academics, industry, and patients and citizens) judged the relevance of each aspect, by assigning a relevance-level ('Critical', 'Fundamental', 'Complementary', or 'Irrelevant'), for two types of medical devices separately: 'Implantable' and 'In vitro tests based on biomarkers'. Opinions were analysed at the panel and group level, and similarities across devices were identified. RESULTS: One hundred thirty-four participants completed the process. No aspects were considered 'Irrelevant', neither for the panel nor for stakeholder groups, in both types of devices. The panel considered effectiveness and safety-related aspects 'Critical' (e.g., 'Adverse events for the patient'), and costs-related aspects 'Fundamental' (e.g., 'Cost of the medical device'). Several additional aspects not included in existing frameworks' literature, e.g., related to environmental impact and devices' usage by the healthcare professional, were deemed as relevant by the panel. A moderate to substantial agreement across and within groups was observed. CONCLUSION: Different stakeholders agree on the relevance of including multiple aspects in medical devices' evaluation. This study produces key information to inform the development of frameworks for valuing medical devices, and to guide evidence collection.

Clinical evidence requirements according to the IVDR 2017/746: practical tools and references for underpinning clinical evidence of IVD-MDs.

In May 2022, the European Regulation 2017/746 (IVDR) came into force. It changes the approach of in vitro medical devices (IVD-MDs) for industry and institutions. It reinforces the clinical evidence requirements to improve performance, safety and transparency. Despite extended transition periods and existing guides, IVDR remains difficult to interpret and bringing devices into compliance requires efforts. The generation of clinical evidence is essential to demonstrate compliance with IVDR, and encompasses scientific validity, analytical performance and clinical performance. It is required to demonstrate, per intended use in the target population and clinical care pathway, IVD-MDs clinical performance (compared to a predefined clinical performance). Thus, there is a need for IVD-manufacturers and end-users in health care institutions, to obtain guidance on how to generate this clinical evidence. This article aims industrials and clinicians to identify key steps imposed by the IVDR for bringing IVD-MDs to the EU-market. We propose a general view of performance evaluation requirements for IVD-MDs and provide key references, including how to establish study design that will enable to document clinical performance of existing, refined or emerging medical tests. Finally, we propose a roadmap to address the relevant questions and studies in relation to the documents requested in the IVDR.

Functional quality assessment of whole-body vibration training devices based on instantaneous amplitude and frequency of photogrammetric vibration measurements.

The practical use of whole-body vibration training (WBVT) and such research may be negatively influenced by generated vibrations with amplitudes, frequencies, and/or patterns that deviate from preset adjustments on WBVT devices. This study examined whether prolonged regular use can generate respective deviations. Four WBVT devices, used for 19 months in a research project on the effects of WBVT, were analyzed using photogrammetry before start of the research project and after 19 months. Divergences between preset and measured amplitudes and frequencies were calculated for all measurements. To quantify how well the output of devices correlates with the target setting, the vibration characteristics were calculated. In particular, exact long-term measurements related to the vibration amplitude is conducted and analyzed for the first time, which has been found as an important measure of the device functional quality. One device had a significantly (p<0.01) larger machine run time than the other three. This one showed the most pronounced signs of functional impairments concerning instantaneous amplitudes, frequencies and the mode of vibration after prolonged use. These results based on photometric measurements underline again that prolonged use can result in divergences between preset and actual applied amplitudes, frequencies, mode of vibration and other accuracy measurement metrics.

Incompatibility of Some Prefilled Glass Syringes and Luer-Activated Needleless Valve Connectors.

Some needleless Luer-activated valve connectors with internal pins are not compatible with certain prefilled glass syringes. The internal pin can block the glass syringe tip and prevent drug administration.Nurses should be aware of this risk and assist in evaluating the Luer-activated valve connectors used in their organization.

Guía para la gestión de riesgos de los dispositivos médicos para el diagnóstico / Risk management guidance for diagnostic medical devices

Introducción: Los fabricantes de los dispositivos médicos no siempre disponen de experiencia para realizar un proceso de gestión de riesgos que cumpla con la norma ISO 14971:2019 e incluya los requisitos metrológicos necesarios; por tanto, para un mejor uso de estos equipos, especialmente los de diagnóstico, se debe implementar y mantener un proceso de gestión de riesgos basado en las normativas establecidas. Objetivo: Proponer una guía para la gestión de los riesgos indirectos en pacientes con diagnósticos incorrectos o retrasados. Métodos: Se revisaron las normas internacionales aplicables y se analizaron expedientes de gestión del riesgo de dispositivos médicos, entre ellos reactivos para el diagnóstico in vitro. Resultados: La guía ofrece elementos orientadores para cada etapa del proceso de gestión de riesgos en los dispositivos médicos para el diagnóstico: plan de gestión del riesgo, análisis, valoración y control del riesgo, evaluación del riesgo residual global, revisión de la gestión de riesgo y retroalimentación a partir de la información de producción o posproducción. Conclusiones: Esta guía es una herramienta útil para diseñadores, fabricantes, evaluadores de dispositivos médicos para el diagnóstico, asesores en temas de gestión de riesgos y la calidad de los dispositivos y personal médico(AU)

Introduction: Manufacturers of medical devices do not always have the expertise to perform a risk management process that complies with ISO 14971:2019 and includes the necessary metrological requirements; therefore, for better use of these devices, especially diagnostic devices, a risk management process based on established regulations should be implemented and maintained. Objective: To provide guidance for the management of indirect risks in patients with incorrect or delayed diagnoses. Methods: Applicable international standards were reviewed and risk management dossiers for medical devices, including in-vitro diagnostic reagents, were analyzed. Results: The guidance provides guiding elements for each step of the risk management process for diagnostic medical devices: risk management plan, risk analysis, risk assessment, risk evaluation and control, overall residual risk assessment, risk management review, and feedback from production or post-production information. Conclusions: This guide is a useful tool for designers, manufacturers, evaluators of diagnostic medical devices, risk management and device quality assessors, and medical personnel(AU)

Health State Assessment of Industrial Equipment Driven by the Fusion of Digital Twin Model and Intelligent Algorithm.

Equipment health state assessment is of great significance to improve the efficiency of industrial equipment maintenance support and realize accurate support. Using the method driven by the fusion of digital twin model and intelligent algorithm can make the equipment health state assessment more suitable for the "accuracy" requirement of equipment support. Taking the neural network algorithm as an example, this paper studies the method of unit level health state assessment of equipment driven by the fusion of digital twin model and intelligent algorithm. The principle and opportunity of equipment health state assessment based on digital twin model are analyzed, the equipment health state grade is redefined from the data-driven perspective, the selection principles of assessment parameters are established, and the unit level health state assessment model of equipment based on digital twin model and neural network algorithm is established. The proposed method is implemented by programming with Python, and the effectiveness of the method is verified by a case study. It provides support for further research of equipment-level health state assessment and the decision-making of equipment maintenance and provides reference for the study of the combination of digital twin model and other intelligent algorithms for health state assessment.

Do Health Technology Safety Issues Vary by Vendor?

There is a need to determine the relative similarity and differences in safety issues across specific types of software and medical devices in order to develop standardized solutions that can be used across these technologies. Over the past several years, health informatics researchers have identified differing types of technology-induced errors or safety issues. This work has led to a literature that has been effective in identifying varying technology-induced errors. Less effort has been made in attempting to understand if there are common types of safety issues and outcomes across vendors for specific types of technology such as electronic health records (EHRs). Our findings demonstrate that some safety issues are common across the same type of software. The findings suggest there is a need to develop standardized approaches to managing technology-induced errors.