Artificial intelligence in medical device software and high-risk medical devices - a review of definitions, expert recommendations and regulatory initiatives.

INTRODUCTION: Artificial intelligence (AI) encompasses a wide range of algorithms with risks when used to support decisions about diagnosis or treatment, so professional and regulatory bodies are recommending how they should be managed. AREAS COVERED: AI systems may qualify as standalone medical device software (MDSW) or be embedded within a medical device. Within the European Union (EU) AI software must undergo a conformity assessment procedure to be approved as a medical device. The draft EU Regulation on AI proposes rules that will apply across industry sectors, while for devices the Medical Device Regulation also applies. In the CORE-MD project (Coordinating Research and Evidence for Medical Devices), we have surveyed definitions and summarize initiatives made by professional consensus groups, regulators, and standardization bodies. EXPERT OPINION: The level of clinical evidence required should be determined according to each application and to legal and methodological factors that contribute to risk, including accountability, transparency, and interpretability. EU guidance for MDSW based on international recommendations does not yet describe the clinical evidence needed for medical AI software. Regulators, notified bodies, manufacturers, clinicians and patients would all benefit from common standards for the clinical evaluation of high-risk AI applications and transparency of their evidence and performance.

Cybersecurity of medical devices: new challenges arising from the AI Act and NIS 2 Directive proposals.

Cyberattacks on the IT infrastructure of hospitals, electronic health records or medical devices that have taken place during the COVID-19 pandemic reaffirmed how crucial it is to ensure cybersecurity in the healthcare sector. Medical devices are regulated in the European Union (EU) through vertical product-specific legislation, such as the Medical Device Regulation (MDR), among others. The MDR foresees safety requirements implying cybersecurity obligations for medical device manufacturers. In 2021, the EU legislator put forward the Network and Information Security System Directive reform (NIS 2) and the Artificial Intelligence Act (AIA) proposal, containing additional cybersecurity requirements applicable to medical devices. This article analyses how the new reforms interact with the existing legislation from a cybersecurity perspective. The research finds that parallel provision of analogous cybersecurity requirements (especially on notification requirements) could lead to regulatory overlapping, fragmentation, and uneven levels of protection of individuals in the EU internal market. In the "Recommendations and conclusions", the article provides policy recommendations to the EU legislator to help mitigate these risks.

Covid-19 Response From Global Makers: The Careables Cases of Global Design and Local Production.

Makerspaces-informal shared spaces that offer access to technologies, resources and a community of peer learners for making-across the globe initiated a rapid response to the lack of medical hardware supplies during the global pandemic outbreak in early 2020 caused by the Corona virus (COVID-19). As our health systems faced unexperienced pressure, being close to collapsing in some countries, and global supply chains failing to react immediately, makers started to prototype, locally produce and globally share designs of Open Source healthcare products, such as face shields and other medical supplies. Local collaboration with hospitals and healthcare professionals were established. These bottom-up initiatives from maker networks across the globe are showing us how responsible innovation is happening outside the constraints of profit-driven large industries. In this qualitative study we present five cases from a global network of makers that contributed to the production of personal protective equipment (PPE) and healthcare-related products. We draw our cases from the experiences made in Careables, a mixed community of people and organizations committed to the co-design and making of open, personalized healthcare for everyone. With the presented cases we reflect on the potential implications for post-pandemic local production of healthcare products and analyze them from a social innovation perspective. These global experiences are valuable indications of transformative innovations that can reduce dependencies from international supply chains and mainstream mass production.