Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 20 de 271
Filtrar
1.
Artigo em Inglês | MEDLINE | ID: mdl-39413313

RESUMO

OBJECTIVE: No studies describe what patients search for online in relation to retrograde cricopharyngeal dysfunction (RCPD). Our objectives were to describe the Google search volume for RCPD, identify the most common queries related to RCPD, and evaluate the available online resources. STUDY DESIGN: Observational. SETTING: Google Database. METHODS: Using Ahrefs and Search Response, Google search volume for RCPD and "People Also Ask" (PAA) questions were documented. PAA questions were categorized based on intent, and the websites were categorized on source. The quality and readability of the sources were determined using the Journal of the American Medical Association (JAMA) benchmark criteria, Flesch Reading Ease score, and Flesch-Kincaid Grade Level. RESULTS: Search volume for RCPD-related content has continually increased since 2021, with a combined average volume of 6287 searches per month. Most PAA questions were related to technical details (61.07%) and treatments (32.06%) for RCPD. Websites provided to answer these questions were most often from academic (25.95%) and commercial (22.14%) sources. None of the sources met the criteria for universal readability, and only 15% met all quality metrics set forth by JAMA. CONCLUSION: Interest in RCPD is at an all-time high, with information related to its diagnosis and treatment most popular among Google users. Significantly, none of the resources provided by Google met the criteria for universal readability, preventing many patients from fully comprehending the information presented. Future work should aim to address questions related to RCPD in a suitable way for all patient demographics.

2.
Health Informatics J ; 30(4): 14604582241287010, 2024.
Artigo em Inglês | MEDLINE | ID: mdl-39367798

RESUMO

Objective: A comprehensive understanding of professional and technical terms is essential to achieving practical results in multidisciplinary projects dealing with health informatics and digital health. The medical informatics multilingual ontology (MIMO) initiative has been created through international cooperation. MIMO is continuously updated and comprises over 3700 concepts in 37 languages on the Health Terminology/Ontology Portal (HeTOP). Methods: We conducted case studies to assess the feasibility and impact of integrating MIMO into real-world healthcare projects. In HosmartAI, MIMO is used to index technological tools in a dedicated marketplace and improve partners' communication. Then, in SaNuRN, MIMO supports the development of a "Catalog and Index of Digital Health Teaching Resources" (CIDHR) backing digital health resources retrieval for health and allied health students. Results: In HosmartAI, MIMO facilitates the indexation of technological tools and smooths partners' interactions. In SaNuRN within CIDHR, MIMO ensures that students and practitioners access up-to-date, multilingual, and high-quality resources to enhance their learning endeavors. Conclusion: Integrating MIMO into training in smart hospital projects allows healthcare students and experts worldwide with different mother tongues and knowledge to tackle challenges facing the health informatics and digital health landscape to find innovative solutions improving initial and continuous education.


Assuntos
Inteligência Artificial , Informática Médica , Humanos , Inteligência Artificial/tendências , Informática Médica/educação , Informática Médica/métodos , Hospitais , Saúde Digital
3.
Stud Health Technol Inform ; 317: 180-189, 2024 Aug 30.
Artigo em Inglês | MEDLINE | ID: mdl-39234721

RESUMO

INTRODUCTION: Constructing search queries that deal with complex concepts is a challenging task without proficiency in the underlying query language - which holds true for either structured or unstructured data. Medical data might encompass both types, with valuable information present in one type but not the other. METHOD: The TOP Framework provides clinical practitioners as well as researchers with a unified framework for querying diverse data types and, furthermore, facilitates an easier and intuitive approach. Additionally, it supports collaboration on query modeling and sharing. RESULTS: Having demonstrated its effectiveness with structured data, we introduce the integration of a component for unstructured data, specifically medical documents. CONCLUSION: Our proof-of-concept shows a query language agnostic framework to model search queries for unstructured and structured data.


Assuntos
Processamento de Linguagem Natural , Humanos , Armazenamento e Recuperação da Informação/métodos , Registros Eletrônicos de Saúde , Mineração de Dados/métodos
4.
Digit Health ; 10: 20552076231220151, 2024.
Artigo em Inglês | MEDLINE | ID: mdl-39286784

RESUMO

Objective: Local authority-led online campaigns offer the possibility of targeted health promotion to connect local services and residents. This study assesses the evidence for medium (e.g., click-trhoughs) and high (off-line behaviour change) levels of public engagement with four local authority-led campaigns across a variety of public health promotions (sexual health, weight loss, and vaccination), online marketing approaches (social media marketing, search engine marketing, and programmatic marketing) and target demographics (language, gender, age, income, ethnicity) undertaken by a London borough local authority. Methods: Employing quasi-experimental and observational study designs, engagement with local health services during the course of the campaigns was evaluated. The first three campaigns were evaluated based on an interrupted time series model of intervention assessment comparing outcome variables of interest during the campaign to periods before and after the campaign period. The results of the fourth campaign, an observational case-study, are discussed using descriptive statistics only. Results: The analyses of the high engagement data for two of the three campaigns statistically assessed clearly supported the effectiveness of the campaigns. While the effect of high engagement could not be determined in the other two campaigns, they provide data that may be useful in online campaign design. Conclusions: The evidence assessed in this study across a variety of platforms, health promotion initiatives, and population targets suggests that local authority-led online marketing campaigns for health promotion may be useful for increasing participation in public health programmes.

5.
Healthcare (Basel) ; 12(17)2024 Sep 05.
Artigo em Inglês | MEDLINE | ID: mdl-39273804

RESUMO

The widespread implementation of artificial intelligence technologies provides an appealing alternative to traditional search engines for online patient healthcare education. This study assessed ChatGPT-3.5's capabilities as a source of obstructive sleep apnea (OSA) information, using Google Search as a comparison. Ten frequently searched questions related to OSA were entered into Google Search and ChatGPT-3.5. The responses were assessed by two independent researchers using the Global Quality Score (GQS), Patient Education Materials Assessment Tool (PEMAT), DISCERN instrument, CLEAR tool, and readability scores (Flesch Reading Ease and Flesch-Kincaid Grade Level). ChatGPT-3.5 significantly outperformed Google Search in terms of GQS (5.00 vs. 2.50, p < 0.0001), DISCERN reliability (35.00 vs. 29.50, p = 0.001), and quality (11.50 vs. 7.00, p = 0.02). The CLEAR tool scores indicated that ChatGPT-3.5 provided excellent content (25.00 vs. 15.50, p < 0.001). PEMAT scores showed higher understandability (60-91% vs. 44-80%) and actionability for ChatGPT-3.5 (0-40% vs. 0%). Readability analysis revealed that Google Search responses were easier to read (FRE: 56.05 vs. 22.00; FKGL: 9.00 vs. 14.00, p < 0.0001). ChatGPT-3.5 delivers higher quality and more comprehensive OSA information compared to Google Search, although its responses are less readable. This suggests that while ChatGPT-3.5 can be a valuable tool for patient education, efforts to improve readability are necessary to ensure accessibility and utility for all patients. Healthcare providers should be aware of the strengths and weaknesses of various healthcare information resources and emphasize the importance of critically evaluating online health information, advising patients on its reliability and relevance.

6.
Laryngoscope ; 2024 Aug 27.
Artigo em Inglês | MEDLINE | ID: mdl-39192469

RESUMO

OBJECTIVE: Identify the questions most frequently asked online about cochlear implants (CI) and assess the readability and quality of the content. METHODS: A Google search engine observational study was conducted via a search response optimization (SEO) tool. The SEO tool listed the questions generated by Google's "People Also Ask" (PAA) feature for the search queries "cochlear implant" and "cochlear implant surgery." The top 50 PAA questions for each query were conceptually classified. Sourced websites were evaluated for readability, transparency and information quality, and ability to answer the question. Readability and accuracy in answering questions were also compared to the responses from ChatGPT 3.5. RESULTS: The PAA questions were commonly related to technical details (21%), surgical factors (18%), and postoperative experiences (12%). Sourced websites mainly were from academic institutions, followed by commercial companies. Among all types of websites, readability, on average, did not meet the recommended standard for health-related patient education materials. Only two websites were at or below the 8th-grade level. Responses by ChatGPT had significantly poorer readability compared to the websites (p < 0.001). These online resources were not significantly different in the percentage of accurately answering the questions (websites: 78%, ChatGPT: 85%, p = 0.136). CONCLUSIONS: The most searched topics were technical details about devices, surgical factors, and the postoperative experience. Unfortunately, most websites did not meet the ideal criteria of readability, quality, and credibility for patient education. These results highlight potential knowledge gaps for patients, deficits in current online education materials, and possible tools to better support CI candidate decision-making. LEVEL OF EVIDENCE: NA Laryngoscope, 2024.

7.
Sci Rep ; 14(1): 15495, 2024 07 05.
Artigo em Inglês | MEDLINE | ID: mdl-38969709

RESUMO

This study, leveraging search engine data, investigates the dynamics of China's domestic tourism markets in response to the August 2022 epidemic outbreak in Xinjiang. It focuses on understanding the reaction mechanisms of tourist-origin markets during destination crises in the post-pandemic phase. Notably, the research identifies a continuous rise in the potential tourism demand from tourist origin cities, despite the challenges posed by the epidemic. Further analysis uncovers a regional disparity in the growth of tourism demand, primarily influenced by the economic stratification of origin markets. Additionally, the study examines key tourism attractions such as Duku Road, highlighting its resilient competitive system, which consists of distinctive tourism experiences, economically robust tourist origins, diverse tourist markets, and spatial pattern stability driven by economic factors in source cities, illustrating an adaptive response to external challenges such as crises. The findings provide new insights into the dynamics of tourism demand, offering a foundation for developing strategies to bolster destination resilience and competitiveness in times of health crises.


Assuntos
COVID-19 , Turismo , Viagem , Humanos , COVID-19/epidemiologia , COVID-19/prevenção & controle , China/epidemiologia , SARS-CoV-2 , Pandemias/prevenção & controle , Cidades
8.
Proc Biol Sci ; 291(2027): 20241222, 2024 Jul.
Artigo em Inglês | MEDLINE | ID: mdl-39079668

RESUMO

In a growing digital landscape, enhancing the discoverability and resonance of scientific articles is essential. Here, we offer 10 recommendations to amplify the discoverability of studies in search engines and databases. Particularly, we argue that the strategic use and placement of key terms in the title, abstract and keyword sections can boost indexing and appeal. By surveying 230 journals in ecology and evolutionary biology, we found that current author guidelines may unintentionally limit article findability. Our survey of 5323 studies revealed that authors frequently exhaust abstract word limits-particularly those capped under 250 words. This suggests that current guidelines may be overly restrictive and not optimized to increase the dissemination and discoverability of digital publications. Additionally, 92% of studies used redundant keywords in the title or abstract, undermining optimal indexing in databases. We encourage adopting structured abstracts to maximize the incorporation of key terms in titles, abstracts and keywords. In addition, we encourage the relaxation of abstract and keyword limitations in journals with strict guidelines, and the inclusion of multilingual abstracts to broaden global accessibility. These recommendations to editors are designed to improve article engagement and facilitate evidence synthesis, thereby aligning scientific publishing with the modern needs of academic research.


Assuntos
Publicações Periódicas como Assunto , Ecologia/métodos , Indexação e Redação de Resumos , Editoração/normas
9.
J Am Med Inform Assoc ; 31(11): 2595-2604, 2024 Nov 01.
Artigo em Inglês | MEDLINE | ID: mdl-39047296

RESUMO

OBJECTIVES: To enhance and evaluate the quality of PubMed search results for Social Determinants of Health (SDoH) through the addition of new SDoH terms to Medical Subject Headings (MeSH). MATERIALS AND METHODS: High priority SDoH terms and definitions were collated from authoritative sources, curated based on publication frequencies, and refined by subject matter experts. Descriptive analyses were used to investigate how PubMed search details and best match results were affected by the addition of SDoH concepts to MeSH. Three information retrieval metrics (Precision, Recall, and F measure) were used to quantitatively assess the accuracy of PubMed search results. Pre- and post-update documents were clustered into topic areas using a Natural Language Processing pipeline, and SDoH relevancy assessed. RESULTS: Addition of 35 SDoH terms to MeSH resulted in more accurate algorithmic translations of search terms and more reliable best match results. The Precision, Recall, and F measures of post-update results were significantly higher than those of pre-update results. The percentage of retrieved publications belonging to SDoH clusters was significantly greater in the post- than pre-update searches. DISCUSSION: This evaluation confirms that inclusion of new SDoH terms in MeSH can lead to qualitative and quantitative enhancements in PubMed search retrievals. It demonstrates the methodology for and impact of suggesting new terms for MeSH indexing. It provides a foundation for future efforts across behavioral and social science research (BSSR) domains. CONCLUSION: Improving the representation of BSSR terminology in MeSH can improve PubMed search results, thereby enhancing the ability of investigators and clinicians to build and utilize a cumulative BSSR knowledge base.


Assuntos
Medical Subject Headings , Processamento de Linguagem Natural , PubMed , Determinantes Sociais da Saúde , Terminologia como Assunto , Armazenamento e Recuperação da Informação/métodos , Humanos , Algoritmos
11.
JMIR Med Inform ; 12: e51187, 2024 May 14.
Artigo em Inglês | MEDLINE | ID: mdl-38771247

RESUMO

Background: A large language model is a type of artificial intelligence (AI) model that opens up great possibilities for health care practice, research, and education, although scholars have emphasized the need to proactively address the issue of unvalidated and inaccurate information regarding its use. One of the best-known large language models is ChatGPT (OpenAI). It is believed to be of great help to medical research, as it facilitates more efficient data set analysis, code generation, and literature review, allowing researchers to focus on experimental design as well as drug discovery and development. Objective: This study aims to explore the potential of ChatGPT as a real-time literature search tool for systematic reviews and clinical decision support systems, to enhance their efficiency and accuracy in health care settings. Methods: The search results of a published systematic review by human experts on the treatment of Peyronie disease were selected as a benchmark, and the literature search formula of the study was applied to ChatGPT and Microsoft Bing AI as a comparison to human researchers. Peyronie disease typically presents with discomfort, curvature, or deformity of the penis in association with palpable plaques and erectile dysfunction. To evaluate the quality of individual studies derived from AI answers, we created a structured rating system based on bibliographic information related to the publications. We classified its answers into 4 grades if the title existed: A, B, C, and F. No grade was given for a fake title or no answer. Results: From ChatGPT, 7 (0.5%) out of 1287 identified studies were directly relevant, whereas Bing AI resulted in 19 (40%) relevant studies out of 48, compared to the human benchmark of 24 studies. In the qualitative evaluation, ChatGPT had 7 grade A, 18 grade B, 167 grade C, and 211 grade F studies, and Bing AI had 19 grade A and 28 grade C studies. Conclusions: This is the first study to compare AI and conventional human systematic review methods as a real-time literature collection tool for evidence-based medicine. The results suggest that the use of ChatGPT as a tool for real-time evidence generation is not yet accurate and feasible. Therefore, researchers should be cautious about using such AI. The limitations of this study using the generative pre-trained transformer model are that the search for research topics was not diverse and that it did not prevent the hallucination of generative AI. However, this study will serve as a standard for future studies by providing an index to verify the reliability and consistency of generative AI from a user's point of view. If the reliability and consistency of AI literature search services are verified, then the use of these technologies will help medical research greatly.

12.
BMC Med Educ ; 24(1): 603, 2024 May 31.
Artigo em Inglês | MEDLINE | ID: mdl-38822287

RESUMO

BACKGROUND: Videos to support learning of clinical skills are effective; however, little is known about the scope and educational quality of the content of freely available online videos demonstrating task-specific training (TST). This review aimed to determine the extent, characteristics of freely available online videos, and whether the content is suitable to guide skill acquisition of task-specific training for neurological physiotherapists and students. METHODS: A scoping review was conducted. Google video and YouTube were searched in December 2022. Videos that met our eligibility criteria and were explicitly designed for (TST) skill acquisition were included in the report. RESULTS: Ten videos met the inclusion criteria and were difficult to find amongst the range of videos available. Most were presented by physiotherapists or occupational therapists, originated from the USA, featured stroke as the condition of the person being treated, and involved a range of interventions (upper limb, constraint induced movement therapy, balance, bicycling). Most videos were created by universities or private practices and only two used people with a neurological condition as the participant. When the content of videos and their presentation (instruction and/or demonstration), was assessed against each key component of TST (practice structure, specificity, repetition, modification, progression, feedback), five of the videos were rated very suitable and five moderately suitable to guide skill acquisition. Most videos failed to demonstrate and provide instruction on each key component of TST and were missing at least one component, with feedback most frequently omitted. CONCLUSIONS: There are many freely available online videos which could be described as demonstrating TST; very few are suitable to guide skill acquisition. The development of a standardised and validated assessment tool, that is easy to use and assesses the content of TST videos is required to support learners to critically evaluate the educational quality of video content. Guidelines based on sound teaching theory and practice are required to assist creators of online videos to provide suitable resources that meet the learning needs of neurological physiotherapists and students.


Assuntos
Competência Clínica , Fisioterapeutas , Gravação em Vídeo , Humanos , Competência Clínica/normas , Fisioterapeutas/educação
13.
J Comput Aided Mol Des ; 38(1): 23, 2024 May 30.
Artigo em Inglês | MEDLINE | ID: mdl-38814371

RESUMO

In this work, we present the frontend of GeoMine and showcase its application, focusing on the new features of its latest version. GeoMine is a search engine for ligand-bound and predicted empty binding sites in the Protein Data Bank. In addition to its basic text-based search functionalities, GeoMine offers a geometric query type for searching binding sites with a specific relative spatial arrangement of chemical features such as heavy atoms and intermolecular interactions. In contrast to a text search that requires simple and easy-to-formulate user input, a 3D input is more complex, and its specification can be challenging for users. GeoMine's new version aims to address this issue from the graphical user interface perspective by introducing an additional visualization concept and a new query template type. In its latest version, GeoMine extends its query-building capabilities primarily through input formulation in 2D. The 2D editor is fully synchronized with GeoMine's 3D editor and provides the same functionality. It enables template-free query generation and template-based query selection directly in 2D pose diagrams. In addition, the query generation with the 3D editor now supports predicted empty binding sites for AlphaFold structures as query templates. GeoMine is freely accessible on the ProteinsPlus web server ( https://proteins.plus ).


Assuntos
Bases de Dados de Proteínas , Ligação Proteica , Proteínas , Interface Usuário-Computador , Ligantes , Sítios de Ligação , Proteínas/química , Proteínas/metabolismo , Software , Ferramenta de Busca , Conformação Proteica , Modelos Moleculares
14.
J Dent Educ ; 2024 May 07.
Artigo em Inglês | MEDLINE | ID: mdl-38715215

RESUMO

PURPOSE/OBJECTIVES: This study proposes the utilization of a Natural Language Processing tool to create a semantic search engine for dental education while addressing the increasing concerns of accuracy, bias, and hallucination in outputs generated by AI tools. The paper focuses on developing and evaluating DentQA, a specialized question-answering tool that makes it easy for students to seek information to access information located in handouts or study material distributed by an institution. METHODS: DentQA is structured upon the GPT3.5 language model, utilizing prompt engineering to extract information from external dental documents that experts have verified. Evaluation involves non-human metrics (BLEU scores) and human metrics for the tool's performance, relevance, accuracy, and functionality. RESULTS: Non-human metrics confirm DentQA's linguistic proficiency, achieving a Unigram BLEU score of 0.85. Human metrics reveal DentQA's superiority over GPT3.5 in terms of accuracy (p = 0.00004) and absence of hallucination (p = 0.026). Additional metrics confirmed consistent performance across different question types (X2 (4, N = 200) = 13.0378, p = 0.012). User satisfaction and performance metrics support DentQA's usability and effectiveness, with a response time of 3.5 s and over 70% satisfaction across all evaluated parameters. CONCLUSIONS: The study advocates using a semantic search engine in dental education, mitigating concerns of misinformation and hallucination. By outlining the workflow and the utilization of open-source tools and methods, the study encourages the utilization of similar tools for dental education while underscoring the importance of customizing AI models for dentistry. Further optimizations, testing, and utilization of recent advances can contribute to dental education significantly.

15.
J Dtsch Dermatol Ges ; 22(6): 794-800, 2024 Jun.
Artigo em Inglês | MEDLINE | ID: mdl-38643380

RESUMO

BACKGROUND AND OBJECTIVES: In recent years, there has been an increase in skin cancer. The aim of this study was therefore to investigate the representation of skin cancer in public awareness worldwide and in Germany, and to determine whether Skin Cancer Awareness Month is represented in the search interests of the Internet-using population in the same way as Breast Cancer Awareness Month worldwide. DATA AND METHODS: In this study, Google Trends data were used to track levels of public awareness for different tumor entities and skin cancer types worldwide and for Germany. RESULTS: The results of this analysis clearly showed a high level of relative public search interest in breast cancer worldwide in the awareness month of October. Worldwide and in Germany, there was a certain increase in search interest and a certain seasonal effect around the May awareness month for skin cancer. For example, the analysis showed a search interest in May and during the summer months in Germany. CONCLUSIONS: It is likely that the population, for example in Germany, may benefit further from an even greater emphasis on the topic of skin cancer.


Assuntos
Neoplasias Cutâneas , Neoplasias Cutâneas/epidemiologia , Alemanha/epidemiologia , Humanos , Saúde Global , Conhecimentos, Atitudes e Prática em Saúde , Internet , Estações do Ano , Conscientização
16.
Graefes Arch Clin Exp Ophthalmol ; 262(9): 3047-3052, 2024 Sep.
Artigo em Inglês | MEDLINE | ID: mdl-38639789

RESUMO

PURPOSE: This study investigated whether websites regarding diabetic retinopathy are readable for patients, and adequately designed to be found by search engines. METHODS: The term "diabetic retinopathy" was queried in the Google search engine. Patient-oriented websites from the first 10 pages were categorized by search result page number and website organization type. Metrics of search engine optimization (SEO) and readability were then calculated. RESULTS: Among the 71 sites meeting inclusion criteria, informational and organizational sites were best optimized for search engines, and informational sites were the most visited. Better optimization as measured by authority score was correlated with lower Flesch Kincaid Grade Level (r = 0.267, P = 0.024). There was a significant increase in Flesch Kincaid Grade Level with successive search result pages (r = 0.275, P = 0.020). Only 2 sites met the 6th grade reading level AMA recommendation by Flesch Kincaid Grade Level; the average reading level was 10.5. There was no significant difference in readability between website categories. CONCLUSION: While the readability of diabetic retinopathy patient information was poor, better readability was correlated to better SEO metrics. While we cannot assess causality, we recommend websites improve their readability, which may increase uptake of their resources.


Assuntos
Compreensão , Retinopatia Diabética , Internet , Ferramenta de Busca , Humanos , Retinopatia Diabética/diagnóstico , Educação de Pacientes como Assunto , Informação de Saúde ao Consumidor/normas , Letramento em Saúde
17.
Comput Struct Biotechnol J ; 23: 1499-1509, 2024 Dec.
Artigo em Inglês | MEDLINE | ID: mdl-38633387

RESUMO

With the explosive growth of protein-related data, we are confronted with a critical scientific inquiry: How can we effectively retrieve, compare, and profoundly comprehend these protein structures to maximize the utilization of such data resources? PS-GO, a parametric protein search engine, has been specifically designed and developed to maximize the utilization of the rapidly growing volume of protein-related data. This innovative tool addresses the critical need for effective retrieval, comparison, and deep understanding of protein structures. By integrating computational biology, bioinformatics, and data science, PS-GO is capable of managing large-scale data and accurately predicting and comparing protein structures and functions. The engine is built upon the concept of parametric protein design, a computer-aided method that adjusts and optimizes protein structures and sequences to achieve desired biological functions and structural stability. PS-GO utilizes key parameters such as amino acid sequence, side chain angle, and solvent accessibility, which have a significant influence on protein structure and function. Additionally, PS-GO leverages computable parameters, derived computationally, which are crucial for understanding and predicting protein behavior. The development of PS-GO underscores the potential of parametric protein design in a variety of applications, including enhancing enzyme activity, improving antibody affinity, and designing novel functional proteins. This advancement not only provides a robust theoretical foundation for the field of protein engineering and biotechnology but also offers practical guidelines for future progress in this domain.

18.
J Inf Sci ; 50(2): 404-419, 2024 Apr.
Artigo em Inglês | MEDLINE | ID: mdl-38618519

RESUMO

Algorithm audits have increased in recent years due to a growing need to independently assess the performance of automatically curated services that process, filter and rank the large and dynamic amount of information available on the Internet. Among several methodologies to perform such audits, virtual agents stand out because they offer the ability to perform systematic experiments, simulating human behaviour without the associated costs of recruiting participants. Motivated by the importance of research transparency and replicability of results, this article focuses on the challenges of such an approach. It provides methodological details, recommendations, lessons learned and limitations based on our experience of setting up experiments for eight search engines (including main, news, image and video sections) with hundreds of virtual agents placed in different regions. We demonstrate the successful performance of our research infrastructure across multiple data collections, with diverse experimental designs, and point to different changes and strategies that improve the quality of the method. We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time, and we hope that this article can serve as a basis for further research in this area.

19.
JMIR Med Educ ; 10: e48393, 2024 Mar 04.
Artigo em Inglês | MEDLINE | ID: mdl-38437007

RESUMO

BACKGROUND: Access to reliable and accurate digital health web-based resources is crucial. However, the lack of dedicated search engines for non-English languages, such as French, is a significant obstacle in this field. Thus, we developed and implemented a multilingual, multiterminology semantic search engine called Catalog and Index of Digital Health Teaching Resources (CIDHR). CIDHR is freely accessible to everyone, with a focus on French-speaking resources. CIDHR has been initiated to provide validated, high-quality content tailored to the specific needs of each user profile, be it students or professionals. OBJECTIVE: This study's primary aim in developing and implementing the CIDHR is to improve knowledge sharing and spreading in digital health and health informatics and expand the health-related educational community, primarily French speaking but also in other languages. We intend to support the continuous development of initial (ie, bachelor level), advanced (ie, master and doctoral levels), and continuing training (ie, professionals and postgraduate levels) in digital health for health and social work fields. The main objective is to describe the development and implementation of CIDHR. The hypothesis guiding this research is that controlled vocabularies dedicated to medical informatics and digital health, such as the Medical Informatics Multilingual Ontology (MIMO) and the concepts structuring the French National Referential on Digital Health (FNRDH), to index digital health teaching and learning resources, are effectively increasing the availability and accessibility of these resources to medical students and other health care professionals. METHODS: First, resource identification is processed by medical librarians from websites and scientific sources preselected and validated by domain experts and surveyed every week. Then, based on MIMO and FNRDH, the educational resources are indexed for each related knowledge domain. The same resources are also tagged with relevant academic and professional experience levels. Afterward, the indexed resources are shared with the digital health teaching and learning community. The last step consists of assessing CIDHR by obtaining informal feedback from users. RESULTS: Resource identification and evaluation processes were executed by a dedicated team of medical librarians, aiming to collect and curate an extensive collection of digital health teaching and learning resources. The resources that successfully passed the evaluation process were promptly included in CIDHR. These resources were diligently indexed (with MIMO and FNRDH) and tagged for the study field and degree level. By October 2023, a total of 371 indexed resources were available on a dedicated portal. CONCLUSIONS: CIDHR is a multilingual digital health education semantic search engine and platform that aims to increase the accessibility of educational resources to the broader health care-related community. It focuses on making resources "findable," "accessible," "interoperable," and "reusable" by using a one-stop shop portal approach. CIDHR has and will have an essential role in increasing digital health literacy.


Assuntos
Saúde Digital , Semântica , Humanos , Ferramenta de Busca , Idioma , Aprendizagem
20.
JMIR Public Health Surveill ; 10: e53086, 2024 Mar 21.
Artigo em Inglês | MEDLINE | ID: mdl-38512343

RESUMO

BACKGROUND: The online pharmacy market is growing, with legitimate online pharmacies offering advantages such as convenience and accessibility. However, this increased demand has attracted malicious actors into this space, leading to the proliferation of illegal vendors that use deceptive techniques to rank higher in search results and pose serious public health risks by dispensing substandard or falsified medicines. Search engine providers have started integrating generative artificial intelligence (AI) into search engine interfaces, which could revolutionize search by delivering more personalized results through a user-friendly experience. However, improper integration of these new technologies carries potential risks and could further exacerbate the risks posed by illicit online pharmacies by inadvertently directing users to illegal vendors. OBJECTIVE: The role of generative AI integration in reshaping search engine results, particularly related to online pharmacies, has not yet been studied. Our objective was to identify, determine the prevalence of, and characterize illegal online pharmacy recommendations within the AI-generated search results and recommendations. METHODS: We conducted a comparative assessment of AI-generated recommendations from Google's Search Generative Experience (SGE) and Microsoft Bing's Chat, focusing on popular and well-known medicines representing multiple therapeutic categories including controlled substances. Websites were individually examined to determine legitimacy, and known illegal vendors were identified by cross-referencing with the National Association of Boards of Pharmacy and LegitScript databases. RESULTS: Of the 262 websites recommended in the AI-generated search results, 47.33% (124/262) belonged to active online pharmacies, with 31.29% (82/262) leading to legitimate ones. However, 19.04% (24/126) of Bing Chat's and 13.23% (18/136) of Google SGE's recommendations directed users to illegal vendors, including for controlled substances. The proportion of illegal pharmacies varied by drug and search engine. A significant difference was observed in the distribution of illegal websites between search engines. The prevalence of links leading to illegal online pharmacies selling prescription medications was significantly higher (P=.001) in Bing Chat (21/86, 24%) compared to Google SGE (6/92, 6%). Regarding the suggestions for controlled substances, suggestions generated by Google led to a significantly higher number of rogue sellers (12/44, 27%; P=.02) compared to Bing (3/40, 7%). CONCLUSIONS: While the integration of generative AI into search engines offers promising potential, it also poses significant risks. This is the first study to shed light on the vulnerabilities within these platforms while highlighting the potential public health implications associated with their inadvertent promotion of illegal pharmacies. We found a concerning proportion of AI-generated recommendations that led to illegal online pharmacies, which could not only potentially increase their traffic but also further exacerbate existing public health risks. Rigorous oversight and proper safeguards are urgently needed in generative search to mitigate consumer risks, making sure to actively guide users to verified pharmacies and prioritize legitimate sources while excluding illegal vendors from recommendations.


Assuntos
Inteligência Artificial , Substâncias Controladas , Humanos , Saúde Pública , Ferramenta de Busca , Bases de Dados Factuais
SELEÇÃO DE REFERÊNCIAS
DETALHE DA PESQUISA
...