Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 20 de 25
Filtrar
1.
JAMA Ophthalmol ; 142(6): 548-558, 2024 Jun 01.
Artigo em Inglês | MEDLINE | ID: mdl-38722644

RESUMO

Importance: Despite widespread availability and consensus on its advantages for detailed imaging of geographic atrophy (GA), spectral-domain optical coherence tomography (SD-OCT) might benefit from automated quantitative OCT analyses in GA diagnosis, monitoring, and reporting of its landmark clinical trials. Objective: To analyze the association between pegcetacoplan and consensus GA SD-OCT end points. Design, Setting, and Participants: This was a post hoc analysis of 11 614 SD-OCT volumes from 936 of the 1258 participants in 2 parallel phase 3 studies, the Study to Compare the Efficacy and Safety of Intravitreal APL-2 Therapy With Sham Injections in Patients With Geographic Atrophy (GA) Secondary to Age-Related Macular Degeneration (OAKS) and Study to Compare the Efficacy and Safety of Intravitreal APL-2 Therapy With Sham Injections in Patients With Geographic Atrophy (GA) Secondary to Age-Related Macular Degeneration (DERBY). OAKS and DERBY were 24-month, multicenter, randomized, double-masked, sham-controlled studies conducted from August 2018 to July 2020 among adults with GA with total area 2.5 to 17.5 mm2 on fundus autofluorescence imaging (if multifocal, at least 1 lesion ≥1.25 mm2). This analysis was conducted from September to December 2023. Interventions: Study participants received pegcetacoplan, 15 mg per 0.1-mL intravitreal injection, monthly or every other month, or sham injection monthly or every other month. Main Outcomes and Measures: The primary end point was the least squares mean change from baseline in area of retinal pigment epithelium and outer retinal atrophy in each of the 3 treatment arms (pegcetacoplan monthly, pegcetacoplan every other month, and pooled sham [sham monthly and sham every other month]) at 24 months. Feature-specific area analysis was conducted by Early Treatment Diabetic Retinopathy Study (ETDRS) regions of interest (ie, foveal, parafoveal, and perifoveal). Results: Among 936 participants, the mean (SD) age was 78.5 (7.22) years, and 570 participants (60.9%) were female. Pegcetacoplan, but not sham treatment, was associated with reduced growth rates of SD-OCT biomarkers for GA for up to 24 months. Reductions vs sham in least squares mean (SE) change from baseline of retinal pigment epithelium and outer retinal atrophy area were detectable at every time point from 3 through 24 months (least squares mean difference vs pooled sham at month 24, pegcetacoplan monthly: -0.86 mm2; 95% CI, -1.15 to -0.57; P < .001; pegcetacoplan every other month: -0.69 mm2; 95% CI, -0.98 to -0.39; P < .001). This association was more pronounced with more frequent dosing (pegcetacoplan monthly vs pegcetacoplan every other month at month 24: -0.17 mm2; 95% CI, -0.43 to 0.08; P = .17). Stronger associations were observed in the parafoveal and perifoveal regions for both pegcetacoplan monthly and pegcetacoplan every other month. Conclusions and Relevance: These findings offer additional insight into the potential effects of pegcetacoplan on the development of GA, including potential effects on the retinal pigment epithelium and photoreceptors. Trial Registration: ClinicalTrials.gov Identifiers: NCT03525600 and NCT03525613.


Assuntos
Angiofluoresceinografia , Atrofia Geográfica , Injeções Intravítreas , Tomografia de Coerência Óptica , Acuidade Visual , Humanos , Atrofia Geográfica/diagnóstico , Atrofia Geográfica/tratamento farmacológico , Feminino , Masculino , Idoso , Método Duplo-Cego , Acuidade Visual/fisiologia , Angiofluoresceinografia/métodos , Epitélio Pigmentado da Retina/patologia , Epitélio Pigmentado da Retina/diagnóstico por imagem , Idoso de 80 Anos ou mais , Fator A de Crescimento do Endotélio Vascular/antagonistas & inibidores , Fundo de Olho , Consenso , Resultado do Tratamento , Seguimentos , Inibidores da Angiogênese/administração & dosagem , Inibidores da Angiogênese/uso terapêutico
2.
Rev. panam. salud pública ; 48: e13, 2024. tab, graf
Artigo em Espanhol | LILACS-Express | LILACS | ID: biblio-1536672

RESUMO

resumen está disponible en el texto completo


ABSTRACT The CONSORT 2010 statement provides minimum guidelines for reporting randomized trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human-AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.


RESUMO A declaração CONSORT 2010 apresenta diretrizes mínimas para relatórios de ensaios clínicos randomizados. Seu uso generalizado tem sido fundamental para garantir a transparência na avaliação de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence) é uma nova diretriz para relatórios de ensaios clínicos que avaliam intervenções com um componente de IA. Ela foi desenvolvida em paralelo à sua declaração complementar para protocolos de ensaios clínicos, a SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 29 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão CONSORT-AI inclui 14 itens novos que, devido à sua importância para as intervenções de IA, devem ser informados rotineiramente juntamente com os itens básicos da CONSORT 2010. A CONSORT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA está inserida, considerações sobre o manuseio dos dados de entrada e saída da intervenção de IA, a interação humano-IA e uma análise dos casos de erro. A CONSORT-AI ajudará a promover a transparência e a integralidade nos relatórios de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente a qualidade do desenho do ensaio clínico e o risco de viés nos resultados relatados.

3.
Rev. panam. salud pública ; 48: e12, 2024. tab, graf
Artigo em Espanhol | LILACS-Express | LILACS | ID: biblio-1536674

RESUMO

resumen está disponible en el texto completo


ABSTRACT The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.


RESUMO A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.

4.
Eye (Lond) ; 37(11): 2172-2175, 2023 08.
Artigo em Inglês | MEDLINE | ID: mdl-36460858

RESUMO

Ophthalmology faces many challenges in providing effective and meaningful eye care to an ever-increasing group of people. Even health systems that have so far been able to cope with the quantitative patient increase, due to their funding and the availability of highly qualified professionals, and improvements in practice routine efficiency, will be pushed to their limits. Further pressure on care will also be caused by new active substances for the largest group of patients with AMD, the so-called dry form. Treatment availability for this so far untreated group will increase the volume of patients 2-3 times. Without the adaptation of the care structures, this quantitative and qualitative expansion in therapy will inevitably lead to an undersupply.There is increasing scientific evidence that significant efficiency gains in the care of chronic diseases can be achieved through better networking of stakeholders in the healthcare system and greater patient involvement. Digitalization can make an important contribution here. Many technological solutions have been developed in recent years and the time is now ready to exploit this potential. The exceptional setting during the SARS-CoV-2 pandemic has shown many that new technology is available safely, quickly, and effectively. The emergency has catalyzed innovation processes and shown for post-pandemic time after that we are equipped to tackle the challenges in ophthalmic healthcare - ultimately for the benefit of patients and society.


Assuntos
COVID-19 , Oftalmologia , Humanos , SARS-CoV-2 , Atenção à Saúde , Pacientes
5.
Rev. panam. salud pública ; 47: e149, 2023. tab, graf
Artigo em Espanhol | LILACS-Express | LILACS | ID: biblio-1536665

RESUMO

resumen está disponible en el texto completo


ABSTRACT The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.


RESUMO A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.

6.
BMJ Open ; 11(12): e056940, 2021 12 23.
Artigo em Inglês | MEDLINE | ID: mdl-34949632

RESUMO

OBJECTIVE: We compared patients with neovascular age-related macular degeneration (nvAMD), diabetic macular oedema (DMO) and other macular pathologies testing their vision with the hyperacuity home-monitoring app Alleye to patients not performing home-monitoring regarding clinical outcomes and clinical management. DESIGN: Matched-pair analysis. SETTING: Retina Referral Centre, Switzerland. PARTICIPANTS: For each eye using Alleye, we matched 2-4 controls not using home-monitoring based on age, gender, number of previous intravitreal injections (IVI), best corrected visual acuity (BCVA) (Early Treatment Diabetic Retinopathy Study letters), central macular thickness (CRT) and time point of enrolment, using the Mahalanobis distance matching algorithm. We included 514 eyes (288 patients); 107 eyes with nvAMD using home monitoring and 218 controls not using home monitoring, 25 eyes with DMO (n=52 controls) and 40 eyes with miscellaneous conditions (n=72 controls). 173 eyes (33.7%) received no IVI during follow-up. MAIN OUTCOME MEASURES: Improvement of ≥5 letters, number of injection visits and treatment retention after correcting for differences in baseline characteristics with multivariate analyses. RESULTS: The mean follow-up duration was 809 days (range 147-1353) and the mean number of IVI/year among treated eyes was 6.7 (SD 3.1). Mean age at baseline was 70.4 years (SD 10.9), BCVA was 77.6 letters (SD 11.6) and CRT was 263.6 µm (SD 86.7) and was similar between patients using and not using home monitoring. In multivariate analyses, patients using home monitoring had a higher chance to improve visual acuity by ≥5 letters (OR 1.67 (95% CI 1.01 to 2.76; p=0.044)) than controls. Treated eyes using home monitoring had less injection visits/year (-0.99 (95% CI -1.59 to -0.40; p=0.001)) and a longer treatment retention +69.2 days (95% CI 2.4 to 136.0; p=0.042). These effects were similar across retinal pathologies. CONCLUSIONS: This data suggest that patients capable of performing mobile hyperacuity home monitoring benefit in terms of visual acuity and discontinue treatment less often than patients not using home monitoring.


Assuntos
Retinopatia Diabética , Aplicativos Móveis , Cooperação e Adesão ao Tratamento , Inibidores da Angiogênese/uso terapêutico , Retinopatia Diabética/tratamento farmacológico , Humanos , Injeções Intravítreas , Análise por Pareamento , Ranibizumab/uso terapêutico , Tomografia de Coerência Óptica , Resultado do Tratamento
7.
Lancet Digit Health ; 3(1): e51-e66, 2021 01.
Artigo em Inglês | MEDLINE | ID: mdl-33735069

RESUMO

Health data that are publicly available are valuable resources for digital health research. Several public datasets containing ophthalmological imaging have been frequently used in machine learning research; however, the total number of datasets containing ophthalmological health information and their respective content is unclear. This Review aimed to identify all publicly available ophthalmological imaging datasets, detail their accessibility, describe which diseases and populations are represented, and report on the completeness of the associated metadata. With the use of MEDLINE, Google's search engine, and Google Dataset Search, we identified 94 open access datasets containing 507 724 images and 125 videos from 122 364 patients. Most datasets originated from Asia, North America, and Europe. Disease populations were unevenly represented, with glaucoma, diabetic retinopathy, and age-related macular degeneration disproportionately overrepresented in comparison with other eye diseases. The reporting of basic demographic characteristics such as age, sex, and ethnicity was poor, even at the aggregate level. This Review provides greater visibility for ophthalmological datasets that are publicly available as powerful resources for research. Our paper also exposes an increasing divide in the representation of different population and disease groups in health data repositories. The improved reporting of metadata would enable researchers to access the most appropriate datasets for their needs and maximise the potential of such resources.


Assuntos
Bases de Dados Factuais , Conjuntos de Dados como Assunto , Diagnóstico por Imagem/métodos , Oftalmopatias/diagnóstico por imagem , Oftalmologia , Humanos , Metadados/normas
8.
Ophthalmol Retina ; 5(11): 1074-1084, 2021 11.
Artigo em Inglês | MEDLINE | ID: mdl-33516917

RESUMO

PURPOSE: To evaluate the predictive usefulness of quantitative imaging biomarkers, acquired automatically from OCT scans, of cross-sectional and future visual outcomes of patients with neovascular age-related macular degeneration (AMD) starting anti-vascular endothelial growth factor (VEGF) therapy. DESIGN: Retrospective cohort study. PARTICIPANTS: Treatment-naive, first-treated eyes of patients with neovascular AMD between 2007 and 2017 at Moorfields Eye Hospital (a large, United Kingdom single center) undergoing anti-VEGF therapy. METHODS: Automatic segmentation was carried out by applying a deep learning segmentation algorithm to 137 379 OCT scans from 6467 eyes of 3261 patients with neovascular AMD. After applying selection criteria, 926 eyes of 926 patients were analyzed. MAIN OUTCOME MEASURES: Correlation coefficients (R2 values) and mean absolute error (MAE) between quantitative OCT (qOCT) parameters and cross-sectional visual function, as well as the predictive value of these parameters for short-term visual change, that is, incremental visual acuity (VA) resulting from an individual injection, as well as VA at distant time points (up to 12 months after baseline). RESULTS: Visual acuity at distant time points could be predicted: R2 = 0.80 (MAE, 5.0 Early Treatment Diabetic Retinopathy Study [ETDRS] letters) and R2 = 0.7 (MAE, 7.2 ETDRS letters) after injection at 3 and at 12 months after baseline (P < 0.001 for both), respectively. Best performing models included both baseline qOCT parameters and treatment response. Furthermore, we present proof-of-principle evidence that the incremental change in VA from an injection can be predicted: R2 = 0.14 (MAE, 5.6 ETDRS letters) for injection 2 and R2 = 0.11 (MAE, 5.0 ETDRS letters) for injection 3 (P < 0.001 for both). CONCLUSIONS: Automatic segmentation enables rapid acquisition of quantitative and reproducible OCT biomarkers with potential to inform treatment decisions in the care of neovascular AMD. This furthers development of point-of-care decision-aid systems for personalized medicine.


Assuntos
Aprendizado Profundo , Ranibizumab/administração & dosagem , Acuidade Visual , Degeneração Macular Exsudativa/fisiopatologia , Idoso , Idoso de 80 Anos ou mais , Inibidores da Angiogênese/administração & dosagem , Estudos Transversais , Feminino , Seguimentos , Humanos , Injeções Intravítreas , Masculino , Pessoa de Meia-Idade , Prognóstico , Estudos Retrospectivos , Tomografia de Coerência Óptica , Fator A de Crescimento do Endotélio Vascular/antagonistas & inibidores , Degeneração Macular Exsudativa/diagnóstico , Degeneração Macular Exsudativa/tratamento farmacológico
9.
Eye (Lond) ; 35(11): 3035-3040, 2021 11.
Artigo em Inglês | MEDLINE | ID: mdl-33414531

RESUMO

BACKGROUND: Home monitoring of hyperacuity allows early detection of progression in exudative neovascular age-related macular degeneration (nvAMD) and diabetic macular oedema (DMO). However, false alarms may pose a significant burden to both patients and healthcare professionals alike. PURPOSE: To assess the false alarm rate and positive predictive value of smartphone-based home monitoring of nvAMD and DMO. METHODS: Patients treated with anti-angiogenic therapy in a pro re nata scheme for nvAMD or DMO at the Medical Retina service (Lucerne, Switzerland) between March and June 2016 were included in this prospective cohort study. The home monitoring test Alleye (Oculocare Ltd, Switzerland) provided a session score from 0-100 in addition to a traffic-light system feedback via the smartphone application. Three consecutive "red" scores were considered as a positive test or alarm signal. Specificity, 1-specificity (false alarm rate) and the predictive value for optical coherence tomography-based disease progression were analysed. RESULTS: 73 eyes of 56 patients performed 2258 tests in 222 "follow-up periods". Progression was observed in 141 periods (63.5%). The specificity of the test was 93.8% (95% CI: 86.2-98.0%), the false alarm rate 6.1% (95% CI: 2.0-13.8%), and the positive predictive value 80.0% (95% CI: 59.3-93.2%) for the detection of progression. CONCLUSION: False alarm rates for the detection of progression in macular disease via home monitoring is low. These findings suggest that home monitoring may be a useful adjunct for remote management of nvAMD and DMO.


Assuntos
Retinopatia Diabética , Edema Macular , Retinopatia Diabética/diagnóstico , Humanos , Valor Preditivo dos Testes , Estudos Prospectivos , Smartphone , Tomografia de Coerência Óptica
10.
Br J Ophthalmol ; 105(12): 1688-1695, 2021 12.
Artigo em Inglês | MEDLINE | ID: mdl-33011683

RESUMO

BACKGROUND: To describe 10-year trends in visual outcomes, anatomical outcomes and treatment burden of patients receiving antivascular endothelial growth factor (anti-VEGF) therapy for neovascular age-related macular degeneration (nAMD). METHODS: Retrospective cohort study of treatment-naïve, first-affected eyes with nAMD started on ranibizumab before January 1, 2009. The primary outcome was time to best-corrected visual acuity (BCVA) falling ≤35 ETDRS letters after initiating anti-VEGF therapy. Secondary outcomes included time to BCVA reaching ≥70 letters, proportion of eyes with BCVA ≥70 and ≤35 letters in 10 years, mean trend of BCVA and central retinal thickness over 10 years, and mean number of injections. RESULTS: For our cohort of 103 patients, Kaplan-Meier analyses demonstrated median time to BCVA reaching ≤35 and ≥70 letters were 37.8 (95% CI 22.2 to 65.1) and 8.3 (95% CI 4.8 to 20.9) months after commencing anti-VEGF therapy, respectively. At the final follow-up, BCVA was ≤35 letters and ≥70 letters in 41.1% and 21%, respectively, in first-affected eyes, while this was the case for 5.4% and 48.2%, respectively, in a patient's better-seeing eye. Mean injection number was 37.0±24.2 per eye and 53.6±30.1 at patient level (63.1% of patients required injections in both eyes). CONCLUSIONS: The chronicity of nAMD disease and its management highlights the importance of long-term visual prognosis. Our analyses suggest that one in five patients will retain good vision (BCVA ≥70 ETDRS letters) in the first-affected eye at 10 years after starting anti-VEGF treatment; yet, one in two patients will have good vision in their better-seeing eye. Moreover, our data suggest that early treatment of nAMD is associated with better visual outcomes.


Assuntos
Degeneração Macular , Degeneração Macular Exsudativa , Inibidores da Angiogênese/uso terapêutico , Humanos , Injeções Intravítreas , Degeneração Macular/tratamento farmacológico , Ranibizumab/uso terapêutico , Estudos Retrospectivos , Resultado do Tratamento , Fator A de Crescimento do Endotélio Vascular , Acuidade Visual , Degeneração Macular Exsudativa/diagnóstico , Degeneração Macular Exsudativa/tratamento farmacológico
11.
Br J Ophthalmol ; 105(12): 1738-1743, 2021 12.
Artigo em Inglês | MEDLINE | ID: mdl-33067360

RESUMO

BACKGROUND/AIMS: The SARS-CoV-2 pandemic has imposed barriers to retinal care delivery worldwide. In this context, retinal services are exploring novel ways to ensure access to healthcare. METHODS: We conducted a worldwide survey among retinal specialists between March 31, 2020 and April 12, 2020. The expert survey was developed on the basis of focus group discussions involving retinal specialists and literature searches. It included 44 questions on alternative ways of care provision including digital health domains such as teleophthalmology, home monitoring or decentralised patient care. RESULTS: 214 retinal experts participated in the survey, of which 120 (56.1%) had more than 15 years of experience in ophthalmology. Most participants were clinicians (n=158, 73.9%) practising in Western Europe (n=159, 74%). In the majority of institutions, teleophthalmology, home monitoring and decentralised patient care have not been implemented before the pandemic (n=46, 21.8.1%; n=64, 29.9%; n=38, 19.1%). During the pandemic, the use of teleophthalmology and home monitoring increased significantly (n=105, p<0.001; n=90, p<0.001). In the subgroup of institutions reporting no teleophthalmology service before and implementing a service during the pandemic (34/70, 48.6%), reimbursement was the sole significant parameter (OR 9.62 (95% CI 2.42 to 38.16); p<0.001). CONCLUSION: Digital health is taking the centre stage tackling unpreceded challenges of retinal care delivery during the SARS-CoV-2 pandemic and may sustainably change the way we practice ophthalmology.


Assuntos
COVID-19 , Atenção à Saúde/métodos , Oftalmologia , Telemedicina , Atitude , Humanos , Pandemias , SARS-CoV-2
12.
Eye (Lond) ; 35(5): 1354-1364, 2021 May.
Artigo em Inglês | MEDLINE | ID: mdl-32591734

RESUMO

OBJECTIVES: The objective of this paper is to evaluate visual acuity (VA) outcomes of intravitreal anti-vascular endothelial growth factor (VEGF) in diabetic macular oedema (DMO). METHODS: In this retrospective cohort study, electronic medical records for all patients undergoing intravitreal injections in a tertiary referral centre between March 2013 and October 2018 were analysed. Treatment response in terms of VA outcomes was reported for all eyes over a 4-year observation period. RESULTS: Our cohort includes 2614 DMO eyes of 1964 patients over 48 months. Cox proportional-hazards modelling identified injection number (hazard ratio (HR) = 1.18), male gender (HR = 1.13) and baseline VA (HR = 1.09) as independent predictors to reach a favourable visual outcome of more than 70 Early Treatment Diabetic Retinopathy Study letters. Half of our cohort reached 70 letters 1.9 months after starting anti-VEGF therapy. Of those that reached 70 letters, 50% fell below 70 letters by 14.7 months. CONCLUSION: To date, this is the largest single centre cohort study and over the longest observation period reporting on real-life outcomes of anti-VEGF in DMO. We have made an anonymised version of our data set available on an open-source data repository as a resource for clinical researchers globally.


Assuntos
Diabetes Mellitus , Retinopatia Diabética , Edema Macular , Inibidores da Angiogênese/uso terapêutico , Bevacizumab/uso terapêutico , Estudos de Coortes , Retinopatia Diabética/tratamento farmacológico , Humanos , Injeções Intravítreas , Edema Macular/tratamento farmacológico , Masculino , Ranibizumab/uso terapêutico , Receptores de Fatores de Crescimento do Endotélio Vascular/uso terapêutico , Estudos Retrospectivos , Fator A de Crescimento do Endotélio Vascular/uso terapêutico , Acuidade Visual
13.
JAMA Ophthalmol ; 139(1): 57-67, 2021 01 01.
Artigo em Inglês | MEDLINE | ID: mdl-33211064

RESUMO

Importance: Although multiple imputation models for missing data and the use of mixed-effects models generally provide better outcome estimates than using only observed data or last observation carried forward in clinical trials, such approaches usually cannot be applied to visual outcomes from retrospective analyses of clinical practice settings, also called real-world outcomes. Objective: To explore the potential usefulness of survival analysis techniques for retrospective clinical practice visual outcomes. Design, Setting, and Participants: This retrospective cohort study covered a 12-year observation period at a tertiary eye center. Of 10 744 eyes with neovascular age-related macular degeneration receiving anti-vascular endothelial growth factor (VEGF) therapy between October 28, 2008, and February 1, 2020, 7802 eyes met study criteria (treatment-naive, first-treated eyes starting anti-VEGF therapy). Eyes were excluded from the analysis if they received photodynamic therapy or macular laser, any previous anti-VEGF therapy, treatment with anti-VEGF agents other than ranibizumab or aflibercept, or had an unknown date or visual acuity (VA) value at first injection. Main Outcomes and Measures: Kaplan-Meier estimates and Cox proportional hazards modeling were used to consider VA reaching an Early Treatment Diabetic Retinopathy Study (ETDRS) letter score of 70 (Snellen equivalent, 20/40) or better, duration of VA sustained at or better than 70 (20/40), and VA declining to 35 (20/200) or worse. Results: A total of 7802 patients (mean [SD] age, 78.7 [8.8] years; 4776 women [61.2%]; and 4785 White [61.3%]) were included in the study. The median time to attaining a VA letter score greater than or equal to 70 (20/40) was 2.0 years (95% CI, 1.87-2.32) after the first anti-VEGF injection. Predictive features were baseline VA (hazard ratio [HR], 1.43 per 5 ETDRS letter score or 1 line; 95% CI, 1.40-1.46), baseline age (HR, 0.88 per 5 years; 95% CI, 0.86-0.90), and injection number (HR, 1.12; 95% CI, 1.10-1.15). Of the 4439 of 7802 patients (57%) attaining this outcome, median time sustained at an ETDRS letter score of 70 (20/40) or better was 1.1 years (95% CI, 1.1-1.2). Conclusions and Relevance: In this cohort study, patients with neovascular age-related macular degeneration beginning anti-VEGF therapy were more likely to experience positive visual outcomes within the first 2.0 years after treatment, typically maintaining this outcome for 1.1 years but then deteriorating to poor vision within 8.7 years. These findings demonstrate the potential usefulness of the proposed analyses. This data set, combined with the statistical approach for retrospective analyses, may provide long-term prognostic information for patients newly diagnosed with this condition.


Assuntos
Inibidores da Angiogênese/uso terapêutico , Degeneração Macular/tratamento farmacológico , Neovascularização Patológica , Ranibizumab/uso terapêutico , Receptores de Fatores de Crescimento do Endotélio Vascular/uso terapêutico , Proteínas Recombinantes de Fusão/uso terapêutico , Fator A de Crescimento do Endotélio Vascular/antagonistas & inibidores , Visão Ocular/efeitos dos fármacos , Idoso , Idoso de 80 Anos ou mais , Inibidores da Angiogênese/efeitos adversos , Progressão da Doença , Feminino , Humanos , Injeções Intravítreas , Degeneração Macular/diagnóstico , Degeneração Macular/mortalidade , Degeneração Macular/fisiopatologia , Masculino , Ranibizumab/efeitos adversos , Proteínas Recombinantes de Fusão/efeitos adversos , Recuperação de Função Fisiológica , Estudos Retrospectivos , Fatores de Tempo , Resultado do Tratamento
14.
Ophthalmologe ; 117(10): 973-988, 2020 Oct.
Artigo em Alemão | MEDLINE | ID: mdl-32857270

RESUMO

BACKGROUND: Empirical models have been an integral part of everyday clinical practice in ophthalmology since the introduction of the Sanders-Retzlaff-Kraff (SRK) formula. Recent developments in the field of statistical learning (artificial intelligence, AI) now enable an empirical approach to a wide range of ophthalmological questions with an unprecedented precision. OBJECTIVE: Which criteria must be considered for the evaluation of AI-related studies in ophthalmology? MATERIAL AND METHODS: Exemplary prediction of visual acuity (continuous outcome) and classification of healthy and diseased eyes (discrete outcome) using retrospectively compiled optical coherence tomography data (50 eyes of 50 patients, 50 healthy eyes of 50 subjects). The data were analyzed with nested cross-validation (for learning algorithm selection and hyperparameter optimization). RESULTS: Based on nested cross-validation for training, visual acuity could be predicted in the separate test data-set with a mean absolute error (MAE, 95% confidence interval, CI of 0.142 LogMAR [0.077; 0.207]). Healthy versus diseased eyes could be classified in the test data-set with an agreement of 0.92 (Cohen's kappa). The exemplary incorrect learning algorithm and variable selection resulted in an MAE for visual acuity prediction of 0.229 LogMAR [0.150; 0.309] for the test data-set. The drastic overfitting became obvious on comparison of the MAE with the null model MAE (0.235 LogMAR [0.148; 0.322]). CONCLUSION: Selection of an unsuitable measure of the goodness-of-fit, inadequate validation, or withholding of a null or reference model can obscure the actual goodness-of-fit of AI models. The illustrated pitfalls can help clinicians to identify such shortcomings.


Assuntos
Inteligência Artificial , Oftalmologia , Biometria , Humanos , Estudos Retrospectivos , Acuidade Visual
15.
16.
Br J Ophthalmol ; 104(5): 684-690, 2020 05.
Artigo em Inglês | MEDLINE | ID: mdl-31611234

RESUMO

BACKGROUND/AIMS: Neovascular age-related macular degeneration (nAMD) is frequently bilateral, and previous reports on 'fellow eyes' have assumed sequential treatment after a period of treatment of the first eye only. The aim of our study was to analyse baseline characteristics and visual acuity (VA) outcomes of fellow eye involvement with nAMD, specifically differentiating between sequential and non-sequential (due to macular scarring in the first eye) antivascular endothelial growth factor treatment and timelines for fellow eye involvement. METHODS: Retrospective, electronic medical record database study of the Moorfields AMD database of 6265 patients/120 286 single entries with data extracted between 21 October 2008 and 9 August 2018. The data set for analysis consisted of 1180 sequential, 807 non-sequential and 3410 unilateral eyes. RESULTS: Mean VA (ETDRS letters±SD) of sequentially treated fellow eyes at baseline was significantly higher (63±13), VA gain over 2 years lower (0.37±14) and proportion of eyes with good VA (≥70 letters) higher (46%) than the respective first eyes (baseline VA 54±16, VA gain at 2 years 5.6±15, percentage of eyes with good VA 39%). Non-sequential fellow eyes showed baseline characteristics and VA outcomes similar to first eyes. Fellow eye involvement rate was 32% at 2 years, and median time interval to fellow eye involvement was 71 (IQR: 27-147) weeks. CONCLUSION: This report shows that sequentially treated nAMD fellow eyes have better baseline and final VA than non-sequentially treated eyes after 2 years of treatment. Sequentially treated eyes also had a greater proportion with good VA after 2 years.


Assuntos
Macula Lutea/patologia , Ranibizumab/administração & dosagem , Tomografia de Coerência Óptica/métodos , Acuidade Visual , Degeneração Macular Exsudativa/diagnóstico , Inibidores da Angiogênese/administração & dosagem , Progressão da Doença , Feminino , Angiofluoresceinografia , Seguimentos , Fundo de Olho , Humanos , Injeções Intravítreas , Masculino , Pessoa de Meia-Idade , Prognóstico , Estudos Retrospectivos , Fator A de Crescimento do Endotélio Vascular/antagonistas & inibidores , Degeneração Macular Exsudativa/fisiopatologia
17.
BMJ Open ; 9(6): e027441, 2019 06 21.
Artigo em Inglês | MEDLINE | ID: mdl-31230012

RESUMO

OBJECTIVES: To analyse treatment outcomes and share clinical data from a large, single-centre, well-curated database (8174 eyes/6664 patients with 120 756 single entries) of patients with neovascular age-related macular degeneration (AMD) treated with anti-vascular endothelial growth factor (VEGF). By making our depersonalised raw data openly available, we aim to stimulate further research in AMD, as well as set a precedent for future work in this area. SETTING: Retrospective, comparative, non-randomised electronic medical record (EMR) database cohort study of the UK Moorfields AMD database with data extracted between 2008 and 2018. PARTICIPANTS: Including one eye per patient, 3357 eyes/patients (61% female). Extraction criteria were ≥1 ranibizumab or aflibercept injection, entry of 'AMD' in the diagnosis field of the EMR and a minimum of 1 year of follow-up. Exclusion criteria were unknown date of first injection and treatment outside of routine clinical care at Moorfields before the first recorded injection in the database. MAIN OUTCOME MEASURES: Primary outcome measure was change in VA at 1 and 2 years from baseline as measured in Early Treatment Diabetic Retinopathy Study letters. Secondary outcomes were the number of injections and predictive factors for VA gain. RESULTS: Mean VA gain at 1 year and 2 years were +5.5 (95% CI 5.0 to 6.0) and +4.9 (95% CI 4.2 to 5.6) letters, respectively. Fifty-four per cent of eyes gained ≥5 letters at 2 years, 63% had stable VA (±≤14 letters), 44% of eyes maintained good VA (≥70 letters). Patients received a mean of 7.7 (95% CI 7.6 to 7.8) injections during year 1 and 13.0 (95% CI 12.8 to 13.2) injections over 2 years. Younger age, lower baseline VA and more injections were associated with higher VA gain at 2 years. CONCLUSION: This study benchmarks high quality EMR study results of real life AMD treatment and promotes open science in clinical AMD research by making the underlying data publicly available.


Assuntos
Ranibizumab/administração & dosagem , Receptores de Fatores de Crescimento do Endotélio Vascular/administração & dosagem , Proteínas Recombinantes de Fusão/administração & dosagem , Acuidade Visual/fisiologia , Degeneração Macular Exsudativa/tratamento farmacológico , Idoso , Inibidores da Angiogênese/administração & dosagem , Registros Eletrônicos de Saúde , Feminino , Seguimentos , Humanos , Injeções Intravítreas , Masculino , Estudos Retrospectivos , Fatores de Tempo , Resultado do Tratamento , Fator A de Crescimento do Endotélio Vascular/antagonistas & inibidores , Degeneração Macular Exsudativa/fisiopatologia
18.
Eye (Lond) ; 33(8): 1327-1338, 2019 08.
Artigo em Inglês | MEDLINE | ID: mdl-30971815

RESUMO

OBJECTIVE: To investigate the diagnostic accuracy of optical coherence tomography angiography (OCTA) in detecting vascular characteristics of chorio-retinal disease. METHODS: Evidence acquisition: We searched Web of Science, Scopus, and Medline by the citation of references and complemented these electronic searches by checking the list of references of included and review articles. Screening, selection, assessment, and extraction was performed in parallel by two authors. RESULTS: Evidence synthesis: Systematic review and exploratory meta-analysis. The ten studies that contributed to the meta-analysis enrolled 440 eyes and allowed constructing ten two-by-two tables. The tables reported on detection of choroidal neovascularization (CNV) in eyes suffering from either age-related macular degeneration (4), central serous chorioretinopathy (2), myopia (2), foveomacular vitelliform dystrophy (1), or a mixed cohort suffering from multiple retinal diseases (1). Of the ten studies, six used a cohort and four a case-control design. We found a pooled sensitivity of 0.90 (95% confidence intervals (CIs): 0.82-0.95) and a pooled specificity of 0.97 (95% CI: 0.89-0.99). Corresponding positive and negative likelihood ratios were 32.3 (95% CI: 7.4-141.6) and 0.10 (95% CI: 0.06-0.20), respectively. No pooling was possible for retinal vascular parameters of diabetic retinopathy, polypoidal choroidal vasculopathy, or detection of CNV activity. CONCLUSIONS: The results of highly biased and heterogeneous studies assessing the diagnostic performance of OCTA highlight the need for further analyses of methodologically sound and sufficiently sized clinical evaluations.


Assuntos
Angiofluoresceinografia/métodos , Doenças Retinianas/diagnóstico , Vasos Retinianos/patologia , Tomografia de Coerência Óptica/métodos , Fundo de Olho , Humanos
19.
Lancet Digit Health ; 1(5): e232-e242, 2019 09.
Artigo em Inglês | MEDLINE | ID: mdl-33323271

RESUMO

BACKGROUND: Deep learning has the potential to transform health care; however, substantial expertise is required to train such models. We sought to evaluate the utility of automated deep learning software to develop medical image diagnostic classifiers by health-care professionals with no coding-and no deep learning-expertise. METHODS: We used five publicly available open-source datasets: retinal fundus images (MESSIDOR); optical coherence tomography (OCT) images (Guangzhou Medical University and Shiley Eye Institute, version 3); images of skin lesions (Human Against Machine [HAM] 10000), and both paediatric and adult chest x-ray (CXR) images (Guangzhou Medical University and Shiley Eye Institute, version 3 and the National Institute of Health [NIH] dataset, respectively) to separately feed into a neural architecture search framework, hosted through Google Cloud AutoML, that automatically developed a deep learning architecture to classify common diseases. Sensitivity (recall), specificity, and positive predictive value (precision) were used to evaluate the diagnostic properties of the models. The discriminative performance was assessed using the area under the precision recall curve (AUPRC). In the case of the deep learning model developed on a subset of the HAM10000 dataset, we did external validation using the Edinburgh Dermofit Library dataset. FINDINGS: Diagnostic properties and discriminative performance from internal validations were high in the binary classification tasks (sensitivity 73·3-97·0%; specificity 67-100%; AUPRC 0·87-1·00). In the multiple classification tasks, the diagnostic properties ranged from 38% to 100% for sensitivity and from 67% to 100% for specificity. The discriminative performance in terms of AUPRC ranged from 0·57 to 1·00 in the five automated deep learning models. In an external validation using the Edinburgh Dermofit Library dataset, the automated deep learning model showed an AUPRC of 0·47, with a sensitivity of 49% and a positive predictive value of 52%. INTERPRETATION: All models, except the automated deep learning model trained on the multilabel classification task of the NIH CXR14 dataset, showed comparable discriminative performance and diagnostic properties to state-of-the-art performing deep learning algorithms. The performance in the external validation study was low. The quality of the open-access datasets (including insufficient information about patient flow and demographics) and the absence of measurement for precision, such as confidence intervals, constituted the major limitations of this study. The availability of automated deep learning platforms provide an opportunity for the medical community to enhance their understanding in model development and evaluation. Although the derivation of classification models without requiring a deep understanding of the mathematical, statistical, and programming principles is attractive, comparable performance to expertly designed models is limited to more elementary classification tasks. Furthermore, care should be placed in adhering to ethical principles when using these automated models to avoid discrimination and causing harm. Future studies should compare several application programming interfaces on thoroughly curated datasets. FUNDING: National Institute for Health Research and Moorfields Eye Charity.


Assuntos
Algoritmos , Interpretação Estatística de Dados , Aprendizado Profundo , Software , Adulto , Estudos de Viabilidade , Fundo de Olho , Humanos , Neoplasias Cutâneas/diagnóstico , Tomografia de Coerência Óptica/estatística & dados numéricos
20.
J Cataract Refract Surg ; 44(12): 1426-1430, 2018 Dec.
Artigo em Inglês | MEDLINE | ID: mdl-30274848

RESUMO

PURPOSE: To evaluate whether the presentation of a video within the informed consent consultation affects patient knowledge about refractive excimer laser treatment, satisfaction with the informed consent process, anxiety in respect to the planned surgery, and the consultation duration. SETTING: Tertiary referral center, Lucerne, Switzerland. DESIGN: Single-center, randomized controlled trial. METHODS: Consenting eligible patients were randomly assigned to receive either a conventional face-to-face consultation (conventional group) or a conventional consultation with additional video-assisted information (interventional group). Knowledge and satisfaction with the informed consent process and anxiety regarding surgery were assessed. Differences between groups were tested with Wilcoxon-Mann-Whitney, Chi-square, and Student t tests. RESULTS: The study comprised 113 patients (58 in the conventional group and 55 in the interventional group). There was no difference in terms of knowledge with 22/25 points (interquartile range [IQR], 3) in the conventional group versus 22/25 points (IQR, 2) in the interventional group (P = .957), satisfaction with the informed consent ("very satisfied": 47/58 versus 45/55; P = .915) and anxiety toward surgery with a median 8 (IQR, 4) versus median 9 (IQR, 3; P = .159). In the interventional group, however, the total consultation time was significantly lower than in the conventional group (-4.96 minutes; 95% CI, -9.50 to -0.43; P = .032). CONCLUSION: Compared with a conventional consultation, video-assistance slightly reduced the total consultation time while maintaining patient knowledge, satisfaction with the informed consent process, and anxiety regarding the surgery on equal levels. Video-assistance could increase efficiency of clinical management on a double-digit percentage at an equal running cost compared with a conventional consultation.


Assuntos
Conhecimentos, Atitudes e Prática em Saúde , Consentimento Livre e Esclarecido , Terapia a Laser/métodos , Educação de Pacientes como Assunto/métodos , Satisfação do Paciente , Erros de Refração/terapia , Gravação em Vídeo , Adulto , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Encaminhamento e Consulta , Inquéritos e Questionários , Adulto Jovem
SELEÇÃO DE REFERÊNCIAS
DETALHE DA PESQUISA