RESUMO
Bayesian methods are increasingly used in proof-of-concept studies. An important benefit of these methods is the potential to use informative priors, thereby reducing sample size. This is particularly relevant for treatment arms where there is a substantial amount of historical information such as placebo and active comparators. One issue with using an informative prior is the possibility of a mismatch between the informative prior and the observed data, referred to as prior-data conflict. We focus on two methods for dealing with this: a testing approach and a mixture prior approach. The testing approach assesses prior-data conflict by comparing the observed data to the prior predictive distribution and resorting to a non-informative prior if prior-data conflict is declared. The mixture prior approach uses a prior with a precise and diffuse component. We assess these approaches for the normal case via simulation and show they have some attractive features as compared with the standard one-component informative prior. For example, when the discrepancy between the prior and the data is sufficiently marked, and intuitively, one feels less certain about the results, both the testing and mixture approaches typically yield wider posterior-credible intervals than when there is no discrepancy. In contrast, when there is no discrepancy, the results of these approaches are typically similar to the standard approach. Whilst for any specific study, the operating characteristics of any selected approach should be assessed and agreed at the design stage; we believe these two approaches are each worthy of consideration.
Assuntos
Ensaios Clínicos Fase II como Assunto/estatística & dados numéricos , Modelos Estatísticos , Estatística como Assunto , Teorema de Bayes , Humanos , Estatística como Assunto/normasRESUMO
BACKGROUND: Effective interprofessional teamwork is an essential component for the delivery of high-quality patient care in an increasingly complex medical environment. The objective is to evaluate whether the implementation of care pathways (CPs) improves teamwork in an acute hospital setting. DESIGN AND MEASURES: A posttest-only cluster randomized controlled trial was performed in Belgian acute hospitals. Teams caring for patients hospitalized with a proximal femur fracture and those hospitalized with an exacerbation of chronic obstructive pulmonary disease, were randomized into intervention and control groups. The intervention group implemented a CP. The control group provided usual care. A set of team input, process, and output indicators were used as effect measures. To analyze the results, we performed multilevel statistical analysis. RESULTS: Thirty teams and a total of 581 individual team members participated. The intervention teams scored significantly better in conflict management [ß=0.30 (0.11); 95% confidence interval (CI), 0.08 to 0.53]; team climate for innovation [ß=0.29 (0.10); 95% CI, 0.09 to 0.49]; and level of organized care [ß=5.56 (2.05); 95% CI, 1.35 to 9.76]. They also showed lower risk of burnout as they scored significantly lower in emotional exhaustion [ß=-0.57 (0.21); 95% CI, -1.00 to -0.14] and higher in the level of competence (ß=0.39; 95% CI, 0.15 to 0.64). No significant effect was found on relational coordination. CONCLUSIONS: CPs are effective interventions for improving teamwork, increasing the organizational level of care processes, and decreasing risk of burnout for health care teams in an acute hospital setting. Through this, high-performance teams can be built.
Assuntos
Procedimentos Clínicos/organização & administração , Relações Interprofissionais , Equipe de Assistência ao Paciente/organização & administração , Qualidade da Assistência à Saúde/organização & administração , Adulto , Idoso , Bélgica , Esgotamento Profissional/prevenção & controle , Competência Clínica , Emoções , Meio Ambiente , Feminino , Fraturas do Fêmur/terapia , Administração Hospitalar , Humanos , Masculino , Pessoa de Meia-Idade , Inovação Organizacional , Avaliação de Processos e Resultados em Cuidados de Saúde , Doença Pulmonar Obstrutiva Crônica/terapiaRESUMO
Dental caries is a highly prevalent disease affecting the tooth's hard tissues by acid-forming bacteria. The past and present caries status of a tooth is characterized by a response called caries experience (CE). Several epidemiological studies have explored risk factors for CE. However, the detection of CE is prone to misclassification because some cases are neither clearly carious nor noncarious, and this needs to be incorporated into the epidemiological models for CE data. From a dentist's point of view, it is most appealing to analyze CE on the tooth's surface, implying that the multilevel structure of the data (surface-tooth-mouth) needs to be taken into account. In addition, CE data are spatially referenced, that is, an active lesion on one surface may impact the decay process of the neighboring surfaces, and that might also influence the process of scoring CE. In this paper, we investigate two hypotheses: that is, (i) CE outcomes recorded at surface level are spatially associated; and (ii) the dental examiners exhibit some spatial behavior while scoring CE at surface level, by using a spatially referenced multilevel autologistic model, corrected for misclassification. These hypotheses were tested on the well-known Signal Tandmobiel® study on dental caries, and simulation studies were conducted to assess the effect of misclassification and strength of spatial dependence on the autologistic model parameters. Our results indicate a substantial spatial dependency in the examiners' scoring behavior and also in the prevalence of CE at surface level.
Assuntos
Teorema de Bayes , Cárie Dentária/patologia , Funções Verossimilhança , Modelos Estatísticos , Saúde Bucal , Conglomerados Espaço-Temporais , Bélgica , Criança , Simulação por Computador , Cárie Dentária/epidemiologia , Odontólogos , Feminino , Humanos , Estudos Longitudinais , Masculino , PrevalênciaRESUMO
BACKGROUND: Patient safety can be increased by improving the organization of care. A tool that evaluates the actual organization of care, as perceived by multidisciplinary teams, is the Care Process Self-Evaluation Tool (CPSET). CPSET was developed in 2007 and includes 29 items in five subscales: (a) patient-focused organization, (b) coordination of the care process, (c) collaboration with primary care, (d) communication with patients and family, and (e) follow-up of the care process. The goal of the present study was to further evaluate the psychometric properties of the CPSET at the team and hospital levels and to compile a cutoff score table. METHODS: The psychometric properties of the CPSET were assessed in a multicenter study in Belgium and the Netherlands. In total, 3139 team members from 114 hospitals participated. Psychometric properties were evaluated by using confirmatory factor analysis (CFA), Cronbach's alpha, interclass correlation coefficients (ICCs), Kruskall-Wallis test, and Mann-Whitney test. For the cutoff score table, percentiles were used. Demographic variables were also evaluated. RESULTS: CFA showed a good model fit: a normed fit index of 0.93, a comparative fit index of 0.94, an adjusted goodness-of-fit index of 0.87, and a root mean square error of approximation of 0.06. Cronbach's alpha values were between 0.869 and 0.950. The team-level ICCs varied between 0.127 and 0.232 and were higher than those at the hospital level (0.071-0.151). Male team members scored significantly higher than females on 2 of the 5 subscales and on the overall CPSET. There were also significant differences among age groups. Medical doctors scored significantly higher on 4 of the 5 subscales and on the overall CPSET. Coordinators of care processes scored significantly lower on 2 of the 5 subscales and on the overall CPSET. Cutoff scores for all subscales and the overall CPSET were calculated. CONCLUSIONS: The CPSET is a valid and reliable instrument for health care teams to measure the extent care processes are organized. The cutoff table permits teams to compare how they perceive the organization of their care process relative to other teams.
Assuntos
Atenção à Saúde/organização & administração , Equipe de Assistência ao Paciente , Avaliação de Processos em Cuidados de Saúde , Inquéritos e Questionários/normas , Bélgica , Continuidade da Assistência ao Paciente , Comportamento Cooperativo , Estudos Transversais , Análise Fatorial , Feminino , Humanos , Masculino , Países Baixos , Segurança do Paciente , Assistência Centrada no Paciente , Relações Profissional-Família , Psicometria , Reprodutibilidade dos TestesRESUMO
Kappa-like agreement indexes are often used to assess the agreement among examiners on a categorical scale. They have the particularity of correcting the level of agreement for the effect of chance. In the present paper, we first define two agreement indexes belonging to this family in a hierarchical context. In particular, we consider the cases of a random and fixed set of examiners. Then, we develop a method to evaluate the influence of factors on these indexes. Agreement indexes are directly related to a set of covariates through a hierarchical model. We obtain the posterior distribution of the model parameters in a Bayesian framework. We apply the proposed approach on dental data and compare it with the generalized estimating equations approach.
Assuntos
Teorema de Bayes , Funções Verossimilhança , Cadeias de Markov , Método de Monte Carlo , Reprodutibilidade dos Testes , Criança , Assistência Odontológica para Crianças/métodos , Cárie Dentária/diagnóstico , Feminino , Humanos , Masculino , Variações Dependentes do ObservadorRESUMO
The objective of this study was to verify how valid misclassification measurements obtained from a 'pre-survey' calibration exercise are by comparing them to validation scores obtained in 'field' conditions. Validation data were collected from the 'Smile for Life' project, an oral health intervention study in Flemish children. A calibration exercise was organized under 'pre-survey' conditions (32 age-matched children examined by eight examiners and the benchmark scorer). In addition, using a pre-determined sampling scheme blinded to the examiners, the benchmark scorer re-examined between six and 11 children screened by each of the dentists during the survey. Factors influencing sensitivity and specificity for scoring caries experience (CE) were investigated, including examiner, tooth type, surface type, tooth position (upper/lower jaw, right/left side) and validation setting (pre-survey versus field). In order to account for the clustering effect in the data, a generalized estimating equations approach was applied. Sensitivity scores were influenced not only by the calibration setting (lower sensitivity in field conditions, p < 0.01), but also by examiner, tooth type (lower sensitivity in molar teeth, p < 0.01) and tooth position (lower sensitivity in the lower jaw, p < 0.01). Factors influencing specificity were examiner, tooth type (lower specificity in molar teeth, p < 0.01) and surface type (the occlusal surface with a lower specificity than other surfaces) but not the validation setting. Misclassification measurements for scoring CE are influenced by several factors. In this study, the validation setting influenced sensitivity, with lower scores obtained when measuring data validity in 'field' conditions. Results obtained in a pre-survey calibration setting need to be interpreted with caution and do not (always) reflect the actual performance of examiners during the field work.
Assuntos
Cárie Dentária/diagnóstico , Odontólogos/normas , Programas de Rastreamento/normas , Benchmarking , Calibragem , Estudos de Casos e Controles , Pré-Escolar , Índice CPO , Humanos , Mandíbula , Maxila , Dente Molar/patologia , Variações Dependentes do Observador , Reprodutibilidade dos Testes , Sensibilidade e Especificidade , Coroa do Dente/patologiaRESUMO
Data obtained from calibration exercises are used to assess the level of agreement between examiners (and the benchmark examiner) and/or between repeated examinations by the same examiner in epidemiological surveys or large-scale clinical studies. Agreement can be measured using different techniques: kappa statistic, percentage agreement, dice coefficient, sensitivity and specificity. Each of these methods shows specific characteristics and has its own shortcomings. The aim of this contribution is to critically review techniques for the measurement and analysis of examiner agreement and to illustrate this using data from a recent survey in young children, the Smile for Life project. The above-mentioned agreement measures are influenced (in differing ways and extents) by the unit of analysis (subject, tooth, surface level) and the disease level in the validation sample. These effects are more pronounced for percentage agreement and kappa than for sensitivity and specificity. It is, therefore, important to include information on unit of analysis and disease level (in validation sample) when reporting agreement measures. Also, confidence intervals need to be included since they indicate the reliability of the estimate. When dependency among observations is present [as is the case in caries experience data sets with typical hierarchical structure (surface-tooth-subject)], this will influence the width of the confidence interval and should therefore not be ignored. In this situation, the use of multilevel modelling is necessary. This review clearly shows that there is a need for the development of guidelines for the measurement, interpretation and reporting of examiner reliability in caries experience surveys.
Assuntos
Índice CPO , Estudos de Validação como Assunto , Algoritmos , Benchmarking , Calibragem , Intervalos de Confiança , Cárie Dentária/epidemiologia , Humanos , Reprodutibilidade dos Testes , Sensibilidade e EspecificidadeRESUMO
OBJECTIVES: The aim of this research was to estimate the prevalence and incidence of caries experience (CE) in first permanent molars while dealing with misclassification and missing of data. METHODS: CE was modeled as a Hidden Markov Model in which the response variable is subject to misclassification and missingness. The proposed analysis extends that of García-Zattera et al. (Stat Med 2010;29:3103) by allowing for various patterns of missing data. Findings were illustrated using data from the Signal Tandmobiel study that is a longitudinal oral health intervention study. RESULTS: Differences in the parameter estimates were noted between models that take into account misclassification and missing data and those that do not. Unbiased parameter estimates of prevalence and incidence were obtained without the use of validation data. Models that include subjects with missing data have smaller standard deviations than models that do not. CONCLUSIONS: It is important to account for misclassification to obtain less biased estimates of prevalence and incidence. For a proper estimation of prevalence and incidence in a longitudinal study subject to misclassification, validation data are not needed but when internal they can increase the efficiency in estimating the model. Also, including subjects with missing data increases the efficiency of estimating the parameters.