RESUMO
We evaluated construct validity, responsiveness, and utility of change indicators of the Dutch-Flemish PROMIS adult v1.0 item banks for Depression and Anxiety administered as computerized adaptive test (CAT). Specifically, the CATs were compared to the Brief Symptom Inventory (BSI) using pre- and re-test data of adult patients treated for common mental disorders (N = 400; median pre-to-re-test interval = 215 days). Construct validity was evaluated with Pearson's correlations and Cohen's ds; responsiveness with Pearson's correlations and pre-post effect sizes (ES); utility of change indicators with kappa coefficients and percentages of (dis)agreement. The results showed that the PROMIS CATs measure similar constructs as matching BSI scales. Under the assumption of measuring similar constructs, the CAT and BSI Depression scales were similarly responsive. For the Anxiety scales, we found a higher responsiveness for CAT (ES = 0.64) compared to the BSI (ES = 0.50). Finally, both CATs categorized the change scores of more patients as changed compared to matching BSI scales, indicating that the PROMIS CATs may be more able to detect actual change than the BSI. Based on these findings, the PROMIS CATs may be considered a modest improvement over matching BSI scales as tools for reviewing treatment progress with patients. We discuss several additional differences between the PROMIS CATs and the BSI to help test users choose instruments. These differences include the adopted measurement theory (Item Response Theory vs. Classical Test Theory), the mode of administration (CAT vs. fixed items), and the area of application (universal vs. predominantly clinical). (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Assuntos
Ansiedade , Depressão , Ansiedade/diagnóstico , Transtornos de Ansiedade/diagnóstico , Bases de Dados Factuais , Depressão/diagnóstico , Etnicidade , Humanos , Reprodutibilidade dos TestesRESUMO
OBJECTIVE: PROMIS offers computerized adaptive tests (CAT) of patient-reported outcomes, using a single set of US-based IRT item parameters across populations and language-versions. The use of country-specific item parameters has local appeal, but also disadvantages. We illustrate the effects of choosing US or country-specific item parameters on PROMIS CAT T-scores. STUDY DESIGN AND SETTING: Simulations were performed on response data from Dutch chronic pain patients (n = 1110) who completed the PROMIS Pain Behavior item bank. We compared CAT T-scores obtained with (1) US parameters; (2) Dutch item parameters; (3) US item parameters for DIF-free items and Dutch item parameters (rescaled to the US metric) for DIF items; (4) Dutch item parameters for all items (rescaled to the US metric). RESULTS: Without anchoring to a common metric, CAT T-scores cannot be compared. When scores were rescaled to the US metric, mean differences in CAT T-scores based on US vs. Dutch item parameters were negligible. However, 0.9%-4.3% of the T-score differences were larger than 5 points (0.5 SD). CONCLUSION: The choice of item parameters can be consequential for individual patient scores. We recommend more studies of translated CATs to examine if strategies that allow for country-specific item parameters should be further investigated.
Assuntos
Medidas de Resultados Relatados pelo Paciente , Simulação por Computador , Pesquisa Empírica , Humanos , Países Baixos , Estados UnidosRESUMO
We investigated longitudinal measurement invariance in the Dutch-Flemish PROMIS adult v1.0 item banks for Depression and Anxiety using two clinical samples with mood and anxiety disorders (n = 640 and n = 528, respectively). Factor analysis was used to evaluate whether the item banks were sufficiently unidimensional at two test-occasions and whether the measured constructs remained the same over time. The results indicated that the item banks were sufficiently unidimensional, but the thresholds and residual variances of the constructs changed over time. However, using tentative rules of thumb, these invariance violations did not substantially affect the endorsement of a specific response category of a specific item at a specific test-occasion. Furthermore, the impact on the mean latent change scores of the item banks remained below the proposed cutoff value for substantial bias. These findings suggest that the invariance violations lacked practical significance for test-users, meaning that the item banks provide sufficiently invariant latent factor scores for use in clinical practice.
Assuntos
Transtornos de Ansiedade , Depressão , Adulto , Ansiedade/diagnóstico , Transtornos de Ansiedade/diagnóstico , Depressão/diagnóstico , Humanos , Psicometria , Qualidade de Vida , Reprodutibilidade dos Testes , Inquéritos e QuestionáriosRESUMO
In psychological assessment of children, it is pivotal to establish from what age on self-reports can complement or replace informant reports. We introduce a psychometric approach to estimate the minimum age for a child to produce self-report data that is of similar quality as informant data. The approach makes use of statistical validity indicators such as person-fit and long-string indices, and can be readily applied to data commonly collected in psychometric studies of child measures. We evaluate and illustrate the approach, using self-report and informant-report data of the PedsQL, a pediatric health-related quality of life measure, from 651 child-mother pairs. To evaluate the approach, we tested various hypotheses about the validity of the self-report data, using the Gnp person-fit index as the validity indicator and the mother informant-data as a benchmark for validity. Results showed that Gnp discriminated between self-reports of younger and older children, between self-reports of children that completed the PedsQL alone or with a parent, and between self-reports and informant reports. We conclude that the validity-index approach has good potential for future applications. Future research should further evaluate the approach for different types of questionnaires (e.g., personality inventories) and using different validity indices (e.g., response-bias indices).
Assuntos
Pais , Qualidade de Vida , Adolescente , Criança , Humanos , Psicometria , Reprodutibilidade dos Testes , Autorrelato , Inquéritos e QuestionáriosRESUMO
OBJECTIVE: Pain interference and pain behavior are highly relevant outcomes in patients with rheumatoid arthritis (RA). The Patient-Reported Outcomes Measurement Information System (PROMIS) is a universally applicable set of item banks measuring patient-reported health, and if applied as computerized adaptive tests (CATs), more efficiently and precisely than current instruments. The objective was to study the psychometric properties of the Dutch-Flemish PROMIS pain interference (PROMIS-PI) and the PROMIS pain behavior (PROMIS-PB) item banks in patients with RA. METHODS: A total of 2,029 patients with RA completed the full PROMIS-PI (version 1.1, 40 items), and 1,554 patients completed the full PROMIS-PB (version 1.1, 39 items). The following psychometric properties were studied: unidimensionality, local dependence, monotonicity and graded response model (GRM) fit, cross-cultural validity (differential item functioning [DIF] for language [Dutch versus Flemish]), other forms of measurement invariance, construct validity, reliability, and floor and ceiling effects. RESULTS: The PROMIS-PI and PROMIS-PB banks were sufficiently unidimensional (Omega-hierarchical [Omega-H] 0.99, 0.95, and explained common variance 0.95, 0.78, respectively), had negligible local dependence (0.3-1.4% of item pairs), good monotonicity (H 0.75, 0.46), and a good GRM model fit (no misfitting items). Furthermore, both item banks showed good cross-cultural validity (no DIF for language), measurement invariance (no DIF for age, sex, administration mode, and disease activity), good construct validity (all hypotheses met), high reliability (>0.90 in the range of patients with RA), and an absence of floor and ceiling effects (0% minimum or maximum score, respectively). CONCLUSION: Both PROMIS-PI and PROMIS-PB banks showed good psychometric properties in patients with RA and can be used as CATs in research and clinical practice.
Assuntos
Artralgia/diagnóstico , Artrite Reumatoide/psicologia , Medição da Dor/normas , Medidas de Resultados Relatados pelo Paciente , Inquéritos e Questionários/normas , Adulto , Idoso , Idoso de 80 Anos ou mais , Artralgia/etnologia , Artralgia/etiologia , Artrite Reumatoide/complicações , Artrite Reumatoide/etnologia , Bélgica , Comparação Transcultural , Feminino , Humanos , Idioma , Masculino , Pessoa de Meia-Idade , Países Baixos , Medição da Dor/psicologia , Percepção da Dor , Psicometria , Reprodutibilidade dos Testes , Traduções , Adulto JovemRESUMO
Kallikrein-related peptidase 6 (KLK6) is a secreted serine protease that belongs to the family of tissue kallikreins. Aberrant expression of KLK6 has been found in different cancers and neurodegenerative diseases, and KLK6 is currently studied as a potential target in these pathologies. We report a novel series of KLK6 inhibitors discovered in a high-throughput screen within the European Lead Factory program. Structure-guided design based on docking studies enabled rapid progression of a hit cluster to inhibitors with improved potency, selectivity and pharmacokinetic properties. In particular, inhibitors 32 ((5R)-3-(4-carbamimidoylphenyl)-N-((S)-1-(naphthalen-1-yl)propyl)-2-oxooxazolidine-5-carboxamide) and 34 ((5R)-3-(6-carbamimidoylpyridin-3-yl)-N-((1S)-1-(naphthalen-1-yl)propyl)-2-oxooxazolidine-5-carboxamide) have single-digit nanomolar potency against KLK6, with over 25-fold and 100-fold selectivities against the closely related enzyme trypsin, respectively. The most potent compound, 32, effectively reduces KLK6-dependent invasion of HCT116 cells. The high potency in combination with good solubility and low clearance of 32 make it a good chemical probe for KLK6 target validation inâ vitro and potentially inâ vivo.
Assuntos
Calicreínas/antagonistas & inibidores , Fármacos Neuroprotetores/síntese química , Oxazolidinonas/química , Sítios de Ligação , Movimento Celular/efeitos dos fármacos , Sistema Enzimático do Citocromo P-450/metabolismo , Células HCT116 , Meia-Vida , Humanos , Concentração Inibidora 50 , Calicreínas/metabolismo , Simulação de Acoplamento Molecular , Fármacos Neuroprotetores/metabolismo , Fármacos Neuroprotetores/farmacologia , Oxazolidinonas/metabolismo , Oxazolidinonas/farmacologia , Estereoisomerismo , Relação Estrutura-AtividadeRESUMO
BACKGROUND: In the clinical field, the use of questionnaires is ubiquitous, and many different methods for constructing them are available. The reason for using a specific method is usually lacking, and a generally accepted classification of methods is not yet available. To guide test developers and users, this article presents a taxonomy for methods of questionnaire design which links the methods to the goal of a test. METHODS: The taxonomy assumes that construction methods are directed towards psychometric aspects. Four stages of test construction are distinguished to describe methods: concept analysis, item production, scale construction, and evaluation; the scale construction stage is used for identifying methods. It distinguishes six different methods: the rational method utilizes expert judgments to ensure face validity. The prototypical method uses prototypicality judgments to ensure process validity. In the internal method, item sets are selected that optimize homogeneity. The external method optimizes criterion validity by selecting items that best predict an external criterion. Under the construct method theoretical considerations are used to optimize construct validity. The facet method is aimed at optimizing content validity through a complete representation of the concept domain. CONCLUSION: The taxonomy is comprehensive, constitutes a useful tool for describing procedures used in questionnaire design, and allows for setting up a test construction plan in which the priorities among psychometric aspects are made explicit.
Assuntos
Psicometria/métodos , Inquéritos e Questionários , Feminino , Objetivos , Humanos , Qualidade de Vida , Reprodutibilidade dos TestesRESUMO
We used the Dutch-Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample (N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch-Flemish version of the PROMIS Anxiety item bank.
Assuntos
Ansiedade/diagnóstico , Escalas de Graduação Psiquiátrica/normas , Psicometria/métodos , Adolescente , Adulto , Idoso , Simulação por Computador , Computadores , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Países Baixos , Reprodutibilidade dos Testes , Adulto JovemRESUMO
PURPOSE: Multidimensional item response theory and computerized adaptive testing (CAT) are increasingly used in mental health, quality of life (QoL), and patient-reported outcome measurement. Although multidimensional assessment techniques hold promises, they are more challenging in their application than unidimensional ones. The authors comment on minimal standards when developing multidimensional CATs. METHODS: Prompted by pioneering papers published in QLR, the authors reflect on existing guidance and discussions from different psychometric communities, including guidelines developed for unidimensional CATs in the PROMIS project. RESULTS: The commentary focuses on two key topics: (1) the design, evaluation, and calibration of multidimensional item banks and (2) how to study the efficiency and precision of a multidimensional item bank. The authors suggest that the development of a carefully designed and calibrated item bank encompasses a construction phase and a psychometric phase. With respect to efficiency and precision, item banks should be large enough to provide adequate precision over the full range of the latent constructs. Therefore CAT performance should be studied as a function of the latent constructs and with reference to relevant benchmarks. Solutions are also suggested for simulation studies using real data, which often result in too optimistic evaluations of an item bank's efficiency and precision. DISCUSSION: Multidimensional CAT applications are promising but complex statistical assessment tools which necessitate detailed theoretical frameworks and methodological scrutiny when testing their appropriateness for practical applications. The authors advise researchers to evaluate item banks with a broad set of methods, describe their choices in detail, and substantiate their approach for validation.
Assuntos
Computadores/estatística & dados numéricos , Medidas de Resultados Relatados pelo Paciente , Psicometria/métodos , Qualidade de Vida/psicologia , Feminino , Humanos , Masculino , Inquéritos e QuestionáriosRESUMO
BACKGROUND: Two important goals when using questionnaires are (a) measurement: the questionnaire is constructed to assign numerical values that accurately represent the test taker's attribute, and (b) prediction: the questionnaire is constructed to give an accurate forecast of an external criterion. Construction methods aimed at measurement prescribe that items should be reliable. In practice, this leads to questionnaires with high inter-item correlations. By contrast, construction methods aimed at prediction typically prescribe that items have a high correlation with the criterion and low inter-item correlations. The latter approach has often been said to produce a paradox concerning the relation between reliability and validity [1-3], because it is often assumed that good measurement is a prerequisite of good prediction. OBJECTIVE: To answer four questions: (1) Why are measurement-based methods suboptimal for questionnaires that are used for prediction? (2) How should one construct a questionnaire that is used for prediction? (3) Do questionnaire-construction methods that optimize measurement and prediction lead to the selection of different items in the questionnaire? (4) Is it possible to construct a questionnaire that can be used for both measurement and prediction? ILLUSTRATIVE EXAMPLE: An empirical data set consisting of scores of 242 respondents on questionnaire items measuring mental health is used to select items by means of two methods: a method that optimizes the predictive value of the scale (i.e., forecast a clinical diagnosis), and a method that optimizes the reliability of the scale. We show that for the two scales different sets of items are selected and that a scale constructed to meet the one goal does not show optimal performance with reference to the other goal. DISCUSSION: The answers are as follows: (1) Because measurement-based methods tend to maximize inter-item correlations by which predictive validity reduces. (2) Through selecting items that correlate highly with the criterion and lowly with the remaining items. (3) Yes, these methods may lead to different item selections. (4) For a single questionnaire: Yes, but it is problematic because reliability cannot be estimated accurately. For a test battery: Yes, but it is very costly. Implications for the construction of patient-reported outcome questionnaires are discussed.
Assuntos
Medidas de Resultados Relatados pelo Paciente , Inquéritos e Questionários , Feminino , Humanos , Masculino , Psicometria , Qualidade de Vida , Reprodutibilidade dos TestesRESUMO
The countdown method is a well-known approach to reducing the average length of screening instruments that are presented by computer. In the countdown method, testing is terminated once the result of the screener ("positive" or "negative") has been unambiguously determined from prior answers. Previous research has examined whether presenting dichotomously scored items in order from "least to most frequently endorsed" or "most to least frequently endorsed" is more efficient when the countdown method is used. The current study describes the Mean Score procedure, an extension of the above item ordering procedures to polytomously scored items, and evaluates its efficiency relative to the distribution of other possible item orderings in 2 real-data simulations. Both simulations involve item responses to the Posttraumatic Stress Disorder (PTSD) Checklist for DSM-5 (PCL-5). In the first simulation, items were scored polytomously, and a single cutoff point was used to determine the screening result. In the second simulation, items were converted to dichotomous scores, as well as categorized into 4 clusters; a positive result for the entire assessment was obtained if and only if a positive result was obtained for each cluster. The latter simulation also investigated the effect of reordering the clusters themselves on the efficiency of the countdown method. Results indicated that the Mean Score procedure does not necessarily produce the optimal ordering, but tends to assemble an efficient item ordering relative to the distribution of possible orderings. In the second simulation, reordering the clusters themselves affected efficiency. Future research directions are suggested. (PsycINFO Database Record
Assuntos
Lista de Checagem/métodos , Transtornos de Estresse Pós-Traumáticos/diagnóstico , Interface Usuário-Computador , Adulto , Idoso , Computadores , Manual Diagnóstico e Estatístico de Transtornos Mentais , Feminino , Humanos , Masculino , Programas de Rastreamento , Pessoa de Meia-Idade , Inquéritos e QuestionáriosRESUMO
We developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample ( N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.
Assuntos
Depressão/diagnóstico , Diagnóstico por Computador/métodos , Adulto , Idoso , Idoso de 80 Anos ou mais , Transtornos de Ansiedade/diagnóstico , Competência Cultural , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Transtornos do Humor/diagnóstico , Países Baixos , Psicometria , Fatores Socioeconômicos , Tradução , Adulto JovemRESUMO
BACKGROUND: The Screener and Opioid Assessment for Patients with Pain-Revised (SOAPP-R) is a 24-item assessment designed to assist in the prediction of aberrant drug-related behavior (ADB) among patients with chronic pain. Recent work has created shorter versions of the SOAPP-R, including a static 12-item short form and two computer-based methods (curtailment and stochastic curtailment) that monitor assessments in progress. The purpose of this study was to cross-validate these shorter versions in two new populations. METHODS: This retrospective study used data from patients recruited from a hospital-based pain center (n=84) and pain patients followed and treated at primary care centers (n=110). Subjects had been administered the SOAPP-R and assessed for ADB. In real-data simulation, the sensitivity, specificity, and area under the curve (AUC) of each form were calculated, as was the mean test length using curtailment and stochastic curtailment. RESULTS: Curtailment reduced the number of items administered by 30% to 34% while maintaining sensitivity and specificity identical to those of the full-length SOAPP-R. Stochastic curtailment reduced the number of items administered by 45% to 63% while maintaining sensitivity and specificity within 0.03 of those of the full-length SOAPP-R. The AUC of the 12-item form was equal to that of the 24-item form in both populations. CONCLUSIONS: Curtailment, stochastic curtailment, and the 12-item short form have potential to enhance the efficiency of the SOAPP-R.
Assuntos
Analgésicos Opioides/uso terapêutico , Dor Crônica/tratamento farmacológico , Medição da Dor/métodos , Analgésicos Opioides/administração & dosagem , Humanos , Clínicas de Dor , Projetos de Pesquisa , Estudos Retrospectivos , Sensibilidade e Especificidade , Detecção do Abuso de SubstânciasRESUMO
OBJECTIVE: The objective of this study was to assess the psychometric properties of the Dutch-Flemish Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank in Dutch patients with chronic pain. STUDY DESIGN AND SETTING: A bank of 121 items was administered to 1,247 Dutch patients with chronic pain. Unidimensionality was assessed by fitting a one-factor confirmatory factor analysis and evaluating resulting fit statistics. Items were calibrated with the graded response model and its fit was evaluated. Cross-cultural validity was assessed by testing items for differential item functioning (DIF) based on language (Dutch vs. English). Construct validity was evaluated by calculation correlations between scores on the Dutch-Flemish PROMIS Physical Function measure and scores on generic and disease-specific measures. RESULTS: Results supported the Dutch-Flemish PROMIS Physical Function item bank's unidimensionality (Comparative Fit Index = 0.976, Tucker Lewis Index = 0.976) and model fit. Item thresholds targeted a wide range of physical function construct (threshold-parameters range: -4.2 to 5.6). Cross-cultural validity was good as four items only showed DIF for language and their impact on item scores was minimal. Physical Function scores were strongly associated with scores on all other measures (all correlations ≤ -0.60 as expected). CONCLUSION: The Dutch-Flemish PROMIS Physical Function item bank exhibited good psychometric properties. Development of a computer adaptive test based on the large bank is warranted.
Assuntos
Atividades Cotidianas , Dor Crônica/fisiopatologia , Comparação Transcultural , Avaliação de Resultados da Assistência ao Paciente , Inquéritos e Questionários/normas , Adulto , Idoso , Idoso de 80 Anos ou mais , Bélgica , Exercício Físico , Análise Fatorial , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Países Baixos , Psicometria , Reprodutibilidade dos Testes , Adulto JovemRESUMO
OBJECTIVE: To investigate the potential of customized computer-based testing procedures to reduce the mean test length of the Posttraumatic Stress Checklist for DSM-5 (PCL-5). METHOD: A retrospective analysis was conducted using responses from 942 adults who had completed the full-length (20-item) PCL-5 in the aftermath of Hurricane Sandy. The abilities of 2 testing procedures, curtailment and stochastic curtailment, to lessen the instrument's mean test length while maintaining the same result as the full-length PCL-5 ("positive" or "negative") were evaluated in a post hoc simulation. Curtailment and stochastic curtailment track a respondent's answers as she takes the instrument and stop the test if future items are unable or unlikely to change the result. The performance of each procedure was recorded under 2 scoring methods: a total-score-based method and a cluster-based method. Each procedure's sensitivity, specificity, and overall agreement with the full-length PCL-5 were computed. RESULTS: Curtailment reduced the mean test length by 40% under the total-score-based method, and by more than 70% under the cluster-based method, while exhibiting 100% sensitivity, specificity, and overall agreement with the full-length PCL-5. Stochastic curtailment reduced the mean test length by up to 88% under the total-score-based method, and up to 84% under the cluster-based method, while always exhibiting at least 92% sensitivity and 99.8% overall agreement, as well as 100% specificity, for the full-length PCL-5. CONCLUSIONS: Curtailment and stochastic curtailment have potential to enhance the efficiency of the PCL-5 when this assessment is administered by computer. The 2 procedures should be evaluated in future prospective studies. (PsycINFO Database Record
Assuntos
Lista de Checagem , Transtornos de Estresse Pós-Traumáticos/diagnóstico , Adulto , Idoso , Diagnóstico por Computador , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Psicometria , Estudos Retrospectivos , Sensibilidade e EspecificidadeRESUMO
BACKGROUND: The Screener and Opioid Assessment for Patients with Pain-Revised (SOAPP-R) is a 24-item questionnaire designed to assess risk of aberrant medication-related behaviors in chronic pain patients. The introduction of short forms of the SOAPP-R may save time and increase utilization by practitioners. OBJECTIVE: To develop and evaluate candidate SOAPP-R short forms. DESIGN: Retrospective study. SETTING: Pain centers. SUBJECTS: Four hundred and twenty-eight patients with chronic noncancer pain. METHODS: Subjects had previously been administered the full-length version of the SOAPP-R and been categorized as positive or negative for aberrant medication-related behaviors via the Aberrant Drug Behavior Index (ADBI). Short forms of the SOAPP-R were developed using lasso logistic regression. Sensitivity, specificity, and area under the curve (AUC) of all forms were calculated with respect to the ADBI using the complete data set, training-test analysis, and 10-fold cross-validation. The coefficient alpha of each form was also calculated. An external set of 12 pain practitioners reviewed the forms for content. RESULTS: In the complete data set analysis, a form of 12 items exhibited sensitivity, specificity, and AUC greater than or equal to those of the full-length SOAPP-R (which were 0.74, 0.67, and 0.76, respectively). The short form had a coefficient alpha of 0.76. In the training-test analysis and 10-fold cross-validation, it exhibited an AUC value within 0.01 of that of the full-length SOAPP-R. The majority of external practitioners reported a preference for this short form. CONCLUSIONS: The 12-item version of the SOAPP-R has potential as a short risk screener and should be tested prospectively.
Assuntos
Comportamento Aditivo/diagnóstico , Dor Crônica/diagnóstico , Transtornos Relacionados ao Uso de Opioides/diagnóstico , Medição da Dor/normas , Inquéritos e Questionários/normas , Adulto , Analgésicos Opioides/efeitos adversos , Comportamento Aditivo/epidemiologia , Comportamento Aditivo/psicologia , Dor Crônica/epidemiologia , Dor Crônica/psicologia , Estudos de Coortes , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Transtornos Relacionados ao Uso de Opioides/epidemiologia , Transtornos Relacionados ao Uso de Opioides/psicologia , Medição da Dor/métodos , Reprodutibilidade dos Testes , Estudos Retrospectivos , Detecção do Abuso de Substâncias/psicologia , Detecção do Abuso de Substâncias/normasRESUMO
BACKGROUND: Respondents' scores to the Screener and Opioid Assessment for Patients with Pain - revised (SOAPP-R) have been shown to be predictive of aberrant drug-related behavior (ADB). However, research is lacking on whether an individual's completion time (the amount of time that he/she takes to finish the screener) has utility in predicting ADB, despite the fact that response speed has been useful in predicting behavior in other fields. The purpose of this study was to evaluate the degree to which SOAPP-R completion time is predictive of ADB. MATERIALS AND METHODS: This retrospective study analyzed completion-time data from 82 adult emergency department patients who completed the SOAPP-R on a tablet computer. The utility of SOAPP-R completion times in predicting ADB was assessed via logistic regression and the area under the curve (AUC) statistic. An external measure of ADB using Prescription Drug Monitoring Program data defined ADB to have occurred in individuals with at least four opioid prescriptions and at least four prescribers in 12 months. RESULTS: Although there was a slight trend for individuals with greater completion times to have greater odds of ADB (odds ratio 1.004 in simple logistic regression), the association between SOAPP-R completion time and ADB was not statistically significant in either simple logistic regression (P=0.307) or multiple logistic regression adjusting for SOAPP-R score (P=0.419). AUC values for the prediction of ADB using completion time alone, SOAPP-R score alone, and both completion time and SOAPP-R score were 0.63, 0.64, and 0.65, respectively. CONCLUSION: There was no significant evidence that SOAPP-R completion times were predictive of ADB among emergency department patients. However, the AUC value for completion times was only slightly less than that for SOAPP-R total scores.
RESUMO
BACKGROUND: The Four-Dimensional Symptom Questionnaire (4DSQ) is a self-report questionnaire measuring distress, depression, anxiety and somatization with separate scales. The 4DSQ has extensively been validated in clinical samples, especially from primary care settings. Information about measurement properties and normative data in the general population was lacking. In a Dutch general population sample we examined the 4DSQ scales' structure, the scales' reliability and measurement invariance with respect to gender, age and education, the scales' score distributions across demographic categories, and normative data. METHODS: 4DSQ data were collected in a representative Dutch Internet panel. Confirmatory factor analysis was used to examine the scales' structure. Reliability was examined by Cronbach's alpha, and coefficients omega-total and omega-hierarchical. Differential item functioning (DIF) analysis was used to evaluate measurement invariance across gender, age and education. RESULTS: The total response rate was 82.4 % (n = 5273/6399). The depression scale proved to be unidimensional. The other scales were best represented as bifactor models consisting of a large general factor and one or more smaller specific factors. The general factors accounted for more than 95 % of the reliable variance of the scales. Reliability was high (≥0.85) by all estimates. The distress-, depression- and anxiety scales were invariant across gender, age and education. The somatization scale demonstrated some lack of measurement invariance as a result of decreased thresholds for some of the items in young people (16-24 years) and increased thresholds in elderly people (65+ years). The somatization scale was invariant regarding gender and education. The 4DSQ scores varied significantly across demographic categories, but the explained variance was small (<6 %). Normative data were generated for gender and age categories. Approximately 17 % of the participants scored above average on de distress scale, whereas 12 % scored above average on de somatization scale. Percentages of people scoring high enough on depression or anxiety as to suspect the presence of depressive or anxiety disorder were 4.1 and 2.5 respectively. CONCLUSIONS: Evidence supports reliability and measurement invariance of the 4DSQ in the general Dutch population. The normative data provided in this study can be used to compare a subject's 4DSQ scores with a general population reference group.
Assuntos
Ansiedade/diagnóstico , Depressão/diagnóstico , Sintomas Inexplicáveis , Qualidade de Vida , Estresse Psicológico/diagnóstico , Adolescente , Adulto , Idoso , Transtornos de Ansiedade/diagnóstico , Estudos Transversais , Transtorno Depressivo/diagnóstico , Análise Fatorial , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Países Baixos , Escalas de Graduação Psiquiátrica , Psicometria , Valores de Referência , Reprodutibilidade dos Testes , Inquéritos e Questionários , Adulto JovemRESUMO
PURPOSE: We reevaluated the psychometric properties of the Amsterdam Inventory for Auditory Disability and Handicap (AIADH; Kramer, Kapteyn, Festen, & Tobi, 1995) using item response theory. Item response theory describes item functioning along an ability continuum. METHOD: Cross-sectional data from 2,352 adults with and without hearing impairment, ages 18-70 years, were analyzed. They completed the AIADH in the web-based prospective cohort study "Netherlands Longitudinal Study on Hearing." A graded response model was fitted to the AIADH data. Category response curves, item information curves, and the standard error as a function of self-reported hearing ability were plotted. RESULTS: The graded response model showed a good fit. Item information curves were most reliable for adults who reported having hearing disability and less reliable for adults with normal hearing. The standard error plot showed that self-reported hearing ability is most reliably measured for adults reporting mild up to moderate hearing disability. CONCLUSIONS: This is one of the few item response theory studies on audiological self-reports. All AIADH items could be hierarchically placed on the self-reported hearing ability continuum, meaning they measure the same construct. This provides a promising basis for developing a clinically useful computerized adaptive test, where item selection adapts to the hearing ability of individuals, resulting in efficient assessment of hearing disability.