Correlates of the Selection Validation Survey with Police Officer Field Performance.

In the present study, we examined performance rating correlates of the Selection Validation Survey (SVS), an informant rating form used to describe the characteristics of newly hired public safety personnel following their initial training period. We correlated SVS ratings for n = 174 police officers with aggregate scores derived from daily performance observation ratings provided by their field training officers (i.e., senior law enforcement officers assigned to train, observe, and evaluate police recruits during a formal 16-week training period). Results generally indicated moderate to strong associations between conceptually similar SVS ratings and field training officer scores, providing evidence that the SVS variables validly summarize performance-relevant data accrued during the field training period. For example, a single SVS item asking the rater to characterize the officer's overall field performance correlated highly in the expected direction (Spearman's rho = -.69) with a composite of daily ratings describing the officer's observed field performance and problem-solving skills. Taken together, these findings indicate that the SVS meaningfully and efficiently captures a range of important information regarding the performance and professional skills of new police officers, providing a useful validation criterion for predictors of police officer performance.

Comparability of MMPI-3 scores from remote and in-person administrations and the impact of the COVID-19 pandemic on MMPI-3 scores.

The COVID-19 pandemic onset necessitated remote administration of psychological instruments, including the Minnesota Multiphasic Personality Inventory-3 (MMPI-3). Although previous evidence has demonstrated that MMPI scale scores are robust across administration modalities, the specific effects of remote administration on the psychometric properties of MMPI-3 scale scores must be investigated. Distinguishing psychometric differences due to administration modality from substantive changes in psychological symptoms due to the COVID-19 pandemic is also important. Thus, goals of the present study include evaluating the psychometric comparability of MMPI-3 scores derived from in-person and remote administration modalities and examining substantive scale scores changes associated with the COVID-19 pandemic. Using a large sample of college students (n = 2,503), rates of protocol invalidity, mean scale scores, reliability, and criterion validity were compared across participants completing the MMPI-3 in-person (both prior to and after the onset of COVID-19) and via remote administration. Results demonstrate comparably low rates of protocol invalidity, negligible differences in reliability, and similar patterns of criterion validity for MMPI-3 scale scores across administration modalities. Results also indicate that mean MMPI-3 scale scores pre- and post-COVID-19 onset substantially differ on select scales, but that scores on remote and in-person protocols administered post-COVID-19 have negligible differences. Remote MMPI-3 scale scores also demonstrated expected patterns of correlations with external criteria, supporting the validity of remote scores. Overall, the present study demonstrates that MMPI-3 protocols administered remotely and in-person are extremely psychometrically similar, although scores have generally increased post-COVID-19 onset for reasons independent of administration modality. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Meaning and Clinical Implications of Low MMPI-3 Self-Importance Scores.

The Minnesota Multiphasic Personality Inventory-3 (MMPI-3) includes two self-concept-oriented scales: Self-Doubt (SFD), a measure of low self-esteem, and Self-Importance (SFI), a measure of beliefs that one has special attributes and abilities. Past research has demonstrated that SFD and SFI measure related but distinct constructs. The present study focused on explicating the meaning and clinical implications of low SFI scores. Using three clinical samples (private practice and community mental health and private practice neuropsychology clinics), we investigated whether the presence of interpretable low SFI scores (< 39 T) in the context of interpretable SFD elevations (≥ 65 T) is associated with distinctive MMPI-3 findings, and whether low SFI scores add clinically meaningful information in predicting relevant extra-test criteria. Consistent meaningful findings were obtained with respect to implications of low SFI scores for assessment of depression- and social engagement-related constructs. Additionally, the full range of SFI scores was meaningfully and negatively correlated with depressive disorder diagnoses and suicidal ideation but yielded very small correlations with suicide attempt and nonmeaningful correlations with diagnoses of Social Anxiety or Avoidant Personality Disorder. Hierarchical logistic regression analyses showed that SFI scores could meaningfully increment other related MMPI-3 scales in predicting diagnosed depressive disorders, albeit with small effect sizes.

Evidence for the comparability of local and remote administrations of the MMPI-2-RF in police candidate evaluations.

In this study, we explore the effects of in-person versus remote administration and in-person versus remote proctoring on scores on the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF) in the context of police candidate preemployment evaluations. To this end, we compare data gathered from candidates who completed the test under standard, in-person conditions with data from candidates who completed the test remotely with the Q-global Remote On-Screen Assessment (ROSA) system, using either in-person or remote proctoring. We find that the standard group (n = 3,311), remote administration/in-person proctoring group (ROSA-IPP; n = 108), and remote administration/remote proctoring group (ROSA-RP; n = 90) all produce very similar distributions of scores, with group differences in means and standard deviations no greater than two T-score points per scale. Examination of the correlations between MMPI-2-RF externalizing scale scores and a set of relevant extra-test criteria for the ROSA-IPP and ROSA-RP groups reveals little difference between groups and suggests patterns of convergent and discriminant validity similar to those observed in studies of the MMPI-2-RF under standard administration conditions. Taken together, these findings provide evidence that the MMPI-2-RF's psychometric properties in police candidate preemployment evaluations are equivalent regardless of whether the test is administered in-person or remotely and whether proctoring is conducted in-person or remotely. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Examining the Psychometric Equivalency of MMPI-3 Scale Scores Derived From the MMPI-3 and the MMPI-2-RF-EX.

The current study evaluated the comparability of Minnesota Multiphasic Personality Inventory-3 (MMPI-3) scale scores derived from the 335-item MMPI-3 to MMPI-3 scale scores derived from the 433-item MMPI-2 restructured form-expanded version (MMPI-2-RF-EX), an enhanced version of the MMPI-2-RF that was used to develop and validate the MMPI-3. To that end, we examined data from 192 college undergraduates who completed both the MMPI-3 and MMPI-2-RF-EX 1 week apart using a counterbalanced design. Across versions, mean T-scores and standard deviations, estimates of internal consistency, and standard error of measurement values, were highly similar, indicating no clinically meaningful differences across versions. We also compared between-version test-retest comparability values with within-version values calculated using a sample of undergraduates (N = 318) who completed the MMPI-2-RF-EX twice over the same time interval, finding only marginal differences across the two samples. Finally, we computed column-vector correlations between MMPI-3 scores from both versions and several criterion measures, where results reflected no effect of test version on external validity. Overall, we determined that scale scores derived from either booklet are psychometrically interchangeable, indicating that MMPI-3 scale scores obtained from an administration of the MMPI-2-RF-EX can be applied when using the 335-item MMPI-3.

Development and Initial Validation of Differential Diagnostic Indices for the MMPI-2-RF.

In this article, I discuss construction of a set of weighted indices for the Minnesota Multiphasic Personality Inventory-2 Restructured Form (MMPI-2-RF) designed to provide direct guidance in three specific differential diagnostic problems. I created a calibration data set using a combined sample of mental health patients (n = 2,043). Using the MMPI-2-RF's Substantive Scales as a pool of potential predictors, I applied the lasso, a penalized regression technique, to derive three logistic regression equations differentiating three major diagnostic groups (schizophrenia, bipolar disorder, and major depressive disorder) from one another. Then, I extracted empirically derived beta weights from these equations and used them to create composite differential diagnostic indices, which I scored in a separate holdout validation data set (n = 873). The differential diagnostic indices performed well in the validation data set (schizophrenia vs. bipolar area under the curve [AUC] = .76; schizophrenia vs. major depression AUC = .90; bipolar vs. major depression AUC = .75). Moreover, they substantially outperformed any single existing MMPI-2-RF scale in the same differential diagnostic tasks. In addition to discussing the development and initial validation of these indices, I present methods for deriving clinically referenced standard scores and diagnostic classification probabilities for obtained raw index scores.

Analysis of the fight-ending chokes in the history of the Ultimate Fighting Championship™ mixed martial arts promotion.

OBJECTIVE: Knowledge of sportive chokes is vital to the practice of Sports Medicine when providing care at mixed martial arts and submission grappling events. This is a descriptive analysis of fight-ending chokes to help provide data on the topic not previously presented. METHODS: An analysis was done on every fight-ending choke in the history of the UFC™ mixed martial arts promotion. Investigators focused on the frequency of chokes, types of chokes, handedness of the chokes, and whether chokes resulted in loss of consciousness. This analysis was done using existing fight outcome reports and video analysis of every choke that ended a fight in UFC™ history. RESULTS: During the study period there were 904 such chokes, comprising 15.5% of fight outcomes and 76.2% of grappling submissions. The makeup of right (50.1%) and left (49.9%) handedness of the chokes has been essentially identical (χ2 [1] = 0.0011, p =.947, phi =.00). Most of the fight-ending chokes culminated in voluntary submission; however, 11% resulted in loss of consciousness. The rear naked choke (RNC) was significantly more frequent than other chokes, comprising 49.1% of the total choke finishes; 19 other choke types accounted for the remaining 50.9%. CONCLUSION: Fight-ending chokes have been common in MMA. Many types of chokes have successfully ended UFC™ fights, with the RNC accounting for almost half of fight-ending chokes. Loss of consciousness occurred in 11% of fight-ending chokes. Right and left handed chokes were utilized equally.

Construct validity of the personality inventory for ICD-11 (PiCD): Evidence from the MMPI-2-RF and CAT-PD-SF.

The Personality Inventory for ICD-11 (PiCD) was recently developed to assess the ICD-11 model of personality disorders. The purpose of this study was to examine the construct validity of the PiCD using the Minnesota Multiphasic Personality Inventory (MMPI)-2-Restructured Form (MMPI-2-RF) and the Computerized Adaptive Test of Personality Disorders Static Form (CAT-PD-SF). We administered these tests to 328 college students (150 males, 178 females). We found that the PiCD had adequate internal consistency reliability. Correlations between scores from the PiCD scales and the criterion measures generally indicated adequate discriminant validity. Along the same lines, convergent validity was adequate for the PiCD Negative Affective, Disinhibition, and Dissocial scales. However, the evidence was more mixed for the PiCD Detachment and Anankastic domains, which may be due to limitations with the content domains for these scales. Consistent with other research and theoretical expectations, a conjoint exploratory factor analysis utilizing the PiCD and MMPI-2-RF PSY-5 scales also indicated that anankastic and disinhibition may be more appropriately conceptualized as measuring opposite poles of one construct. Implications of these findings for the PiCD and the ICD-11 model are discussed. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Generalizability of statistical prediction from psychological assessment data: An investigation with the MMPI-2-RF.

In the present study, the author employed tools and principles from the domain of machine learning to investigate four questions related to the generalizability of statistical prediction in psychological assessment. First, to what extent do predictive methods common to psychology research and machine learning actually tend to predict new data points in new settings? Second, of what practical value is parsimony in applied prediction? Third, what is the most effective way to select model predictors when attempting to maximize generalizability? Fourth, how well do the methods considered compare with one another with respect to prediction generalizability? To address these questions, the author developed various types of predictive models on the basis of Minnesota Multiphasic Personality Inventory (MMPI)-2-RF scales, using multiple prediction criteria, in a calibration inpatient sample, then externally validated those models by applying them to one or two clinical samples from other settings. Model generalizability was then evaluated based on prediction accuracy in the external validation samples. Noteworthy findings from the present study include (a) statistical models generally demonstrated observable performance shrinkage across settings regardless of modeling approach, though they nevertheless tended to retain non-negligible predictive power in new settings; (b) of the modeling approaches considered, regularized (penalized) regression methods appeared to produce the most consistently robust predictions across settings; (c) parsimony appeared more likely to reduce than to enhance model generalizability; and (d) multivariate models whose predictors were selected automatically tended to perform relatively well, often producing substantially more generalizable predictions than models whose predictors were selected based on theory. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Equivalence of Laptop and Tablet Administrations of the Minnesota Multiphasic Personality Inventory-2 Restructured Form.

The present study investigated the comparability of laptop computer- and tablet-based administration modes for the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF). Employing a counterbalanced within-subjects design, the MMPI-2-RF was administered via both modes to a sample of college undergraduates ( N = 133). Administration modes were compared in terms of mean scale scores, internal consistency, test-retest consistency, external validity, and administration time. Mean scores were generally similar, and scores produced via both methods appeared approximately equal in terms of internal consistency and test-retest consistency. Scores from the two modalities also evidenced highly similar patterns of associations with external criteria. Notably, tablet administration of the MMPI-2-RF was substantially longer than laptop administration in the present study (mean difference 7.2 minutes, Cohen's d = .95). Overall, results suggest that varying administration mode between laptop and tablet has a negligible influence on MMPI-2-RF scores, providing evidence that these modes of administration can be considered psychometrically equivalent.