An introductory biology research-rich laboratory course shows improvements in students' research skills, confidence, and attitudes.

As part of a wider reform to scaffold quantitative and research skills throughout the biology major, we introduced course-based undergraduate research experiences (CURE) in sections of a large-enrollment introductory biology laboratory course in a mid-level, public, minority-serving institution. This initiative was undertaken as part of the in the National Science Foundation / Council for Undergraduate Research Transformations Project. Student teams performed two or three experiments, depending on semester. They designed, implemented, analyzed, revised and iterated, wrote scientific paper-style reports, and gave oral presentations. We tested the impact of CURE on student proficiency in experimental design and statistical reasoning, and student research confidence and attitudes over two semesters. We found that students in the CURE sections met the reformed learning objectives for experimental design and statistical reasoning. CURE students also showed higher levels of experimental design proficiency, research self-efficacy, and more expert-like scientific mindsets compared to students in a matched cohort with the traditional design. While students in both groups described labs as a positive experience in end-of-semester reflections, the CURE group showed a high level of engagement with the research process. Students in CURE sections identified components of the research process that were difficult, while also reporting enjoying and valuing research. This study demonstrates improved learning, confidence, and attitudes toward research in a challenging CURE laboratory course where students had significant autonomy combined with appropriate support at a diverse public university.

Robustness of Projective IRT to Misspecification of the Underlying Multidimensional Model.

As a method to derive a "purified" measure along a dimension of interest from response data that are potentially multidimensional in nature, the projective item response theory (PIRT) approach requires first fitting a multidimensional item response theory (MIRT) model to the data before projecting onto a dimension of interest. This study aims to explore how accurate the PIRT results are when the estimated MIRT model is misspecified. Specifically, we focus on using a (potentially misspecified) two-dimensional (2D)-MIRT for projection because of its advantages, including interpretability, identifiability, and computational stability, over higher dimensional models. Two large simulation studies (I and II) were conducted. Both studies examined whether the fitting of a 2D-MIRT is sufficient to recover the PIRT parameters when multiple nuisance dimensions exist in the test items, which were generated, respectively, under compensatory MIRT and bifactor models. Various factors were manipulated, including sample size, test length, latent factor correlation, and number of nuisance dimensions. The results from simulation studies I and II showed that the PIRT was overall robust to a misspecified 2D-MIRT. Smaller third and fourth simulation studies were done to evaluate recovery of the PIRT model parameters when the correctly specified higher dimensional MIRT or bifactor model was fitted with the response data. In addition, a real data set was used to illustrate the robustness of PIRT.

Development and Initial Validation of the PROMIS(®) Sexual Function and Satisfaction Measures Version 2.0.

INTRODUCTION: The Patient-Reported Outcomes Measurement Information System (PROMIS)(®) Sexual Function and Satisfaction measure (SexFS) version 1.0 was developed with cancer populations. There is a need to expand the SexFS and provide evidence of its validity in diverse populations. AIM: The aim of this study was to describe the development of the SexFS v2.0 and present preliminary evidence for its validity. METHODS: Development built on version 1.0, plus additional review of extant items, discussions with 15 clinical experts, 11 patient focus groups (including individuals with diabetes, heart disease, anxiety, depression, and/or are lesbian, gay, bisexual, or aged 65 or older), 48 cognitive interviews, and psychometric evaluation in a random sample of U.S. adults plus an oversample for specific sexual problems (2281 men, 1686 women). We examined differential item functioning (DIF) by gender and sexual activity. We examined convergent and known-groups validity. RESULTS: The final set of domains includes 11 scored scales (interest in sexual activity, lubrication, vaginal discomfort, clitoral discomfort, labial discomfort, erectile function, orgasm ability, orgasm pleasure, oral dryness, oral discomfort, satisfaction), and six nonscored item pools (screeners, sexual activities, anal discomfort, therapeutic aids, factors interfering with sexual satisfaction, bother). Domains from version 1.0 were reevaluated and improved. Domains considered applicable across gender and sexual activity status, namely interest, orgasm, and satisfaction, were found to have significant DIF. We identified subsets of items in each domain that provided consistent measurement across these important respondent groups. Convergent and known-groups validity was supported. CONCLUSIONS: The SexFS version 2.0 has several improvements and enhancements over version 1.0 and other extant measures, including expanded evidence for validity, scores centered around norms for sexually active U.S. adults, new domains, and a final set of items applicable for both men and women and those sexually active with a partner and without. The SexFS is customizable, allowing users to select relevant domains and items for their study.

A Dual-Purpose Rasch Model with Joint Maximum Likelihood Estimation.

In practice, there is a growing need of reporting both overall score for the ranking/decision-making purpose and subscores for the diagnostic purpose. The Rasch model with subdimensions (RMS) was employed in this study to address this problem. A joint maximum likelihood estimation (JMLE) procedure was proposed to obtain computationally efficient estimation for this model. A simulation study was conducted to investigate the properties of this model with the JMLE procedure in conditions with varying sample size, test lengths and subdimension loading structure. Results indicated that in general, parameters were estimated well using the JMLE procedure. The item parameters and overall ability parameters in RMS were in accordance with parameters obtained from the Rasch model.

Survey analysis with mixture Rasch models.

This research provides a demonstration of the utility of mixture Rasch models (MRMs) for the analysis of survey data. Specifically, a framework based on a mixture partial credit model (MPCM) will be presented. MRMs are able to provide information regarding latent classes (subpopulations without manifest grouping variables) and separate item parameter estimates for each of these latent classes. Analyses can provide insight into how a survey scale is functioning and how survey respondents differ from one another. The paper provides a detailed example with real survey data from a higher education survey administered to college seniors through all stages of model estimation and selection, description of model results, and follow-up analyses using the MRM results. The results found three distinct classes and discussed each class in terms of the pattern of item parameter estimates within class. The paper also investigated differences of class assignment based on the college the student belongs to on campus.

Accuracy and reliability of peer assessment of athletic training psychomotor laboratory skills.

CONTEXT: Peer assessment is defined as students judging the level or quality of a fellow student's understanding. No researchers have yet demonstrated the accuracy or reliability of peer assessment in athletic training education. OBJECTIVE: To determine the accuracy and reliability of peer assessment of athletic training students' psychomotor skills. DESIGN: Cross-sectional study. SETTING: Entry-level master's athletic training education program. PATIENTS OR OTHER PARTICIPANTS: First-year (n  =  5) and second-year (n  =  8) students. MAIN OUTCOME MEASURE(S): Participants evaluated 10 videos of a peer performing 3 psychomotor skills (middle deltoid manual muscle test, Faber test, and Slocum drawer test) on 2 separate occasions using a valid assessment tool. Accuracy of each peer-assessment score was examined through percentage correct scores. We used a generalizability study to determine how reliable athletic training students were in assessing a peer performing the aforementioned skills. Decision studies using generalizability theory demonstrated how the peer-assessment scores were affected by the number of participants and number of occasions. RESULTS: Participants had a high percentage of correct scores: 96.84% for the middle deltoid manual muscle test, 94.83% for the Faber test, and 97.13% for the Slocum drawer test. They were not able to reliably assess a peer performing any of the psychomotor skills on only 1 occasion. However, the φ increased (exceeding the 0.70 minimal standard) when 2 participants assessed the skill on 3 occasions (φ  =  0.79) for the Faber test, with 1 participant on 2 occasions (φ  =  0.76) for the Slocum drawer test, and with 3 participants on 2 occasions for the middle deltoid manual muscle test (φ  =  0.72). CONCLUSIONS: Although students did not detect all errors, they assessed their peers with an average of 96% accuracy. Having only 1 student assess a peer performing certain psychomotor skills was less reliable than having more than 1 student assess those skills on more than 1 occasion. Peer assessment of psychomotor skills could be an important part of the learning process and a tool to supplement instructor assessment.

Differences in ultrasonic vocalizations between wild and laboratory California mice (Peromyscus californicus).

BACKGROUND: Ultrasonic vocalizations (USVs) emitted by muroid rodents, including laboratory mice and rats, are used as phenotypic markers in behavioral assays and biomedical research. Interpretation of these USVs depends on understanding the significance of USV production by rodents in the wild. However, there has never been a study of muroid rodent ultrasound function in the wild and comparisons of USVs produced by wild and laboratory rodents are lacking to date. Here, we report the first comparison of wild and captive rodent USVs recorded from the same species, Peromyscus californicus. METHODOLOGY AND PRINCIPAL FINDINGS: We used standard ultrasound recording techniques to measure USVs from California mice in the laboratory (Peromyscus Genetic Stock Center, SC, USA) and the wild (Hastings Natural History Reserve, CA, USA). To determine which California mouse in the wild was vocalizing, we used a remote sensing method that used a 12-microphone acoustic localization array coupled with automated radio telemetry of all resident Peromyscus californicus in the area of the acoustic localization array. California mice in the laboratory and the wild produced the same types of USV motifs. However, wild California mice produced USVs that were 2-8 kHz higher in median frequency and significantly more variable in frequency than laboratory California mice. SIGNIFICANCE: The similarity in overall form of USVs from wild and laboratory California mice demonstrates that production of USVs by captive Peromyscus is not an artifact of captivity. Our study validates the widespread use of USVs in laboratory rodents as behavioral indicators but highlights that particular characteristics of laboratory USVs may not reflect natural conditions.

Responsible Conduct of Research Measure: initial development and pilot study.

Although much discussion has been focused on research misconduct (RM) and questionable research practices, to date no self-report measures exist to examine this phenomenon. To help fill this void, the authors developed the Responsible Conduct of Research Measure (RCRM) through multiple pilot study waves involving researchers in the social and behavioral sciences. Preliminary results reveal adequate validity and reliability. The authors discuss limitations of the study as well as some possible directions for future research on this topic.