Knowledge Gains and Changing Attitudes from the Anatomy Education Research Institute (AERI 2017): A Mixed Methods Analysis.

The inaugural Anatomy Education Research Institute (AERI 2017) was held in Bloomington, Indiana in July of 2017. This workshop style conference paired experienced educational researchers (invited speakers) with individuals interested in learning more about the field (accepted applicants). In 2017, AERI was held over a five-day period and entailed plenary style presentations, break-out sessions, and specific times for small group mentorship. All participants (applicants and invited speakers) completed a pre-conference survey at the beginning of the institute and a post-conference survey at the end of the institute. Both surveys included categorical and Likert scale questions as well as open-ended questions for participant feedback. Quantitative and qualitative analyses indicate that both applicants and speakers increased their knowledge of anatomy education research, but that additional obstacles remain. Funding, time, and a lack of respect for the field remain problematic for faculty that wish to complete educational research. Mentorship and a community of practice also emerged as major themes necessary for educational research to be successful.

Implementation of an education-focused PhD program in anatomy and cell biology at Indiana University: lessons learned and future challenges.

In 2008, the Indiana University School of Medicine, in collaboration with the School of Education, admitted its first student to a newly approved PhD program in Anatomy and Cell Biology focusing on educational research rather than biomedical research. The goal of the program is twofold: (1) to provide students with extensive training in all of the anatomical disciplines coupled with sufficient teaching experience to assume major educational responsibilities upon graduation and (2) to train students to conduct rigorous medical education research and other scholarly work necessary for promotion and tenure. The 90 credit hour curriculum consists of biomedical courses taught within the School of Medicine and education courses taught within the School of Education, including courses in health sciences pedagogy, curriculum development, learning theory, quantitative, and qualitative research methods, statistics, and electives. To date, 16 students have entered the program, seven have passed their qualifying examinations, and five have earned their PhD degrees. Four students have received national recognition for their educational research and four graduates have obtained faculty appointments. Going forward, we must adapt the program's biomedical course requirements to incorporate the new integrated curriculum of the medical school, and we must secure additional funding to support more students. Overcoming these challenges will enable us to continue producing a small but stable supply of doctoral-level anatomy educators for a growing academic market.

The Blooming Anatomy Tool (BAT): A discipline-specific rubric for utilizing Bloom's taxonomy in the design and evaluation of assessments in the anatomical sciences.

Bloom's taxonomy is a resource commonly used to assess the cognitive level associated with course assignments and examination questions. Although widely utilized in educational research, Bloom's taxonomy has received limited attention as an analytical tool in the anatomical sciences. Building on previous research, the Blooming Anatomy Tool (BAT) was developed. This rubric provides discipline-specific guidelines to Blooming anatomy multiple-choice questions (MCQs). To test the efficacy of the BAT, a group of volunteers were randomly split up and asked to Bloom a series of anatomy MCQs using either the BAT or a traditional Bloom's reference called Bloom's Learning Objectives (BLO). Both groups utilized each rubric for a different series of MCQs. Examination question categorizations made using each rubric were tested for accuracy and interrater reliability. In addition, previous experience in anatomy and Bloom's taxonomy were considered. Results demonstrated that volunteers using the BAT had consistently higher levels of interrater reliability, but accuracy varied and was similar between rubrics. Neither measure was substantially impacted by experience in Bloom's taxonomy or anatomy. A poststudy survey indicated that volunteers strongly preferred the BAT and felt it was more helpful in categorizing anatomy MCQs than the BLO. These results suggest that the BAT can be useful in educational research in the anatomical sciences to aid in aligning observer judgment on Bloom taxonomic levels and improve consistency, especially when used in conjunction with a norming session prior to data collection.

A comparison of student performance on discipline-specific versus integrated exams in a medical school course.

Curricular reform is a widespread trend among medical schools. Assessing the impact that pedagogical changes have on students is a vital step in review process. This study examined how a shift from discipline-focused instruction and assessment to integrated instruction and assessment affected student performance in a second-year medical school pathology course. We investigated this by comparing pathology exam scores between students exposed to traditional discipline-specific instruction and exams (DSE) versus integrated instruction and exams (IE). Exam content was controlled, and individual questions were evaluated using a modified version of Bloom's taxonomy. Additionally, we compared United States Medical Licensing Examination (USMLE) step 1 scores between DSE and IE groups. Our findings indicate that DSE students performed better than IE students on complete pathology exams. However, when exam content was controlled, exam scores were equivalent between groups. We also discovered that the integrated exams were composed of a significantly greater proportion of questions classified on the higher levels of Bloom's taxonomy and that IE students performed better on these questions overall. USMLE step 1 exam scores were similar between groups. The finding of a significant difference in content complexity between discipline-specific and integrated exams adds to recent literature indicating that there are a number of potential biases related to curricular comparison studies that must be considered. Future investigation involving larger sample sizes and multiple disciplines should be performed to explore this matter further.

The virtual anatomy laboratory: usability testing to improve an online learning resource for anatomy education.

An increasing number of instructors are seeking to provide students with online anatomy resources. Many researchers have attempted to identify associations between resource use and student learning but few studies discuss the importance of usability testing in resource design and modification. Usability testing provides information about ease of use and resource flexibility and indicates navigational issues that contribute to extraneous cognitive load for the user. An example of usability testing for modification of an online anatomy resource called the "Virtual Lab" is presented. Usability testing was used to determine whether increased content would impair navigation through the interface. Subjects with varying levels of experience with anatomy content were recruited to assess efficiency and effectiveness (defined by usability standards) of the original resource and of the redesigned resource. Comparisons between usability evaluation of the original "Virtual Lab" (OVL) and of the redesigned "Virtual Lab" (RVL) revealed that subjects were better able to successfully complete tasks using the RVL than they were with the OVL. Results also demonstrated that subjects did not take significantly more time to successfully complete tasks with the RVL. Additionally, usability testing revealed that subjects were able to successfully complete tasks using the RVL regardless of whether they possessed prior experience with anatomy content or not. Results of this study suggest that the modified resource is more effective for users. The example presented here underscores the need for usability testing prior to resource implementation and whenever significant changes are made to a resource interface.