Association Between Performance on an Interdisciplinary Stroke Assessment Battery and Falls in Patients With Acute Stroke in an Inpatient Rehabilitation Facility: A Retrospective Cohort Study.

OBJECTIVE: To explore the association between demographic factors and functional performance measures of patients with acute stroke in an inpatient rehabilitation facility (IRF) and falls during the IRF stay and to quantify the diagnostic accuracy of functional outcome measures in identifying fallers. DESIGN: Retrospective cohort study. SETTING: Inpatient rehabilitation facility. PARTICIPANTS: Individuals with acute stroke admitted to hospital-based IRF (N=139). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Odds ratios were used to examine the relationship between fall frequency and functional outcome measures (National Institute of Stroke Scale, neglect [Item #11], Berg Balance Scale, Stroke Rehabilitation Assessment of Movement mobility and Stroke Rehabilitation Assessment of Movement lower extremity subscales [STREAM-LE], Montreal Cognitive Assessment, Dynamic Gait Index, and Stroke Impact Scale). Receiver operator characteristic analysis with area under the curve, sensitivity, specificity, and diagnostic odds ratio were used to assess the diagnostic accuracy of each functional outcome measure to distinguish patients who fell vs those who did not fall in the IRF. RESULTS: A total of 23 patients (16.2%) fell during the IRF hospitalization. Patients who did and did not fall did not differ in terms of age, sex, stroke type, or stroke location. Only the STREAM-LE was associated with falls (odds ratio, 0.93; 95% CI, 0.86-0.99). Area under the curve was 0.67 (95% CI, 0.51-0.82). With a positivity cutoff point of 12, sensitivity and specificity were 73.3% (95% CI, 54.6%-92.2%) and 50.0% (95% CI, 39.9%-59.2%), respectively. The diagnostic odds ratio was 3.4. CONCLUSIONS: The STREAM-LE score at admission to IRF may identify patients with acute stroke who are more likely to fall during their stay. However, the search for measures with greater diagnostic accuracy should continue.

Randomized Sham-Controlled Trial of Navigated Repetitive Transcranial Magnetic Stimulation for Motor Recovery in Stroke.

Background and Purpose- We aimed to determine whether low-frequency electric field navigated repetitive transcranial magnetic stimulation to noninjured motor cortex versus sham repetitive transcranial magnetic stimulation avoiding motor cortex could improve arm motor function in hemiplegic stroke patients when combined with motor training. Methods- Twelve outpatient US rehabilitation centers enrolled participants between May 2014 and December 2015. We delivered 1 Hz active or sham repetitive transcranial magnetic stimulation to noninjured motor cortex before each of eighteen 60-minute therapy sessions over a 6-week period, with outcomes measured at 1 week and 1, 3, and 6 months after end of treatment. The primary end point was the percentage of participants improving ≥5 points on upper extremity Fugl-Meyer score 6 months after end of treatment. Secondary analyses assessed changes on the upper extremity Fugl-Meyer and Action Research Arm Test and Wolf Motor Function Test and safety. Results- Of 199 participants, 167 completed treatment and follow-up because of early discontinuation of data collection. Upper extremity Fugl-Meyer gains were significant for experimental ( P<0.001) and sham groups ( P<0.001). Sixty-seven percent of the experimental group (95% CI, 58%-75%) and 65% of sham group (95% CI, 52%-76%) improved ≥5 points on 6-month upper extremity Fugl-Meyer ( P=0.76). There was also no difference between experimental and sham groups in the Action Research Arm Test ( P=0.80) or the Wolf Motor Function Test ( P=0.55). A total of 26 serious adverse events occurred in 18 participants, with none related to the study or device, and with no difference between groups. Conclusions- Among patients 3 to 12 months poststroke, goal-oriented motor rehabilitation improved motor function 6 months after end of treatment. There was no difference between the active and sham repetitive transcranial magnetic stimulation trial arms. Clinical Trial Registration- URL: https://www.clinicaltrials.gov . Unique identifier: NCT02089464.

Current practice focus trends in physical medicine and rehabilitation.

BACKGROUND: Physical medicine and rehabilitation (PM&R) is a diverse specialty, growing and evolving over a variety of subspecialty and practice focus areas. Accurate data regarding practice patterns of physiatrists are essential for updating requirements in training and certification, particularly as the Accreditation Council for Graduate Medical Education begins its process to update of the PM&R core residency training requirements. This study analyzes practice trends for nearly 98% of physiatrists in active practice, the largest study to date. OBJECTIVE: To update current demographics of physicians specializing in PM&R, including current areas of practice focus, to analyze the alignment of practice focus with subspecialty certification, and to determine the extent that electromyography is a component of current physiatric practice. DESIGN: Retrospective analysis of deidentified responses from American Board of Physical Medicine and Rehabilitation (ABPMR) board-certified PM&R physicians (diplomates) on annual enrollment in the ABPMR Continuing Certification program. PARTICIPANTS: A total of 9543 ABPMR diplomates. MAIN OUTCOME MEASURES: Demographics - age, gender, years in practice, practice setting(s) and area(s). Practice focus, subspecialty certifications. RESULTS: The majority of practicing physiatrists are men (62%) although the percentage of women in the field is growing (38%). Nearly 80% of physiatrists report more than one practice focus area, with pain medicine and sports medicine/musculoskeletal practices most commonly reported. CONCLUSIONS: This study confirms the growth trends in PM&R in pain and sports medicine but also highlights the substantial number of physiatrists focusing their practices in areas related to neurorehabilitation and medical rehabilitation. The large majority of physiatrists incorporate multiple focus areas into their practices. Electromyography is a focus for a declining percentage of practicing physiatrists.

Current status and trends in subspecialty certification in physical medicine and rehabilitation.

BACKGROUND: There is a need to better understand the overall state of sub-specialization in physical medicine and rehabilitation (PM&R). OBJECTIVE: To examine the status and trends in subspecialty certification for each of the seven subspecialties approved for American Board of Physical Medicine and Rehabilitation (ABPMR) diplomates. DESIGN/SETTING: Retrospective analysis of deidentified information from the ABPMR database. PARTICIPANTS: Physicians certified by ABPMR through 2019. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: For each subspecialty, we examined: (1) the number of certificates issued to ABPMR diplomates; (2) the recertification rate; (3) the yearly trends for total active, new, and expired certificates; and (4) for ABPMR-administered subspecialties, recertification rates for those entering the subspecialty through fellowship completion versus a "grandfathered" practice pathway. RESULTS: Of 11,421 ABPMR diplomates in the United States in 2019, a total of 3560 (31.2%) had 3985 active subspecialty certificates. Pain Medicine (PM) was the most common subspecialty certification (15.5% of all ABPMR diplomates) followed by Sports Medicine (SM, 6.6%), Brain Injury Medicine (BIM, 4.8%), Spinal Cord Injury Medicine (SCIM, 4.2%), Pediatric Rehabilitation Medicine (PRM, 2.5%), Neuromuscular Medicine (NMM, 0.7%), and Hospice and Palliative Medicine (HPM, 0.5%). For diplomates with more than one subspecialty certification, PM and SM was the most frequent combination. Both the recertification rate and the end of practice track eligibility influenced certification trends differently for individual subspecialties. The average number of new certificates added annually for every subspecialty was higher before than after the temporary practice track-based eligibility ended; the difference was statistically significant (p < .05) for SCIM, PM, SM, and NMM. The recertification rate for all subspecialties combined was 73.4%. For the subspecialties (SCIM, PRM) for which these data were available, fellowship candidates had higher recertification rates than those grandfathered through a practice track. CONCLUSION: This report informs stakeholders about the state and evolution of subspecialty certification in PM&R over time.

Why Do Physical Medicine and Rehabilitation Physicians Lose American Board of Physical Medicine and Rehabilitation Board Certification?

OBJECTIVE: Physicians can lose board certification through revocation related to professionalism violations or expiration due to failure to complete continuing certification requirements. The purpose of this study was to analyze the causes of board certification loss for physicians with board certification through the American Board of Physical Medicine and Rehabilitation. DESIGN: This retrospective cohort study analyzed the certification status of 5541 American Board of Physical Medicine and Rehabilitation diplomates between 1993 and 2019 to determine reasons for certification loss. A focused analysis of diplomates with expired certificates in 2019 was conducted to further examine reasons for certificate expiration. RESULTS: Of 5541 physicians, 496 (9%) had certification expiration due to failure to meet continuing certification requirements and 60 (1%) had certification revocation due to disciplinary actions, without regaining certification across the study years. A focused analysis of physicians with expired certificates in 2019 revealed that the majority had failed to complete multiple components of continuing certification. Practice improvement was the single most common incomplete requirement. Failure to pass the knowledge assessment was an uncommon cause for certification loss. CONCLUSIONS: Certification expiration through failure to complete all continuing certification requirements, versus revocation, is responsible for most instances of board certification loss. Practice improvement was the most common incomplete requirement.

American Board of Physical Medicine and Rehabilitation Diplomate Customization Choices on the Longitudinal Assessment for Physical Medicine and Rehabilitation: A First-Year Experience.

ABSTRACT: The American Board of Physical Medicine and Rehabilitation began administering the longitudinal assessment for physical medicine and rehabilitation for continuing certification in 2020. The longitudinal assessment for physical medicine and rehabilitation digitally delivers quarterly short assessments of content and repeats missed items to facilitate learning as well as serve as a summative certification assessment. With a goal of offering content relevant to an individual's practice and learning needs, diplomates choose how to customize the domains or topic areas of their question content on an annual basis. This report describes the first year of experience with customization of longitudinal assessment for physical medicine and rehabilitation. The American Board of Physical Medicine and Rehabilitation diplomate customization data are grouped and compared in a variety of ways to ascertain whether there are differences in customization choices. While customization choices were similar across several domains, significant differences were seen when comparing groups with specific areas of practice or subspecialty certification. Smaller differences were also seen when comparing question domain allocation choice between sexes, age groups, and practice setting. The results from this first full year of experience confirm an alignment of this innovative assessment approach to individual physician practice, a significant step in improving the relevance of continuing certification overall for participating physicians.

Taking Leave During Residency: Types of Absences and Subsequent Delays and Variations in Physical Medicine and Rehabilitation Medical Board Pass Rates.

ABSTRACT: There is limited literature examining the reasons physical medicine and rehabilitation residents take an extended leave of absence during residency and the impact of leave on board examination performance. Such information could better inform leave policies, help guide residency program directors, and potentially destigmatize taking leave. Study objectives were to describe the characteristics of physical medicine and rehabilitation residents who take leave during residency, compare differences in part I (written) and part II (oral) certification examination performance, and determine the prevalence of delays in taking board examinations. Study methodology was a retrospective analysis of deidentified information from the American Board of Physical Medicine and Rehabilitation database between 2008 and 2020. Results indicated four reasons for extended leave of absence: medical, parental, academic/remediation, and unspecified personal reasons. Residents who took an extended leave of absence for medical or parental reasons had similar or better odds of passing their part I and part II examinations compared with those without leave. Residents who took leave for academic/remediation concerns or unspecified personal reasons had lower odds of passing their board examinations. Examination delays for those taking parental or personal health leaves did not affect board pass rates. Further investigation is needed to identify how to support residents on academic/remediation and unspecified leaves during training.

Interrater Reliability in the American Board of Physical Medicine and Rehabilitation Part II Certification Examination: Impact of a New Assessment Design.

OBJECTIVE: The design of medical board certification examinations continues to evolve with advances in testing innovations and psychometric analysis. The potential for subjectivity is inherent in the design of oral board examinations, making improvements in reliability and validity especially important. The purpose of this quality improvement study was to analyze the impact of using two examiners on the overall reliability of the oral certification examination in physical medicine and rehabilitation. DESIGN: This was a retrospective quality improvement study of 422 candidates for the American Board of Physical Medicine and Rehabilitation Part II Examination in 2020. Candidates were examined by examiner pairs, each of whom submitted independent scores. Training for all 116 examiners included examination case review, scoring guidelines, and bias mitigation. Examiner performance was analyzed for both internal consistency (intrarater reliability) and agreement with their paired examiner (interrater reliability). RESULTS: The reliability of the Part II Examination was high, ranging from 0.93 to 0.94 over three administrations. The analysis also demonstrated high interrater agreement and examiner internal consistency. CONCLUSIONS: A high degree of interrater agreement was found using a new, two-examiner format. Comprehensive examiner training is likely the most significant factor for this finding. The two-examiner format improved the overall reliability and validity of the Part II Examination.

Improving Patient Safety and Quality in Physical Medicine and Rehabilitation Through Participation in the American Board of Physical Medicine and Rehabilitation Continuing Certification Program.

ABSTRACT: The American Board of Medical Specialties Continuing Certification Program's Improvement in Medical Practice Standard requires physicians to participate in practice improvement activities. Despite this universal requirement, there has been no assessment of this requirement or its potential impact on patient care. Because of its continuing certification oversight structure, the American Board of Physical Medicine and Rehabilitation is in a unique position to provide this assessment. Review of quality improvement projects submitted to the American Board of Physical Medicine and Rehabilitation for continuing certification compliance revealed that most diplomates (70.1%) used available topic-specific options. These projects are designed to be directive and easy to use for physicians with limited quality improvement experience. Examples of topic-directed project potential impact on patient care include preventing wrong-site injections through implementing a preprocedure timeout or decreasing opioid prescribing risk through implementation of an opioid risk assessment tool. Thirty percent of submissions described improvement efforts in other areas of practice. These projects were directed toward areas of patient care including safety, communication/education, satisfaction, processes, and outcomes. This study demonstrates the efforts of physiatrists to improve care and the potential impact of these efforts on patient care and safety through participation in continuing certification.

Key Findings From Peer-Reviewed Published Research by the American Board of Physical Medicine and Rehabilitation in Review.

ABSTRACT: Recognizing the dearth of published research on board certification in physical medicine and rehabilitation and its subspecialties, the American Board of Physical Medicine and Rehabilitation has increased efforts to conduct and disseminate research in this area. This report summarizes key findings of peer-reviewed studies published by American Board of Physical Medicine and Rehabilitation staff and leadership in the past 6 yrs, including those conducted in partnership with other entities. The reported studies are organized in three main categories: initial certification, continuing certification, and subspecialty certification in physical medicine and rehabilitation. Related findings are further grouped into subsections that include psychometric evaluation of certification examinations, association of candidate characteristics with certification performance, relationship of certification performance to other measures, and candidate reaction and feedback. Collectively, the summarized results provide evidence that the board certification process is reliable, statistically valid, and predictive of the risk of disciplinary action in subsequent years. These studies also describe facets of our specialty including degree of subspecialization, burnout, and how people maintain certification over time. We hope that physical medicine and rehabilitation trainees, diplomates, institutions, programs, and other stakeholders find this information useful and look forward to continuing research in these and other areas in the spirit of constant evidence-based improvement and feedback to our specialty.

Board Certification in Physical Medicine and Rehabilitation: A New Approach for a New Era.

ABSTRACT: The American Board of Physical Medicine and Rehabilitation's revised mission and vision emphasize lifelong learning throughout its board certification processes. More formative approaches have been incorporated into both initial and continuing certification. These changes are based in adult learning theory and are supported by an ongoing board research endeavor. Board certification in the future is envisioned as a partnership with physicians to facilitate ongoing learning and positively impact patient outcomes.

Influence of Sex and Age on Ratings of Confidence and Relevance in Continuing Certification Longitudinal Assessment: A Pilot Study.

OBJECTIVE: Longitudinal assessments use spaced repetition of items to facilitate learning. Algorithms selecting repetition items can prioritize various properties for future presentation. The purpose of this pilot study was to evaluate the relationship between participant ratings of item-specific confidence and/or practice relevance and participant age, sex, and response correctness. DESIGN: This is a prospective quality improvement study of 403 American Board of Physical Medicine and Rehabilitation diplomates with time-limited certificates. Participants answered 20 items quarterly over four quarters, rating each item on its relevance to their practice and their confidence in their response. RESULTS: The relationship between sex and ratings of response confidence was significant, with women less likely than men to be confident in their responses, regardless of correctness. Younger physicians were significantly more confident in their responses and rated items as more practice relevant. CONCLUSIONS: Women physicians were less confident than men in their item-specific confidence ratings, regardless of correctness, on the American Board of Physical Medicine and Rehabilitation continuing certification longitudinal knowledge assessment. Older physicians were less confident in their responses than younger physicians. The findings supported the American Board of Physical Medicine and Rehabilitation prioritization of response correctness and practice relevance, rather than response confidence, to select items for spaced repetition in American Board of Physical Medicine and Rehabilitation's continuing certification longitudinal assessment.

Positive Professionalism.

The evaluation of professionalism is embedded in the American Board of Medical Specialties' continuing certification programs for its 24 member boards.1 Currently, professionalism assessment is largely restricted to documenting professional standing, such as the status of medical licenses and medical staff privileges. With increased recognition of an expanded view of professionalism to include professional behaviors and competencies comes an opportunity for medical specialty boards to embrace a more formative approach to professionalism assessment. The goal of such an approach is to educate, reaffirm, and reinforce positive professional behaviors long beyond completion of formal medical education.

Evaluation of Longitudinal Assessment for Use in Maintenance of Certification.

OBJECTIVE: The aim of the study was to evaluate a longitudinal assessment program for physical medicine and rehabilitation (LA-PM&R) as a replacement for the American Board of Physical Medicine and Rehabilitation maintenance of certification examination. DESIGN: In this quality improvement study, randomly selected American Board of Physical Medicine and Rehabilitation diplomates were invited to participate in the LA-PM&R. Participants' maintenance of certification scaled scores were compared with LA-PM&R nonparticipants. We examined the association between LA-PM&R scores and maintenance of certification scaled scores and performance on clone items placed on both examinations. RESULTS: There were 2222 American Board of Physical Medicine and Rehabilitation diplomates eligible to take the maintenance of certification examination from February 2018 to February 2019. Invitations were sent to 1050 randomly selected diplomates, of whom 448 initially agreed. Three hundred eighteen individuals completed more than two quarters of LA-PM&R participation and took the maintenance of certification examination. Two hundred sixty-six diplomates took the maintenance of certification examination in the same period who did not participate in LA-PM&R. The LA-PM&R group scored higher on the maintenance of certification examination than the control group (P < 0.05). Performance on the two examinations were highly correlated, r = .50, P < 0.0001. On clone items, LA-PM&R participants had 74% correct on the LA-PM&R but 86% correct on the maintenance of certification examination (P < 0.01). CONCLUSIONS: The LA-PM&R program leads to better learning and retention of information than the 10-yr maintenance of certification examination.

Allopathic (MD) and Osteopathic (DO) Performance on the American Board of Physical Medicine and Rehabilitation Initial Certifying Examinations.

BACKGROUND: Osteopathic physicians (DOs) represent over 30% of residents in allopathic (MD) Accreditation Council for Graduate Medical Education (ACGME) accredited physical medicine and rehabilitation (PM&R) training programs. However, some have questioned the quality of osteopathic medical school training and the graduates of osteopathic medical schools. The performance of osteopathic physicians in allopathic PM&R training programs has not been assessed. OBJECTIVE: To compare allopathic (MD) and osteopathic (DO) physician performance on American Board of Physical Medicine and Rehabilitation (ABPMR) initial certifying examinations. DESIGN: Retrospective cross-sectional study. SETTING: Board-eligible PM&R physicians. PARTICIPANTS: MDs and DOs who completed an allopathic ACGME-accredited PM&R residency training program. METHODS: MD and DO pass rates and mean scaled scores on the ABPMR initial certifying examinations were compared. MD versus DO degrees and training program 6 years aggregate board pass rates were independent variables. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURE: MD and DO pass rates and mean scaled scores on the ABPMR initial certifying examinations. RESULTS: Of the 2187 physicians who were first-time ABPMR initial certifying examination takers, there were 1596 MDs (73%) and 591 DOs (27%). No statistically significant difference was found in pass rates between MDs and DOs on Part I (94.9% vs. 93.9%, P = .35) or Part II (87.8% vs. 88%, P = .83) of the ABPMR certifying examination. Analysis of mean scaled scores demonstrated higher MD scores on both Part I ( 526, SD = 31, vs. 516, SD = 67, P = .002) and Part II ( 6.73, SD = .83 vs. 6.62, SD = .77, P = .005), significant only in programs with a 90%-100% pass rate. These differences, however, were of very small magnitude and likely not meaningful from a clinical or educational perspective. CONCLUSION: This study did not find meaningful differences in performance on the ABPMR certifying examinations between MDs and DOs.

Association of Participation in the American Board of Physical Medicine and Rehabilitation Maintenance of Certification Program and Physician Disciplinary Actions.

OBJECTIVE: The study analyzed the relationship between participation in the American Board of Physical Medicine and Rehabilitation maintenance of certification program and the incidence of disciplinary actions by state medical boards over a physician's career. The hypothesis is that physicians who do not maintain their board certification have a higher likelihood of state medical board disciplinary actions. DESIGN: This retrospective cohort study analyzed American Board of Physical Medicine and Rehabilitation maintenance of certification data from all board-certified physiatrists who were enrolled in the American Board of Physical Medicine and Rehabilitation maintenance of certification program from 1993 to 2007. RESULTS: Matching examination and license data were available for 4794 physicians, who received a total of 212 disciplinary action reports through the Federation of State Medical Boards. The results showed that physicians who have a lapse in completing the American Board of Physical Medicine and Rehabilitation maintenance of certification program have a 2.5-fold higher incidence of receiving a disciplinary action report through the Federation of State Medical Boards (95% confidence interval = 1.76-3.63) and had higher severity violations (χ = 7.14, P < 0.05) than physicians whose certificate never lapsed. CONCLUSIONS: For physicians in physical medicine and rehabilitation, loss of board certification through failure to fulfill the maintenance of certification program requirements is associated with an increased risk of disciplinary action from a state medical licensing board.

Is There Evidence of Gender Bias in the Oral Examination for Initial Certification by the American Board of Physical Medicine & Rehabilitation?

OBJECTIVE: Unconscious bias may result in a prejudicial evaluation of another person and lead to unfair treatment. Potential gender bias risk exists in the scoring process on the American Board of Physical Medicine and Rehabilitation oral examination (Part II) because of the face-to-face interactions between candidates and examiners. This study was undertaken to determine whether performance on the American Board of Physical Medicine and Rehabilitation Part II examination differed based on candidate gender or configuration of examiner/candidate gender pairings. The impact of examiner unconscious bias training on candidate performance was also assessed. DESIGN: This is a retrospective observational study of first-time Part II physical medicine and rehabilitation certification examination test takers between 2013 and 2018. RESULTS: There were significant differences in pass rates (men 84%, women 89%) and mean scaled scores (men 6.56, women 6.81) between men and women (P < 0.001) with the biggest domain score differences in data acquisition and interpersonal and communication skills. Implementation of examiner unconscious bias training did not impact candidate performance. CONCLUSIONS: Women candidates scored higher and had a higher pass rate than men candidates overall on the American Board of Physical Medicine and Rehabilitation Part II examination. This difference does not seem to be due to scoring gender bias by the Part II examiners or due to candidate aptitude as measured on the Part I examination.

Does Performance on the American Board of Physical Medicine and Rehabilitation Initial Certification Examinations Predict Future Physician Disciplinary Actions?

OBJECTIVE: The aim of the study was to determine the relationship between performance on the American Board of Physical Medicine and Rehabilitation primary certification examinations and the risk of subsequent disciplinary actions by state medical boards over a physician's career. The hypothesis is that physicians who do not pass either or both of the two initial specialty certification examinations are at higher risk of disciplinary action from a state medical licensing board. DESIGN: This is a retrospective cohort study that analyzed board certification examination data from all physicians who completed physical medicine and rehabilitation residency between 1968 and 2017. RESULTS: Matching examination and license data were available for 9889 physical medicine and rehabilitation physicians, who received a total of 547 disciplinary action reports through the Federation of State Medical Boards. The results showed a significant correlation between failing an American Board of Physical Medicine and Rehabilitation certification examination and the risk of subsequent disciplinary action by a state medical board. Failure to pass either the written (Part I) or oral (Part II) examination increased the risk of subsequent disciplinary action by 5.77-fold (P < 0.0001, 95% confidence interval = 4.07-8.18). CONCLUSIONS: Physicians in physical medicine and rehabilitation who do not pass initial certification examinations and become board certified are at higher risk of disciplinary action from a state medical licensing board throughout their careers.