Implementation Intentions for Self-Selected Occupational Therapy Goals: Two Case Reports.

OBJECTIVE: We evaluated the feasibility of an intervention combining metacognitive strategy instruction (MSI) with training in implementation intentions for adults with mild traumatic brain injury (mTBI). Implementation intentions are written premade decision statements specifying when, where, and how goal behaviors are to be enacted. METHOD: Two participants with mTBI received a six-session intervention that included setting a daily implementation intention for an occupational therapy goal. A scoring rubric was used to evaluate the quality of implementation intentions; goal achievement was measured using the Canadian Occupational Performance Measure (COPM) and goal attainment scaling. RESULTS: All implementation intentions received perfect quality scores, suggesting participants learned to correctly craft implementation intentions. Improvements in COPM self-ratings exceeded minimal detectable change values; goal attainment levels indicated better-than-expected goal achievement. CONCLUSION: An intervention combining MSI and implementation intention training appears to be feasible. As an adjunct to MSI, implementation intentions may contribute to clients' ability to achieve their own occupational performance goals. Further study is needed.

Toward Return to Duty Decision-Making After Military Mild Traumatic Brain Injury: Preliminary Validation of the Charge of Quarters Duty Test.

Introduction: Determining duty-readiness after mild traumatic brain injury (mTBI) remains a priority of the United States Department of Defense as warfighters in both deployed and non-deployed settings continue to sustain these injuries in relatively large numbers. Warfighters with mTBI may experience unresolved sensorimotor, emotional, cognitive sequelae including problems with executive functions, a category of higher order cognitive processes that enable people to regulate goal-directed behavior. Persistent mTBI sequelae interfere with warfighters' proficiency in performing military duties and signal the need for graded return to activity and possibly rehabilitative services. Although significant strides have been carried out in recent years to enhance the identification and management of mTBI in garrison (EXORD 165-13) and deployed settings (EXORD 242-11; DoDI 6,490.11), the Department of Defense still lacks reliable, valid, and clinically feasible functional assessments to help inform duty-readiness decisions. Traditional functional assessments lack face validity for warfighters and may have ceiling effects, especially as related to executive functions. Performance-based multitasking assessments have been shown to be sensitive to executive dysfunction after acquired brain injury but no multitasking assessments have been validated in adults with mTBI. Existing multitasking assessments are not ecologically valid relative to military contexts. A multidisciplinary military-civilian team of researchers developed and evaluated a performance-based assessment called the Assessment of Military Multitasking Performance. One of the Assessment of Military Multitasking Performance multitasks, the Charge of Quarters Duty Test (CQDT), was designed to challenge the divided attention, foresight, and planning dimensions of executive functions. Here, we report on the preliminary validation results of the CQDT. Materials and Methods: The team conducted a measurement development study at Fort Bragg, NC, enrolling 83 service members (33 with mTBI and 50 healthy controls). Discriminant validity was evaluated by comparing differences in CQDT sub-scores of warfighters with mTBI and healthy controls. Associations between CQDT sub-scores and neurocognitive measures known to be sensitive to mTBI were examined to explore convergent validity. The study was approved by the Womack Army Medical Center Institutional Review Board (Fort Bragg). Results: There were significant between-group differences in two of the four CQDT sub-scores (number of visits, p = 0.012; and performance accuracy, p = 0.020). Correlations between the CQDT sub-scores and some neurocognitive measures were statistically significant but weak, ranging from 0.287 (CQDT performance accuracy and NAB Numbers and Letters, Part D) to -0.421 (CQDT total number of visits and Automated Neuropsychological Assessment Metrics Tower Task). There were group differences in terms of participants' reading level, education, years in military, and stress symptoms; some of these characteristics may have influenced CQDT performance. Conclusions: The CQDT demonstrated initial evidence of discriminant validity. Further study is warranted to more formally evaluate convergent/divergent validity and ultimately how and whether this performance-based multitasking measure can inform readiness to return to duty after mTBI.

Measuring Soldier Performance During the Patrol-Exertion Multitask: Preliminary Validation of a Postconcussive Functional Return-to-Duty Metric.

OBJECTIVE: To assess the discriminant validity of the Patrol-Exertion Multitask (PEMT), a novel, multidomain, functional return-to-duty clinical assessment for active duty military personnel. DESIGN: Measurement development study. SETTING: Nonclinical indoor testing facility. PARTICIPANTS: Participants (N=84) were healthy control (HC) service members (SMs; n=51) and military personnel (n=33) with persistent postconcussive symptoms receiving rehabilitation (mild traumatic brain injury [mTBI]). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Known-groups discriminant validity was evaluated by comparing performance on the PEMT in 2 groups of active duty SMs: HCs and personnel with mTBI residual symptoms. Participant PEMT performance was based on responses in 4 subtasks during a 12-minute patrolling scenario: (1) accuracy in identifying virtual improvised explosive device (IED) markers and responses to scenario-derived questions from a computer-simulated foot patrol; (2) auditory reaction time responses; (3) rating of perceived exertion during stepping; and (4) self-reported visual clarity (ie, gaze stability) during vertical head-in-space translation while stepping. RESULTS: Significant between-group differences for the PEMT were observed in 2 of 4 performance domains. Postpatrol IED identification task/question responses (P=.179) and rating of perceived exertion (P=.133) did not discriminate between groups. Participant self-report of visual clarity during stepping revealed significant (P<.001) between-group differences. SM reaction time responses to scenario-based auditory cues were significantly delayed in the mTBI group in both the early (P=.013) and late (P=.002) stages of the PEMT. CONCLUSIONS: Findings from this study support the use of a naturalistic, multidomain, complex clinical assessment to discriminate between healthy SMs and personnel with mTBI residual symptoms. Based on this preliminary study, additional research to further refine the PEMT and extend its application to return-to-work outcomes in military and civilian environments is warranted.

Importance and Difficulties of Pursuing rTMS Research in Acute Stroke.

Although much research has been done on repetitive transcranial magnetic stimulation (rTMS) in chronic stroke, only sparse research has been done in acute stroke despite the particularly rich potential for neuroplasticity in this stage. We attempted a preliminary clinical trial in one active, high-quality inpatient rehabilitation facility (IRF) in the -United States. But after enrolling only 4 patients in the grant period, the study was stopped because of low enrollment. The purpose of this paper is to offer a perspective describing the important physiologic rationale for including rTMS in the early phase of stroke, the reasons for our poor patient enrollment in our attempted study, and recommendations to help future studies succeed. We conclude that, if scientists and clinicians hope to enhance stroke outcomes, more attention must be directed to leveraging conventional rehabilitation with neuromodulation in the acute phase of stroke when the capacity for neuroplasticity is optimal. Difficulties with patient enrollment must be addressed by reassessing traditional inclusion and exclusion criteria. Factors that shorten patients' length of stay in the IRF must also be reassessed at all policy-making levels to make ethical decisions that promote higher functional outcomes while retaining cost consciousness.

Effect on Gait Speed, Balance, Motor Symptom Rating, and Quality of Life in Those with Stage I Parkinson's Disease Utilizing LSVT BIG®.

Individuals with Parkinson's Disease (PD) are often not referred to Physical Therapy (PT) until there are issues with mobility in later Hoehn and Yahr Stages. There have been no studies outlining the benefits of PT intervention in Stage I only. For persons with PD, deficits in motor function increase over time due to destruction of dopamine-producing cells. LSVT BIG, an exercise program for PD, has been shown to be effective in improving mobility. The purpose of this study was to assess participants functional improvement at a level of minimal clinically important difference (MCID) in one of four outcome measures: Gait Speed, Berg Balance Assessment, Functional Gait Assessment, and Unified Parkinson's Disease Rating Scale Motor Section. Case Description. Nine participants with Stage I PD received LSVT BIG 4x/week for 4 weeks followed by bimonthly participation in a community class. Outcome measurement occurred at baseline, after LSVT BIG, and three months after LSVT BIG. Outcomes. Eight of nine participants (88.9%) achieved MCID in at least one of the four measures at both after and 3 months after LSVT BIG training indicating improvement based on our criteria. Participants in Stage I of PD in this study completed LSVT BIG and demonstrated improved function.

Further Development of the Assessment of Military Multitasking Performance: Iterative Reliability Testing.

The Assessment of Military Multitasking Performance (AMMP) is a battery of functional dual-tasks and multitasks based on military activities that target known sensorimotor, cognitive, and exertional vulnerabilities after concussion/mild traumatic brain injury (mTBI). The AMMP was developed to help address known limitations in post concussive return to duty assessment and decision making. Once validated, the AMMP is intended for use in combination with other metrics to inform duty-readiness decisions in Active Duty Service Members following concussion. This study used an iterative process of repeated interrater reliability testing and feasibility feedback to drive modifications to the 9 tasks of the original AMMP which resulted in a final version of 6 tasks with metrics that demonstrated clinically acceptable ICCs of > 0.92 (range of 0.92-1.0) for the 3 dual tasks and > 0.87 (range 0.87-1.0) for the metrics of the 3 multitasks. Three metrics involved in recording subject errors across 2 tasks did not achieve ICCs above 0.85 set apriori for multitasks (0.64) and above 0.90 set for dual-tasks (0.77 and 0.86) and were not used for further analysis. This iterative process involved 3 phases of testing with between 13 and 26 subjects, ages 18-42 years, tested in each phase from a combined cohort of healthy controls and Service Members with mTBI. Study findings support continued validation of this assessment tool to provide rehabilitation clinicians further return to duty assessment methods robust to ceiling effects with strong face validity to injured Warriors and their leaders.

Delphi Study to Determine Rehabilitation Research Priorities for Older Adults With Cancer.

OBJECTIVE: To solicit expert opinions and develop consensus around the research that is needed to improve cancer rehabilitation for older adults. DESIGN: Delphi methods provided a structured process to elicit and prioritize research questions from national experts. SETTING: National, Web-based survey. PARTICIPANTS: Members (N=32) of the American Congress of Rehabilitation Medicine completed at least 1 of 3 investigator-developed surveys. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: In the first survey, participants identified up to 5 research questions that needed to be answered to improve cancer rehabilitation for older adults. In 2 subsequent surveys, participants viewed the compilation of questions, rated the importance of each question, and identified the 5 most important questions. This generated priority scores for each question. Consensus scores were created to describe the degree of agreement around the priority of each question. RESULTS: Highest priority research concerns the epidemiology and measurement of function and disability in older adult cancer survivors; the effects of cancer rehabilitation interventions on falls, disability, participation, survival, costs, quality of care, and health care utilization; and testing models of care that facilitate referrals from oncology to rehabilitation providers as part of coordinated, multicomponent care. CONCLUSIONS: A multipronged approach is needed to fill these gaps, including targeted funding opportunities developed with an advisory panel of cancer rehabilitation experts, development of a research network to facilitate novel collaborations and grant proposals, and coordinated efforts of clinical groups to advocate for funding, practice change, and policy change.

Utility of Oncotype DX Risk Assessment in Patients With Invasive Lobular Carcinoma.

INTRODUCTION/BACKGROUND: Oncotype DX (Genomic Health, Redwood City, CA) uses reverse transcriptase polymerase chain reaction analysis to measure tumor gene expression for determining recurrence risk (RR) and guiding chemotherapy decisions for breast cancer patients. Invasive lobular carcinoma (ILC) is a histologic subtype that has not been the focus of prior studies validating Oncotype DX. The study purpose was to develop a model using histologic tumor characteristics to predict uniformly low Oncotype DX Recurrence Scores (RS) in ILC. PATIENTS AND METHODS: ILC cases in our pathology database with Oncotype DX testing were identified. Histologic tumor characteristics, immunohistochemical (IHC) of estrogen receptor (ER)/progesterone receptor (PgR) percent, HER2, E-cadherin expression, and Ki-67 levels were obtained for cases. Discriminant analysis was used to test the hypothesis that tumors classified as lower/higher risk based on Oncotype DX RS would differ significantly on a linear combination of variables. RESULTS: From 2006 - 2014, 158 cases of ILC having Oncotype DX testing were identified; 90 low risk (RS < 18), 66 intermediate risk (RS 18 - 30) and 2 high risk (RS > 30). Discriminant analysis showed that PgR% followed by Ki-67 provided the greatest contribution to discern low versus elevated RS. A subset of 57 cases (∼36%) with predicted probabilities > 86% for either low or high RS yielded 96.5% correct classification, 92.3% sensitivity, and 97.7% specificity. CONCLUSION: Our analytical model may be useful in predicting lower RR in patients with ILC. If validated, this provides a faster and less expensive alternative to Oncotype DX testing in certain patients with ILC.

Feasibility of early functional rehabilitation in acute stroke survivors using the Balance-Bed-a technology that emulates microgravity.

Evidence-based guidelines recommend early functional rehabilitation of stroke patients when risk of patient harm can be managed. Current tools do not allow balance training under load conditions sufficiently low for acute stroke patients. This single-arm pilot study tested feasibility and safety for acute stroke survivors to use "Balance-Bed", a technology for balance exercises in supine initially developed to emulate microgravity effects on balance. Nine acute stroke patients (50-79 years) participated in 3-10 sessions over 16-46 days as part of their rehabilitation in a hospital inpatient setting. Standard inpatient measures of outcome were monitored where lack of progress from admission to discharge might indicate possible harm. Total FIM scores at admission (median 40, range 22-53) changed to (74, 50-96), Motor FIM scores from (23, 13-32) to (50, 32-68) and Berg Balance scores from (3, 0-6) to (19, 7-43) at discharge. Changes reached Minimal Clinical Important Difference for a sufficient proportion (>0.6) of the patients to indicate no harm to the patients. In addition, therapists reported the technology was safe, provided a positive experience for the patient and fit within the rehabilitation program. They reported the device should be easier to set up and exit. We conclude acute stroke patients tolerated Balance-Bed exercises such as standing on one or two legs, squats, stepping in place as well as balance perturbations provided by the therapist. We believe this is the first time it has been demonstrated that acute stroke patients can safely perform whole body balance training including balance perturbations as part of their rehabilitation program. Future studies should include a control group and compare outcomes from best practices to interventions using the Balance-Bed. In addition, the technology is relevant for countermeasure development for spaceflight and as a test-bed of balance function under microgravity-like conditions.

The club-level road cyclist: injury, pain, and performance.

OBJECTIVE: The aims of this study were to (1) examine riding habits of injured cyclists, (2) identify factors related to seeking medical treatment, (3) investigate performance of recreational road cyclists compared with established norms regarding strength and flexibility measures, and (4) propose cycling-specific injury risk factors. DESIGN: Observational and prospective study. SETTING: Cycling store and bicycle distribution company. PARTICIPANTS: Sixty-three experienced road cyclists. ASSESSMENT OF RISK FACTORS: Initial data collection included a questionnaire. A 2-week training diary and 8 weekly follow-up injury questionnaires were also collected. MAIN OUTCOME MEASURES: Training habits and injury history, bike fit, flexibility, and isometric, dynamic, and plyometric strength measures. RESULTS: Participants were likely to have an injury at baseline, and chronic pain was common. Cyclists trained for an equal quantity of time irrespective of experiencing pain. Injury severity in terms of pain level and participant age were factors in seeking medical care. Our participants performed poorly on our testing protocol compared with available norms. Flexibility, strength, and bike fit measures did not predict injury. Previous injury predicted prospective injury. The knee and lumbar region were most frequently injured. CONCLUSIONS: Cycling is a sport in which injury risk and prevention need to be further studied. Cyclists are frequently injured but continue to participate in cycling at volumes equal to their healthy peers. CLINICAL RELEVANCE: This study outlines a clinically reproducible cyclist assessment and discusses behaviors common to the cycling patient.

Composition of a vision screen for servicemembers with traumatic brain injury: consensus using a modified nominal group technique.

Vision impairment is common in the first year after traumatic brain injury (TBI), including among service members whose brain injuries occurred during deployment in Iraq and Afghanistan. Occupational therapy practitioners provide routine vision screening to inform treatment planning and referral to vision specialists, but existing methods are lacking because many tests were developed for children and do not screen for vision dysfunction typical of TBI. An expert panel was charged with specifying the composition of a vision screening protocol for servicemembers with TBI. A modified nominal group technique fostered discussion and objective determinations of consensus. After considering 29 vision tests, the panel recommended a nine-test vision screening that examines functional performance, self-reported problems, far-near acuity, reading, accommodation, convergence, eye alignment and binocular vision, saccades, pursuits, and visual fields. Research is needed to develop reliable, valid, and clinically feasible vision screening protocols to identify TBI-related vision disorders in adults.

Development and preliminary reliability of a multitasking assessment for executive functioning after concussion.

OBJECTIVES. Executive functioning deficits may result from concussion. The Charge of Quarters (CQ) Duty Task is a multitask assessment designed to assess executive functioning in servicemembers after concussion. In this article, we discuss the rationale and process used in the development of the CQ Duty Task and present pilot data from the preliminary evaluation of interrater reliability (IRR). METHOD. Three evaluators observed as 12 healthy participants performed the CQ Duty Task and measured performance using various metrics. Intraclass correlation coefficient (ICC) quantified IRR. RESULTS. The ICC for task completion was .94. ICCs for other assessment metrics were variable. CONCLUSION. Preliminary IRR data for the CQ Duty Task are encouraging, but further investigation is needed to improve IRR in some domains. Lessons learned in the development of the CQ Duty Task could benefit future test development efforts with populations other than the military.

Long-term effects of safe patient handling program on staff injuries.

PURPOSE: This study evaluated the effectiveness of a safe patient handling program (STEPS) at an inpatient rehabilitation unit in reducing injury due to patient transfers. Our objectives were to compare number of staff injuries during the 1.5-year period post training to pre training (baseline) and to determine whether reduction in injuries was sustained long term during a 2.5-year post training period. METHODS: All nursing and therapy staff as well as new hires received STEPS training. Periodic retraining was not provided. FINDINGS: The number of injuries was significantly reduced at post training compared to baseline (p = 0.01). However, the reductions in injuries were not sustained long term. CONCLUSION: We estimated a cost benefit of $3.71 for every dollar invested in retraining based on injury reduction realized during the post training period. CLINICAL RELEVANCE: Retraining is likely to have a positive cost benefit when it results in maintaining reduction in staff injuries.

Nurse practitioners in medical rehabilitation settings: a description of practice roles and patterns.

PURPOSE: To describe nurse practitioner (NP) roles in medical rehabilitation settings. DATA SOURCE: Description of practice by rehabilitation NPs and physicians. CONCLUSIONS: NPs increasingly function in medical rehabilitation settings as independent or collaborative care providers. This article describes their roles at a large rehabilitation institute in acute care consultation/liaison, acute rehabilitation, and ambulatory settings. The organization has experienced greater physician efficiency and practice scope, without erosion of subjective or objective quality measures and outcomes. The authors provide specific examples of NP roles in intrathecal baclofen and cancer rehabilitation programs. IMPLICATIONS FOR PRACTICE: Advanced practice nurses can provide efficacious care to people with disabilities, resulting in cost savings, improved outcomes, and high value. Patient care by NPs is beneficial for the physicians so that they may extend their clinical realm, spend more time doing research, and participate in medical leadership.

Development of a measure to inform return-to-duty decision making after mild traumatic brain injury.

Mild traumatic brain injury (mTBI), a principal injury of the wars in Iraq and Afghanistan, can result in significant morbidity. To make accurate return-to-duty decisions for soldiers with mTBI, military medical personnel require sensitive, objective, and duty-relevant data to characterize subtle cognitive and sensorimotor injury sequelae. A military-civilian research team reviewed existing literature and obtained input from stakeholders, end users, and experts to specify the concept and develop a preliminary assessment protocol to address this need. Results of the literature review suggested the potential utility of a test based on dual-task and multitask assessment methods. Thirty-three individuals representing a variety of military and civilian stakeholders/experts participated in interviews. Interview data suggested that reliability/validity, clinical feasibility, usability across treatment facilities, military face validity, and capacity to challenge mission-critical mTBI vulnerabilities were important to ultimate adoption. The research team developed the Assessment of Military Multitasking Performance, a tool composed of eight dual and multitasking test-tasks. A concept test session with 10 subjects indicated preliminary face validity and informed modifications to scoring and design. Further validation is needed. The Assessment of Military Multitasking Performance may fill a gap identified by stakeholders for complex cognitive/motor testing to assist return-to-duty decisions for service members with mTBI.

Which management strategy do parents prefer for their head-injured child: immediate computed tomography scan or observation?

OBJECTIVE: The objectives of this study were to determine which method of head injury evaluation, immediate computed tomography (CT) or observation, parents would prefer for their child when given the opportunity to make an informed decision and to determine factors influencing preference. METHODS: Parents of head-injured children 2 years or older who presented to a pediatric emergency department were eligible. After triage evaluation, and before physician assessment, research assistants presented educational materials regarding the method, risks, and benefits of both immediate CT and observation. Parents then completed a survey asking them their preference, reasons for preference, details of their child's injury, and demographic information. RESULTS: One hundred thirty-four parents participated. After reviewing the educational materials, 53 (40%) preferred immediate CT; 77 (57%) preferred observation; 4 (3%) did not indicate a preference. Of those parents who preferred immediate CT, the leading reason given was, "I need to be 100% sure there is no bleeding in my child's brain." Of those parents who preferred observation, the 2 leading reasons given were, "I don't want my child to have a test unless he/she absolutely has to" and "I am concerned about the possibility of radiation causing a brain tumor." Injury mechanism, time between injury and presentation, time of day, child's age, worst symptom, previous CT, and demographic markers were not statistically associated with preference. CONCLUSIONS: When given the opportunity to make an informed decision regarding the evaluation of their head-injured child, parents were divided as to their preference. A small majority preferred observation.

Assistive/Socially assistive robotic platform for therapy and recovery: patient perspectives.

Improving adherence to therapy is a critical component of advancing outcomes and reducing the cost of rehabilitation. A robotic platform was previously developed to explore how robotics could be applied to the social dimension of rehabilitation to improve adherence. This paper aims to report on feedback given by end users of the robotic platform as well as the practical applications that socially assistive robotics could have in the daily life activities of a patient. A group of 10 former and current patients interacted with the developed robotic platform during a simulated exercise session before taking an experience-based survey. A portion of these participants later provided verbal feedback as part of a focus group on the potential utility of such a platform. Identified applications included assistance with reaching exercise goals, managing to-do lists, and supporting participation in social and recreational activities. The study participants expressed that the personality characteristics of the robotic system should be adapted to individual preferences and that the assistance provided over time should align with the progress of their recovery. The results from this study are encouraging and will be useful for further development of socially assistive robotics.

The complex association of race and leaving the pediatric emergency department without being seen by a physician.

OBJECTIVES: This study examined the influence of race and language on leaving the emergency department (ED) without complete evaluation and treatment (LWCET). METHODS: This retrospective, case-cohort study examined LWCET among patients discharged home from 2 EDs between March 2, 2009, and March 31, 2010. Race and language were obtained by family self-report. We also explored wait time to see a physician as an explanation of racial disparities. RESULTS: One thousand two hundred eighty-five (1.7%) of 76,931 ED encounters ended in LWCET. Factors increasing LWCET were high ED activity, low acuity, and medical assistance (MA) insurance. American Indian, biracial, African American, and Hispanic races were also associated with higher odds of LWCET among visits by MA insurance patients compared with those of white patients on private insurance. Restricting the analysis to visits by MA insurance patients, only American Indian race was associated with LWCET compared with white race. Visits by patients using an interpreter or speaking a language other than English at home had lower odds of ending in LWCET. Sensitivity analyses in subgroups confirmed these findings. We developed a measure of ED activity that correlated well with wait time to see a physician (correlation coefficient = 0.993; P < 0.001). Among non-LWCET visits, wait time to see a practitioner did not correlate with racial disparities in LWCET. CONCLUSIONS: Race, language, and insurance status interact to form a complex relationship with LWCET. Medical assistance insurance status appears to account for much of the excessive instances of LWCET seen in nonwhites. After restricting the analysis to MA insurance patients, only visits by American Indian patients had higher odds of LWCET compared with whites on MA insurance. Wait time to see a physician did not explain racial differences in LWCET.

Validated assessment tools for pediatric airway endoscopy simulation.

OBJECTIVE: To determine the interrater reliability and construct validity of 3 separate assessment tools for assessing trainee skills in pediatric airway endoscopy simulation. DESIGN: An Objective Structured Assessment of Technical Skills (OSATS) was developed in which examinees were asked to name and assemble the airway foreign body instruments and retrieve a foreign body from an infant airway mannequin. Each examinee's performance was assessed in a blinded fashion by 3 pediatric otolaryngology faculty at separate residency programs using 3 assessment tools: (1) objective quantifiable measures list (eg, assists needed, forceps openings, foreign body drops), (2) 15-point OSATS checklist, and (3) Global Rating Index for Technical Skills (GRITS). Setting Otolaryngology residency program. Subjects Examinees (medical students, n = 3; otolaryngology residents, n = 17; pediatric otolaryngology faculty, n = 3) and raters (n = 3). Main Outcome Measures Interrater reliability and construct validity. Results Anonymized split-screen videos simultaneously capturing each examinee's instrument handling and the endoscopic videos were created for all 23 examinees. Nineteen videos were chosen for review by 3 raters. The interrater reliability as measured by the intraclass correlation for objective quantifiable measures ranged from 0.46 to 0.98. The intraclass correlation coefficient was 0.95 for the 15-point OSATS checklist and 0.95 for the GRITS; both showed a high degree of construct validity with scores correlating with previous experience. Conclusion Assessment tools for skills assessments must have high interrater reliability and construct validity. When assessing trainee skills in pediatric airway foreign body scenarios, the 15-point OSATS checklist developed by this group or the GRITS meets these criteria.