Implementing Geographic Information Systems (GIS) into VHA Home Based Primary Care.

The Veteran's Health Administration (VHA) Home Based Primary Care (HBPC) program provides comprehensive in-home primary care services to elderly Veterans with complex chronic medical conditions. Nurses have prominent roles in HBPC including as program leaders, primary care providers and nurses who make home visits. Delivery of primary care services to patients in their homes can be challenging due to travel distances, difficult terrain, traffic, and adverse weather. Mapmaking with geographic information systems (GIS) can support optimization of resource utilization, travel efficiency, program capacity, and management during normal operations, and patient safety during disasters. This paper reports on the feasibility, acceptability and outcomes of an initiative to implement GIS mapmaking in VHA HBPC programs. A mixed method evaluation assessed extent of adoption and identified facilitators and barriers to uptake. Results indicate that GIS mapping in VHA HBPC is feasible and can increase effectiveness and efficiency of VHA HBPC nurses.

Large-Scale Survey Findings Inform Patients' Experiences in Using Secure Messaging to Engage in Patient-Provider Communication and Self-Care Management: A Quantitative Assessment.

BACKGROUND: Secure email messaging is part of a national transformation initiative in the United States to promote new models of care that support enhanced patient-provider communication. To date, only a limited number of large-scale studies have evaluated users' experiences in using secure email messaging. OBJECTIVE: To quantitatively assess veteran patients' experiences in using secure email messaging in a large patient sample. METHODS: A cross-sectional mail-delivered paper-and-pencil survey study was conducted with a sample of respondents identified as registered for the Veteran Health Administrations' Web-based patient portal (My HealtheVet) and opted to use secure messaging. The survey collected demographic data, assessed computer and health literacy, and secure messaging use. Analyses conducted on survey data include frequencies and proportions, chi-square tests, and one-way analysis of variance. RESULTS: The majority of respondents (N=819) reported using secure messaging 6 months or longer (n=499, 60.9%). They reported secure messaging to be helpful for completing medication refills (n=546, 66.7%), managing appointments (n=343, 41.9%), looking up test results (n=350, 42.7%), and asking health-related questions (n=340, 41.5%). Notably, some respondents reported using secure messaging to address sensitive health topics (n=67, 8.2%). Survey responses indicated that younger age (P=.039) and higher levels of education (P=.025) and income (P=.003) were associated with more frequent use of secure messaging. Females were more likely to report using secure messaging more often, compared with their male counterparts (P=.098). Minorities were more likely to report using secure messaging more often, at least once a month, compared with nonminorities (P=.086). Individuals with higher levels of health literacy reported more frequent use of secure messaging (P=.007), greater satisfaction (P=.002), and indicated that secure messaging is a useful (P=.002) and easy-to-use (P≤.001) communication tool, compared with individuals with lower reported health literacy. Many respondents (n=328, 40.0%) reported that they would like to receive education and/or felt other veterans would benefit from education on how to access and use the electronic patient portal and secure messaging (n=652, 79.6%). CONCLUSIONS: Survey findings validated qualitative findings found in previous research, such that veterans perceive secure email messaging as a useful tool for communicating with health care teams. To maximize sustained utilization of secure email messaging, marketing, education, skill building, and system modifications are needed. These findings can inform ongoing efforts to promote the sustained use of this electronic tool to support for patient-provider communication.

Evaluating user experiences of the secure messaging tool on the Veterans Affairs' patient portal system.

BACKGROUND: The United States Department of Veterans Affairs has implemented an electronic asynchronous "Secure Messaging" tool within a Web-based patient portal (ie, My HealtheVet) to support patient-provider communication. This electronic resource promotes continuous and coordinated patient-centered care, but to date little research has evaluated patients' experiences and preferences for using Secure Messaging. OBJECTIVE: The objectives of this mixed-methods study were to (1) characterize veterans' experiences using Secure Messaging in the My HealtheVet portal over a 3-month period, including system usability, (2) identify barriers to and facilitators of use, and (3) describe strategies to support veterans' use of Secure Messaging. METHODS: We recruited 33 veterans who had access to and had previously used the portal's Secure Messaging tool. We used a combination of in-depth interviews, face-to-face user-testing, review of transmitted secure messages between veterans and staff, and telephone interviews three months following initial contact. We assessed participants' computer and health literacy during initial and follow-up interviews. We used a content-analysis approach to identify dominant themes in the qualitative data. We compared inferences from each of the data sources (interviews, user-testing, and message review) to identify convergent and divergent data trends. RESULTS: The majority of veterans (27/33, 82%) reported being satisfied with Secure Messaging at initial interview; satisfaction ratings increased to 97% (31/32, 1 missing) during follow-up interviews. Veterans noted Secure Messaging to be useful for communicating with their primary care team to manage health care needs (eg, health-related questions, test requests and results, medication refills and questions, managing appointments). Four domains emerged from interviews: (1) perceived benefits of using Secure Messaging, (2) barriers to using Secure Messaging, (3) facilitators for using Secure Messaging, and (4) suggestions for improving Secure Messaging. Veterans identified and demonstrated impediments to successful system usage that can be addressed with education, skill building, and system modifications. Analysis of secure message content data provided insights to reasons for use that were not disclosed by participants during interviews, specifically sensitive health topics such as erectile dysfunction and sexually transmitted disease inquiries. CONCLUSIONS: Veterans perceive Secure Messaging in the My HealtheVet patient portal as a useful tool for communicating with health care teams. However, to maximize sustained utilization of Secure Messaging, marketing, education, skill building, and system modifications are needed. Data from this study can inform a large-scale quantitative assessment of Secure Messaging users' experiences in a representative sample to validate qualitative findings.

Staff Low Back Injury Risk During Assisted Falls Virtual Reality Simulations.

BACKGROUND: Assisted falls occur when staff try to minimize the impact of falls by slowing a patient's descent. Assisting a patient fall may decrease patient injury risk, but biomechanical risk of injury to staff has not been evaluated. Assisted falls virtual reality (VR) simulations were conducted to examine staff low back injury risk during common assisted falls scenarios. METHODS: VR simulations of a toilet to wheelchair transfer were developed with a male patient avatar for three assisted falls scenarios: standing up from toilet, sitting down on wheelchair, and ambulation. Patient avatar weight was modified to reflect normal, underweight, and overweight adult patients. The average spinal compression force at L5/S1 was calculated for each participant with five trials per three scenarios while utilizing physical ergonomic techniques and compared to the safe spinal compression limit of 3,400 Newtons (N). FINDINGS: Six staff participants completed 90 VR simulations in total. The average calculated spinal compression force ranged from 7,132 N to 27,901 N. All participant trials exceeded the safe spinal compression limit of 3,400 N for every assisted falls scenario and avatar weight despite application of ergonomic techniques including wide stance, knees bent, and backs straight. CONCLUSIONS/APPLICATION TO PRACTICE: Staff are at risk for low back injury if they assist falls regardless of the adult patient weight and application of ergonomic techniques. Safer alternatives like the implementation of mobility screening tools and safe patient handling and mobility technology are needed to help prevent assisted falls to decrease injury risk to both patients and staff.

Multisite Agricultural Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) Pilot Program: Protocol for a Responsive Mixed Methods Evaluation Study.

BACKGROUND: Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) is an innovative pilot program to provide supportive resources for veterans with interests in agricultural vocations. Implemented at 10 pilot sites, VA FARMS will provide mental health services and resources for veterans while supporting training in gardening and agriculture. As each pilot site project has unique goals, outreach strategies, and implementation efforts based on the local environment and veteran population, evaluating the pilot program provides a unique challenge for evaluators. This paper describes the protocol to evaluate VA FARMS, which was specifically designed to enable site variation by providing both site-specific and cross-site understanding of site implementation processes and outcomes. OBJECTIVE: The objectives of this paper are to (1) describe the protocol used for evaluating VA FARMS, as an innovative Department of Veterans Affairs (VA) agriculturally based, mental health, and employment pilot program serving veterans at 10 pilot sites across the Veterans Health Administration enterprise; and (2) provide guidance to other evaluators assessing innovative programs. METHODS: This evaluation uses the context, inputs, process, product (CIPP) model, which evaluates a program's content and implementation to identify strengths and areas for improvement. Data collection will use a concurrent mixed methods approach. Quantitative data collection will involve quarterly program surveys, as well as three individual veteran participant surveys administered upon the veteran's entrance and exit of the pilot program and 3 months postexit. Quantitative data will include baseline descriptive statistics and follow-up statistics on veteran health care utilization, health care status, and agriculture employment status. Qualitative data collection will include participant observation at each pilot site, and interviews with participants, staff, and community stakeholders. Qualitative data will provide insights about pilot program implementation processes, veterans' experiences, and short-term participation outcomes. RESULTS: Evaluation efforts began in December 2018 and are ongoing. Between October 2018 and September 2020, 494 veterans had enrolled in VA FARMS and 1326 veterans were reached through program activities such as demonstrations, informational presentations, and town-hall discussions. A total of 1623 community members and 655 VA employees were similarly reached by VA FARMS programming during that time. Data were collected between October 2018 and September 2020 in the form of 336 veteran surveys, 30 veteran interviews, 27 staff interviews, and 11 community partner interviews. Data analysis is expected to be completed by October 2022. CONCLUSIONS: This evaluation protocol will provide guidance to other evaluators assessing innovative programs. In its application to the VA FARMS pilot, the evaluation aims to add to existing literature on nature-based therapies and the rehabilitation outcomes of agricultural training programs for veterans. Results will provide programmatic insights on the implementation of pilot programs, along with needed improvements and modifications for the future expansion of VA FARMS and other veteran-focused agricultural programs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/40496.

Enhancing Veteran Community Reintegration Research (ENCORE): Protocol for a Mixed Methods and Stakeholder Engagement Project.

BACKGROUND: Veteran community reintegration (CR) has been defined as participation in community life, including employment or other productive activities, independent living, and social relationships. Veteran CR is a Veterans Health Administration priority, as a substantial proportion of veterans report difficulties with veteran CR following discharge from military service. OBJECTIVE: Enhancing Veteran Community Reintegration Research (ENCORE) is a project funded by Veterans Health Administration's Health Service Research and Development Service. The goal of ENCORE is to maximize veteran and family reintegration by promoting innovative research and knowledge translation (KT) that informs and improves equitable Department of Veterans Affairs (VA) policies, programs, and services. Overall, 2 strategic objectives guide ENCORE activities: mobilize veteran CR research and promote innovation, relevance, and acceleration of veteran CR research and KT. METHODS: ENCORE uses a mixed methods and stakeholder-engaged approach to achieve objectives and to ensure that the KT products generated are inclusive, innovative, and meaningful to stakeholders. Project activities will occur over 5 years (2019-2024) in 5 phases: plan, engage, mobilize, promote, and evaluate. All activities will be conducted remotely owing to the ongoing COVID-19 pandemic. Methods used will include reviewing research funding and literature examining the gaps in veteran CR research, conducting expert informant interviews with VA program office representatives, and assembling and working with a Multistakeholder Partnership (MSP). MSP meetings will use external facilitation services, group facilitation techniques adapted for virtual settings, and a 6-step group facilitation process to ensure successful execution of meetings and accomplishment of goals. RESULTS: As of December 2022, data collection for ENCORE is ongoing, with the team completing interviews with 20 stakeholders from 16 VA program offices providing veteran CR-related services. ENCORE developed and assembled the MSP, reviewed the VA funding portfolio and veteran CR research literature, and conducted a scientific gap analysis. The MSP developed a veteran CR research agenda in 2021 and continues to work with the ENCORE team to prepare materials for dissemination. CONCLUSIONS: The goal of this program is to improve the impact of veteran CR research on policies and programs. Using a stakeholder-engaged process, insights from key stakeholder groups are being incorporated to set a research agenda that is more likely to result in a relevant and responsive veteran CR research program. Future products will include the development of an effective and relevant dissemination plan and the generation of innovative and relevant dissemination products designed for rapid KT. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/42029.

Original Research: What Health Care Staff Who Experienced Assisted Patient Falls Can Teach Us: Implications for Fall and Fall Injury Risk.

PURPOSE: This quality improvement project had three aims: to identify common assisted falls scenarios, describe staff members' experiences with and risk perceptions of such falls, and explore factors that influenced their perceptions. The overarching goal was to gain useful insight for the development of assisted fall-related strategies and policies. METHODS: In the fall of 2020, 16 staff members from 13 health care facilities were purposively recruited and interviewed. Transcript summaries of these interviews, along with secondary narrative data from employee and patient injury databases, were analyzed using thematic content analysis. RESULTS: According to staff members' accounts, assisted falls most commonly took place in patient rooms or bathrooms when patients were ambulating or transferring. The interviewees described assisting falls by grabbing or holding the patient or by using their own body to brace or steady the patient. Interview and secondary narrative data noted various injuries that occurred during assisted fall events. These injuries most often involved the lower back (among staff) and the legs (among patients). Most interviewees perceived that using proper body mechanics would prevent injury. CONCLUSIONS: Interviewees' experiences with assisted falls indicate areas of improvement for fall prevention. The perception that using proper body mechanics will protect staff from injury may be a misconception. Although the literature reports mixed findings concerning whether staff should assist patient falls, this project's results led us to conclude that there is no safe way to physically assist a falling patient without risk of staff injury.

Evaluation of a new assistive technology: the StandBar.

PURPOSE: Evaluate the potential of a wheelchair assistive technology (StandBar) to promote power wheelchair users' ability to safely stand independently from their power wheelchair and determine the impact of the device use on psychological well-being for both power wheelchair users and their caregivers. MATERIALS AND METHODS: A convenience sample of 11 power wheelchair users and caregiver dyads provided study data. Participants included power wheelchair users who were existing StandBar users or currently in training with the StandBar as part of their rehabilitation. Assessments were conducted at baseline and at six-month follow-up and included physiological assessments and functional testing with and without the StandBar. Monthly follow-up phone calls were completed to collect information on adverse events (e.g., falls, hospitalizations, and skin breakdown). A qualitative interview assessed StandBar users' and caregivers' perception at six-month follow-up. RESULTS AND CONCLUSIONS: StandBar use provided power wheelchair users a higher level of independence, confidence, and safety. All participants highly recommended StandBar use to others with similar levels of functional impairment. StandBar use allowed many participants the ability to complete functional tasks that were otherwise not possible without assistance. Qualitative interviews reported improved independence and psychological well-being for StandBar users as well as reduced levels of anxiety and burden of care by caregivers. The StandBar is a cost-effective assistive technology that promotes independence and functionality for power wheelchair users and improves the psychological well-being of users and their caregivers. Implications for RehabilitationStandBar allows power wheelchair users to:Minimize negative effects of immobilization.Increase independence for activities of daily living (grooming, hygiene, toileting, transfers) and instrumental activities of daily living (social experiences).Improve their quality of life through increasing independence and confidence.Reduce need for assistance and corresponding caregiver burden.

Using Geographic Information System Mapping in Emergency Management: Expanding the Role of Nurses in Home Based Primary Care.

The Veterans Health Administration Home Based Primary Care (VHA-HBPC) program serves Veterans with complex, chronic conditions. Emergency management is a concern for VHA-HBPC programs. Geographic information system (GIS) mapping has been implemented for local program operations in 30 locations. An evaluation assessed GIS mapping as a tool in emergency management, including frontline nurses' and nurse leaders' experiences. Nurses' roles included making and using maps for preparedness and response. Maps provided valuable information, including locations of vulnerable patients (eg, ventilator dependent), community emergency resources, and environmental threats (eg, hurricane). Nurses' willingness to embrace this new technology and skill set was notable.

Action Ethnography of Community Reintegration for Veterans and Military Service Members With Traumatic Brain Injury: Protocol for a Mixed Methods Study.

BACKGROUND: Numerous studies of community reintegration (CR) in traumatic brain injury (TBI) have been conducted in civilian populations, but research is limited in veteran and military service member populations. Little is known about how knowledge from civilian studies translates into veterans' experiences and needs. The US Department of Veterans Health Administration (VHA) recognizes the distinctive health care needs of post-9/11 veteran and military service members, particularly with TBI, including the need to bridge health and rehabilitation-related services from acute care and inpatient settings to veteran and military service members' homes and communities to facilitate CR. OBJECTIVE: The goal of this study is to better understand the experiences of veterans with complicated mild, moderate, or severe TBI; their families; and CR workers as veterans and servicemembers transition to and sustain living in communities. This paper describes the rationale, design, and methods used to reach this goal. METHODS: This five-year longitudinal mixed methods study uses both a community-engaged research (CEnR) approach and an ethnographic approach. The sample includes 30 veterans and service members with TBI, 13 family caregivers, 11 CR specialists, 16 key stakeholders, and 82 community events. Interviews and observations are coded and analyzed using hierarchical coding schemes and thematic analysis. Analyses include data from surveys, interviews, and participant observations. Content analysis is used to highlight the complex social context of reintegration and to triangulate quantitative data. Egocentric (personal) social network analysis is used to examine the support system a veteran or service member has in place to facilitate reintegration. RESULTS: Study enrollment and data collection are completed. Data analyses are underway. CONCLUSIONS: The results of this study may provide a heightened understanding of environmental factors affecting CR in complicated mild, moderate, or severe TBI. Veteran, servicemember and family voices and insights provide VHA clinicians and policy makers with an ecological view of CR that is grounded in the life experiences of veterans, military service members, and families. The results of this study provide a roadmap for designing and testing interventions to maximize CR in a variety of domains. The longitudinal ethnographic approach allows for capturing detailed experiences within the naturalistic context. CEnR allows collaborative assessment of the social context of reintegration with community members. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/14170.

Qualitative Inquiry Explores Health-Related Quality of Life of Female Veterans With Post-Traumatic Stress Disorder.

As the number of female veterans increases, health care systems must be prepared to meet the individualized needs of this population. To date, published data on health-related quality of life (HRQOL) of veterans with post-traumatic stress disorder (PTSD) focus on quantitative data and primarily represent the male population. The purpose of this study was to qualitatively explore the impact of PTSD on female veterans' HRQOL. A descriptive qualitative study used focus groups and demographic surveys to achieve data collection in a sample of veterans with PTSD. This report focuses on the analysis of a sample of 12 females to explore PTSD HRQOL experiences unique to female veterans. Female veterans reported several areas in which their HRQOL was impacted adversely in social participation, physical, cognitive, and emotional aspects of their lives. Issues with self-medication and substance abuse were also reported by participants. Female participants' perceptions about Veterans Health Administration were also discussed, highlighting unmet needs when receiving care for PTSD. These data provide unique insights from the perspective of female veterans with PTSD about their HRQOL and receiving care within the Veterans Health Administration health care system. These data can inform future research to better address the needs of female veterans living with PTSD.

A participatory approach to designing and enhancing integrated health information technology systems for veterans: protocol.

BACKGROUND: The Department of Veterans Affairs (VA) has developed health information technologies (HIT) and resources to improve veteran access to health care programs and services, and to support a patient-centered approach to health care delivery. To improve VA HIT access and meaningful use by veterans, it is necessary to understand their preferences for interacting with various HIT resources to accomplish health management related tasks and to exchange information. OBJECTIVE: The objective of this paper was to describe a novel protocol for: (1) developing a HIT Digital Health Matrix Model; (2) conducting an Analytic Hierarchy Process called pairwise comparison to understand how and why veterans want to use electronic health resources to complete tasks related to health management; and (3) developing visual modeling simulations that depict veterans' preferences for using VA HIT to manage their health conditions and exchange health information. METHODS: The study uses participatory research methods to understand how veterans prefer to use VA HIT to accomplish health management tasks within a given context, and how they would like to interact with HIT interfaces (eg, look, feel, and function) in the future. This study includes two rounds of veteran focus groups with self-administered surveys and visual modeling simulation techniques. This study will also convene an expert panel to assist in the development of a VA HIT Digital Health Matrix Model, so that both expert panel members and veteran participants can complete an Analytic Hierarchy Process, pairwise comparisons to evaluate and rank the applicability of electronic health resources for a series of health management tasks. RESULTS: This protocol describes the iterative, participatory, and patient-centered process for: (1) developing a VA HIT Digital Health Matrix Model that outlines current VA patient-facing platforms available to veterans, describing their features and relevant contexts for use; and (2) developing visual model simulations based on direct veteran feedback that depict patient preferences for enhancing the synchronization, integration, and standardization of VA patient-facing platforms. Focus group topics include current uses, preferences, facilitators, and barriers to using electronic health resources; recommendations for synchronizing, integrating, and standardizing VA HIT; and preferences on data sharing and delegation within the VA system. CONCLUSIONS: This work highlights the practical, technological, and personal factors that facilitate and inhibit use of current VA HIT, and informs an integrated system redesign. The Digital Health Matrix Model and visual modeling simulations use knowledge of veteran preferences and experiences to directly inform enhancements to VA HIT and provide a more holistic and integrated user experience. These efforts are designed to support the adoption and sustained use of VA HIT to support patient self-management and clinical care coordination in ways that are directly aligned with veteran preferences.

Implications for patient safety in the use of safe patient handling equipment: a national survey.

BACKGROUND: The prevalence of musculoskeletal injuries among nursing staff has been high due to patient handling and movement. Internationally, healthcare organizations are integrating technological equipment into patient handling and movement to improve safety. Although evidence shows that safe patient handling programs reduce work-related musculoskeletal injuries in nursing staff, it is not clear how safe these new programs are for patients. OBJECTIVES: The objective of this study was to explore adverse patient events associated with safe patient handling programs and preventive approaches in US Veterans Affairs medical centers. METHODS: The study surveyed a convenience sample of safe patient handling program managers from 51 US Department of Veterans Affairs medical centers to collect data on skin-related and fall-related adverse patient events. RESULTS: Both skin- and fall-related adverse patient events associated with safe patient handling occurred at VA Medical centers. Skin-related events included abrasions, contusions, pressure ulcers and lacerations. Fall-related events included sprains and strains, fractures, concussions and bleeding. Program managers described contextual factors in these adverse events and ways of preventing the events. CONCLUSIONS: The use of safe patient handling equipment can pose risks for patients. This study found that organizational factors, human factors and technology factors were associated with patient adverse events. The findings have implications for how nursing professionals can implement safe patient handling programs in ways that are safe for both staff and patients.

Perceived Benefits of Group Exercise Among Individuals With Peripheral Neuropathy.

Exercise and training programs improve strength, functional balance, and prevent falls in a variety of populations. This article presents the qualitative findings related to the perceived benefits of participants in a randomized controlled trial that compared the effectiveness of group exercise on gait and balance in persons with peripheral neuropathy (PN). Participants with moderately severe PN were randomized into groups that received 10-week classes of Functional Balance Training (FBT) or Tai Chi or education alone. Perceptions of the intervention were overwhelmingly positive regardless of the study group. Perceived benefits reported by participants in the FBT and Tai Chi groups included awareness of how to deal with the effects of neuropathy by implementing balance strategies and a heightened sense of walking to prevent falls. This study offers a guide to design future exercise studies that promote simple balance exercises that can be performed in group settings.

Bearing the burden: deployment stress among army national guard chaplains.

Military Chaplains are a critical component of behavioral health and spiritual support in combat operations. Support of combat operations has taken a toll on these caregivers. The purpose of this study was to explore the impact of deployment on the psychosocial and health characteristics and reintegration of Army National Guard (ARNG) chaplains. Seventy-four ARNG chaplains participated in an anonymous, online survey. Results were categorized into two mutually exclusive groups, combat deployed and non-combat deployed. Although both groups tended to present similar results, Combat deployed group chaplains were significantly more likely to be of higher rank, have served in a pastoral role in the ARNG longer, and present with higher scores for combat exposure, resilience, and alcohol use. Further, five and seven participants, respectively, the majority of whom were from the combat deployed group, endorsed "frequently" or "a great deal" to negative religious coping. These endorsements of abandonment may relate back to Reserve component specific deployment concerns.

Using ensemble models to classify the sentiment expressed in suicide notes.

In 2007, suicide was the tenth leading cause of death in the U.S. Given the significance of this problem, suicide was the focus of the 2011 Informatics for Integrating Biology and the Bedside (i2b2) Natural Language Processing (NLP) shared task competition (track two). Specifically, the challenge concentrated on sentiment analysis, predicting the presence or absence of 15 emotions (labels) simultaneously in a collection of suicide notes spanning over 70 years. Our team explored multiple approaches combining regular expression-based rules, statistical text mining (STM), and an approach that applies weights to text while accounting for multiple labels. Our best submission used an ensemble of both rules and STM models to achieve a micro-averaged F(1) score of 0.5023, slightly above the mean from the 26 teams that competed (0.4875).