Task complexity and operational risk management in military aviation.

Flight risk assessment has been based on traditional tools that are simple to use but not validated for the consideration of all relevant Complexity Contributing Factors (CCFs). This work aims to improve the process of risk management of missions in military aviation and allow for a more thorough examination of Complexity Contributing Factors (CCFs). After a series of structured workshops, a classification scheme of 46 CCFs was developed and tested in a large number of operational missions (n = 227). Principal Components Analysis has verified four complexity classes that provided a structure for the CCFs while multiple linear regression analysis showed that the four classes of complexity correlated well with mission success outcomes. The study provides evidence that the classification scheme of complexity considers a variety of observable markers (CCFs) which can be used to rate complexity and introduce mission changes that create a safety environment for military missions. Practitioner summary: This study develops a classification scheme of complexity with a large number of observable markers (Complexity Contributing Factors) that can be used to rate the complexity of missions in military aviation. Earlier studies on task complexity and a series of workshops with Subject Matter Experts (SMEs) have been used to develop the classification scheme which was validated with data from a large number of military missions.

Evaluating non-technical skills and mission essential competencies of pilots in military aviation environments.

To develop and validate a classification of non-technical skills (NTS) in military aviation, a study was conducted, using data from real operations of F16 aircraft formations. Phase 1 developed a NTS classification based on the literature review (e.g. NOTECHS) and a workshop with pilots. The Non-TEChnical-MILitary-Skills (NOTEMILS) scheme was tested in Phase 2 in a series of Principal Component Analysis with data from After-Action-Review sessions (i.e. 900 records from a wide range of operations). The NTS were found to make a good prediction of Mission Essential Components (R2 > 0.80) above the effect of experience. Phase 3 undertook a reliability analysis where three raters assessed the NOTEMILS scheme with good results (i.e. all rwg > 0.80). To look into the consistency of classifications, another test indicated that, at least, two out of three raters were in agreement in over 70% of the assessed flight segments. Practitioner Summary: A classification scheme of Non-Technical Skills (NTS) was developed and tested for reliability in military aviation operations. The NTS scheme is a valuable tool for assessing individual and team skills of F-16 pilots in combat. It is noteworthy that the tool had a good capability of predicting Mission Essential Competencies.

A sensemaking perspective on framing the mental picture of air traffic controllers.

It has long been recognized that controller strategies are based on a 'mental picture' or representation of traffic situations. Earlier studies indicated that controllers tend to maintain a selective representation of traffic flows based on a few salient traffic features that point out to interesting events (e.g., potential conflicts). A field study is presented in this paper that examines salient features or 'knowledge variables' that constitute the building blocks of controller mental pictures. Verbal reports from participants, a field experiment and observations of real-life scenarios provided insights into the cognitive processes that shape and reframe the mental pictures of controllers. Several cognitive processes (i.e., problem detection, elaboration, reframing and replanning) have been explored within a particular framework of sensemaking stemming from the data/frame theory (Klein et al., 2007). Cognitive maps, representing standard and non-standard air traffic flows, emerged as an explanatory framework for making sense of traffic patterns and for reframing mental pictures. The data/frame theory proved to be a useful theoretical tool for investigating complex cognitive phenomena. The findings of the study have implications for the design of training curricula and decision support systems in air traffic control systems.

Recursive modeling of loss of control in human and organizational processes: a systemic model for accident analysis.

A recursive model of accident investigation is proposed by exploiting earlier work in systems thinking. Safety analysts can understand better the underlying causes of decision or action flaws by probing into the patterns of breakdown in the organization of safety. For this deeper analysis, a cybernetic model of organizational factors and a control model of human processes have been integrated in this article (i.e., the viable system model and the extended control model). The joint VSM-ECOM framework has been applied to a case study to help safety practitioners with the analysis of patterns of breakdown with regard to how operators and organizations manage goal conflicts, monitor work progress, recognize weak signals, align goals across teams, and adapt plans on the fly. The recursive accident representation brings together several organizational issues (e.g., the dilemma of autonomy versus compliance, or the interaction between structure and strategy) and addresses how operators adapt to challenges in their environment by adjusting their modes of functioning and recovery. Finally, it facilitates the transfer of knowledge from diverse incidents and near misses within similar domains of practice.

A systems perspective of managing error recovery and tactical re-planning of operating teams in safety critical domains.

INTRODUCTION: Research in human error has provided useful tools for designing procedures, training, and intelligent interfaces that trap errors at an early stage. However, this "error prevention" policy may not be entirely successful because human errors will inevitably occur. This requires that the error management process (e.g., detection, diagnosis and correction) must also be supported. Research has focused almost exclusively on error detection; little is known about error recovery, especially in the context of safety critical systems. The aim of this paper is to develop a research framework that integrates error recovery strategies employed by experienced practitioners in handling their own errors. METHOD AND RESULTS: A control theoretic model of human performance was used to integrate error recovery strategies assembled from reviews of the literature, analyses of near misses from aviation and command & control domains, and observations of abnormal situations training at air traffic control facilities. The method of system dynamics has been used to analyze and compare error recovery strategies in terms of patterns of interaction, system affordances, and types of recovery plans. System dynamics offer a promising basis for studying the nature of error recovery management in the context of team interactions and system characteristics. IMPACT ON INDUSTRY: The proposed taxonomy of error recovery strategies can help human factors and safety experts to develop resilient system designs and training solutions for managing human errors in unforeseen situations; it may also help incident investigators to explore why people's actions and assessments were not corrected at the time.

Managing emergencies and abnormal situations in air traffic control (part II): teamwork strategies.

Team performance has been studied in many safety-critical organizations including aviation, nuclear power plant, offshore oil platforms and health organizations. This study looks into teamwork strategies that air traffic controllers employ to manage emergencies and abnormal situations. Two field studies were carried out in the form of observations of simulator training in emergency and unusual scenarios of novices and experienced controllers. Teamwork strategies covered aspects of team orientation and coordination, information exchange, change management and error handling. Several performance metrics were used to rate the efficiency of teamwork and test the construct validity of a prototype model of teamwork. This is a companion study to an earlier investigation of taskwork strategies in the same field (part I) and contributes to the development of a generic model for Taskwork and Teamwork strategies in Emergencies in Air traffic Management (T(2)EAM). Suggestions are made on how to use T(2)EAM to develop training programs, assess team performance and improve mishap investigations.

Managing emergencies and abnormal situations in air traffic control (part I): taskwork strategies.

A lot of research in Air Traffic Control (ATC) has focused on human errors in decision making whilst little attention has been paid to the cognitive strategies employed by controllers in managing abnormal situations. This study looks into cognitive strategies in taskwork that enable controllers to become resilient decision-makers. Two field studies were carried out where novice and experienced controllers were observed in simulator training in emergency and unusual scenarios. A prototype model of taskwork strategies in air traffic management was developed and its construct validity was tested in the context of the field studies. A companion study (part II), follows that investigates aspects of teamwork in the same field and contributes to the development of a generic model of Taskwork & Teamwork strategies in Emergencies in Air traffic Management (T(2)EAM). The final section addresses the difficulties experienced by novice controllers and explains taskwork strategies employed by experts to manage uncertainty and balance workload in simulator emergencies.

Patterns of driver stress and coping strategies in a Greek sample and their relationship to aberrant behaviors and traffic accidents.

This paper presents an investigation into the relationship between driver stress, coping strategies and aberrant driving of a Greek sample of company employees (N=714). The results supported the main factor structures of the Driver Behavior Inventory (Matthews, G., Tsuda, A., Xin, G., Ozeki, Y., 1999. Individual differences in driver stress vulnerability in a Japanese sample. Ergonomics 42, 401-415) and Driver Behavior Questionnaire (Kontogiannis, T., Kossiavelou, Z., Marmaras, N., 2002. Self-reports of aberrant behavior on the roads: errors and violations in a sample of Greek drivers. Accident Anal. Prev. 34, 391-399). An inventory of coping strategies was also examined in terms of self reports. Confrontive coping was characteristic of drivers high on aggression who also had higher rates of mistakes and violations. Coping in terms of self-criticism was exhibited by drivers high on dislike of driving (i.e., anxiety) who reported a higher incidence of mistakes. Task-focus coping was characteristic of alertness and had a weak correlation with confidence. Drivers high in confidence reported fewer mistakes and violations which, in association with low perception of risk, was a particularly worrying aspect of driving. A contextual model of accident involvement was tested with LISREL in which violations yielded a direct effect whilst aggression yielded an indirect effect mediated by violations. Alertness and confidence were both related to safety orientation but failed to predict accident rates and speeding convictions.

Self-reports of aberrant behaviour on the roads: errors and violations in a sample of Greek drivers.

Recent studies have shown that unsafe driver acts can be classified into two distinct categories (i.e.. errors and violations) entailing different measures for reducing road traffic accidents. A survey of over 1,400 drivers in Greece is reported in which a variety of aberrant driving behaviours have been identified. The present study has confirmed the results of earlier studies in the driving populations of Britain. Australia and Sweden that errors and violations are the major determinants in the factor structure of aberrant behaviours. Three types of violations were identified including, highway code-, aggressive- and parking-violations (or situational violations). Mistakes and lapses were two major forms of errors. The factor analysis identified another two classes of behaviour that could not be accounted for very well by the error-violation distinction. One class of behaviours referred to a state of low preparedness and negligence while the other class referred to communication errors and 'social disregard' for the other road users. Each class of behaviour was found to have different demographic correlates. Finally, accident liability was predicted by self-reported tendency to commit highway-code violations, but not by tendency to make errors due to failures of judgement (i.e.. mistakes) or lapses. Aggressive violations were significantly related to involvement in speeding convictions and law-breaking whilst highway-code violations were related to speeding convictions only.