International Perspectives of Extended Genetic Sequencing When Used as Part of Newborn Screening to Identify Cystic Fibrosis.

There is increasing interest in using extended genetic sequencing (EGS) in newborn screening (NBS) for cystic fibrosis (CF). How this is implemented will change the number of children being given an uncertain outcome of CRMS/CFSPID (cystic fibrosis transmembrane conductance regulator (CFTR)-related metabolic syndrome/CF Screen Positive Inconclusive Diagnosis), probable carrier results, and the number of missed CF diagnoses. An international survey of CF health professionals was used to gather views on two approaches to EGS-specific (may reduce detection of CRMS/CFSID but miss some CF cases) versus sensitive (may increase detection of CRMS/CFSPID but avoid missing more CF cases). Health professionals acknowledged the anxiety caused to parents (and health professionals) from the uncertainty surrounding the prognosis and management of CRMS/CFSPID. However, most preferred the sensitive approach, as overall, identifying more cases of CRMS/CFSPID was viewed as less physically and psychologically damaging than a missed case of CF. The importance of early diagnosis and treatment for CF to ensure better health outcomes and reducing diagnostic odysseys for parents were highlighted. A potential benefit to identifying more children with CRMS/CFSPID included increasing knowledge to obtain a better understanding of how these children should best be managed in the future.

Development of a Performance Monitoring Instrument for Rating Explosives Search Dog Performance.

The growing body of working dog literature includes many examples of scales robustly developed to measure aspects of dog behavior. However, when comparing behavior to working dog ability, most studies rely on training organizations' own long-established ratings of performance, or simply pass/fail at selection or certification as measures of success. Working ability is multifaceted, and it is likely that different aspects of ability are differentially affected by external factors. In order to understand how specific aspects of selection, training, and operations influence a dog's working ability, numerous facets of performance should be considered. An accurate and validated method for quantifying multiple aspects of performance is therefore required. Here, we describe the first stages of formulating a meaningful performance measurement tool for two types of working search dogs. The systematic methodology used was: (1) interviews and workshops with a representative cross-section of stakeholders to produce a shortlist of behaviors integral to current operational performance of vehicle (VS) and high assurance (HAS) search dogs; (2) assessing the reliability and construct validity of the shortlisted behavioral measures (at the behavior and the individual rater level) using ratings of diverse videoed searches by experienced personnel; and (3) selecting the most essential and meaningful behaviors based on their reliability/validity and importance. The resulting performance measurement tool was composed of 12 shortlisted behaviors, most of which proved reliable and valid when assessed by a group of raters. At the individual rater level, however, there was variability between raters in the ability to use and interpret behavioral measures, in particular, more abstract behaviors such as Independence. This illustrates the importance of examining individual rater scores rather than extrapolating from group consensus (as is often done), especially when designing a tool that will ultimately be used by single raters. For ratings to be practically valuable, individual rater reliability needs to be improved, especially for behaviors deemed as essential (e.g., control and confidence). We suggest that the next steps are to investigate why individuals vary in their ratings and to undertake efforts to increase the likelihood that they reach a common conceptualization of each behavioral construct. Plausible approaches are improving the format in which behaviors are presented, e.g., by adding benchmarks and utilizing rater training.

Does Benchmarking of Rating Scales Improve Ratings of Search Performance Given by Specialist Search Dog Handlers?

Rating scales are widely used to rate working dog behavior and performance. Whilst behaviour scales have been extensively validated, instruments used to rate ability have usually been designed by training and practitioner organizations, and often little consideration has been given to how seemingly insignificant aspects of the scale design might alter the validity of the results obtained. Here we illustrate how manipulating one aspect of rating scale design, the provision of verbal benchmarks or labels (as opposed to just a numerical scale), can affect the ability of observers to distinguish between differing levels of search dog performance in an operational environment. Previous studies have found evidence for range restriction (using only part of the scale) in raters' use of the scales and variability between raters in their understanding of the traits used to measures performance. As provision of verbal benchmarks has been shown to help raters in a variety of disciplines to select appropriate scale categories (or scores), it may be predicted that inclusion of verbal benchmarks will bring raters' conceptualization of the traits closer together, increasing agreement between raters, as well as improving the ability of observers to distinguish between differing levels of search dog performance and reduce range restriction. To test the value of verbal benchmarking we compared inter-rater reliability, raters' ability to discriminate between different levels of search dog performance, and their use of the whole scale before and after being presented with benchmarked scales for the same traits. Raters scored the performance of two separate types of explosives search dog (High Assurance Search (HAS) and Vehicle Search (VS) dogs), from short (~30 s) video clips, using 11 previously validated traits. Taking each trait in turn, for the first five clips raters were asked to give a score from 1, representing the lowest amount of the trait evident to 5, representing the highest. Raters were given a list of adjective-based benchmarks (e.g., very low, low, intermediate, high, very high) and scored a further five clips for each trait. For certain traits, the reliability of scoring improved when benchmarks were provided (e.g., Motivation and Independence), indicating that their inclusion may potentially reduce ambivalence in scoring, ambiguity of meanings, and cognitive difficulty for raters. However, this effect was not universal, with the ratings of some traits remaining unchanged (e.g., Control), or even reducing in reliability (e.g., Distraction). There were also some differences between VS and HAS (e.g., Confidence reliability increased for VS raters and decreased for HAS raters). There were few improvements in the spread of scores across the range, but some indication of more favorable scoring. This was a small study of operational handlers and trainers utilizing training video footage from realistic operational environments, and there are potential cofounding effects. We discuss possible causal factors, including issues specific to raters and possible deficiencies in the chosen benchmarks, and suggest ways to further improve the effectiveness of rating scales. This study illustrates why it is vitally important to validate all aspects of rating scale design, even if they may seem inconsequential, as relatively small changes to the amount and type of information provided to raters can have both positive and negative impacts on the data obtained.

Search Dog Handlers Show Positive Bias When Scoring Their Own Dog's Performance.

Self-assessments of performance are commonly used in the human workplace, although compared to peer or supervisor ratings, they may be subject to positive biases or leniency. The use of subjective ratings scales in animal sciences is also common, although little consideration is usually given to possible rater bias. Dog handlers, work very closely and form strong relationships with their dogs and are also best placed to monitor dog performance since they often work in isolation. Previous work found ratings of search dog performance correlated well between experienced dog trainers, instructors, and scientists; but until now, there has been no investigation into ratings made by a dog's own handler. We compared handlers' subjective assessment of their own dog's search performance to scores given by other handlers and in a second study, to scores made by impartial raters. We found that handlers generally showed leniency; for example scoring their own dogs more favorably for Control (responsiveness to commands) and Strength of Indication. But the degree of bias varied with the trait being scored and between raters. Such differences may be attributable to greater desirability or importance of favorable scores for certain traits, or a lack of clarity of their precise meaning. Handlers may vary in susceptibility to bias due to differing levels of experience and the extent to which they view their dog's ability as dependent on their own. The exact causes require further investigation. We suggest working dog agencies provide rater-training to overcome leniency, improve reliability and validity, and to increase handler's motivation to provide accurate assessments. This study represents one of a series of steps to formulate robust, validated and evidence-based performance rating systems and has relevance to any situation where raters assess their own performance or others (particularly where they may have a vested interest in, or loyalty toward, the ratee).

Factors associated with the presence and prevalence of contagious ovine digital dermatitis: A 2013 study of 1136 random English sheep flocks.

In 2013, a questionnaire was used to gather data on risks for introduction, and factors associated with prevalence, of contagious ovine digital dermatitis (CODD). There were 1136 (28.4%) usable responses from 4000 randomly selected sheep farmers in England. CODD was present in 58% (662) of flocks, with a reported prevalence of CODD lesions of 2.3%. The geometric mean period prevalence of all lameness was 4.2% and 2.8% in CODD positive and negative flocks respectively. Factors associated with a greater risk of presence of CODD were purchasing replacement ewes, not always checking the feet of sheep before purchase, not isolating purchased sheep, foot bathing returning ewes, foot trimming the flock more than twice in the year all compared with not doing these activities and increasing log10 flock size. Farmers who vaccinated sheep with Footvax™ were less likely to report presence of CODD. Factors associated with increasing prevalence of CODD lesions were not always checking the feet of purchased sheep, flocks that mixed with other flocks and sheep that left the farm for summer grazing and later returned. In addition, flocks where farmers followed the current recommended managements for control of footrot, had a lower prevalence of CODD whilst those who used foot bathing and where feet bled during routine foot trimming had a higher prevalence of CODD. The prevalence of CODD decreased with each log10 increase in flock size. We conclude that CODD is an infectious cause of lameness in sheep of increasing importance in GB. Introduction is linked to poor biosecurity with one likely source of the pathogen being introduction of or mixing with infected sheep. As with footrot, prevalence of CODD was lower in flocks where farmers focused on individual treatment to manage lameness and avoided foot bathing and trimming feet. We conclude that most of the currently recommended biosecurity and treatment approaches to control footrot in GB are also effective for control of CODD.