Delivering on a promise: futureproofing automated insect monitoring methods.

Due to rapid technological innovations, the automated monitoring of insect assemblages comes within reach. However, this continuous innovation endangers the methodological continuity needed for calculating reliable biodiversity trends in the future. Maintaining methodological continuity over prolonged periods of time is not trivial, since technology improves, reference libraries grow and both the hard- and software used now may no longer be available in the future. Moreover, because data on many species are collected at the same time, there will be no simple way of calibrating the outputs of old and new devices. To ensure that reliable long-term biodiversity trends can be calculated using the collected data, I make four recommendations: (1) Construct devices to last for decades, and have a five-year overlap period when devices are replaced. (2) Construct new devices to resemble the old ones, especially when some kind of attractant (e.g. light) is used. Keep extremely detailed metadata on collection, detection and identification methods, including attractants, to enable this. (3) Store the raw data (sounds, images, DNA extracts, radar/lidar detections) for future reprocessing with updated classification systems. (4) Enable forward and backward compatibility of the processed data, for example by in-silico data 'degradation' to match the older data quality. This article is part of the theme issue 'Towards a toolkit for global insect biodiversity monitoring'.

Automated detection of methicillin-resistant Staphylococcus aureus with the MRSA CHROM imaging application on BD Kiestra Total Lab Automation System.

The virulence of methicillin-resistant Staphylococcus aureus (MRSA) and its potentially fatal outcome necessitate rapid and accurate detection of patients colonized with MRSA in healthcare settings. Using the BD Kiestra Total Lab Automation (TLA) System in conjunction with the MRSA Application (MRSA App), an imaging application that uses artificial intelligence to interpret colorimetric information (mauve-colored colonies) indicative of MRSA pathogen presence on CHROMagar chromogenic media, anterior nares specimens from three sites were evaluated for the presence of mauve-colored colonies. Results obtained with the MRSA App were compared to manual reading of agar plate images by proficient laboratory technologists. Of 1,593 specimens evaluated, 1,545 (96.98%) were concordant between MRSA App and laboratory technologist reading for the detection of MRSA growth [sensitivity 98.15% (95% CI, 96.03, 99.32) and specificity 96.69% (95% CI, 95.55, 97.60)]. This multi-site study is the first evaluation of the MRSA App in conjunction with the BD Kiestra TLA System. Using the MRSA App, our results showed 98.15% sensitivity and 96.69% specificity for the detection of MRSA from anterior nares specimens. The MRSA App, used in conjunction with laboratory automation, provides an opportunity to improve laboratory efficiency by reducing laboratory technologists' labor associated with the review and interpretation of cultures.

Dense reinforcement learning for safety validation of autonomous vehicles.

One critical bottleneck that impedes the development and deployment of autonomous vehicles is the prohibitively high economic and time costs required to validate their safety in a naturalistic driving environment, owing to the rarity of safety-critical events1. Here we report the development of an intelligent testing environment, where artificial-intelligence-based background agents are trained to validate the safety performances of autonomous vehicles in an accelerated mode, without loss of unbiasedness. From naturalistic driving data, the background agents learn what adversarial manoeuvre to execute through a dense deep-reinforcement-learning (D2RL) approach, in which Markov decision processes are edited by removing non-safety-critical states and reconnecting critical ones so that the information in the training data is densified. D2RL enables neural networks to learn from densified information with safety-critical events and achieves tasks that are intractable for traditional deep-reinforcement-learning approaches. We demonstrate the effectiveness of our approach by testing a highly automated vehicle in both highway and urban test tracks with an augmented-reality environment, combining simulated background vehicles with physical road infrastructure and a real autonomous test vehicle. Our results show that the D2RL-trained agents can accelerate the evaluation process by multiple orders of magnitude (103 to 105 times faster). In addition, D2RL will enable accelerated testing and training with other safety-critical autonomous systems.

Exploration into the Needs and Requirements of the Remote Driver When Teleoperating the 5G-Enabled Level 4 Automated Vehicle in the Real World-A Case Study of 5G Connected and Automated Logistics.

Connected and automated vehicles have the potential to deliver significant environmental, safety, economic and social benefits. The key advancement for automated vehicles with higher levels of automation (SAE Level 4 and over) is fail-operational. One possible solution for the failsafe mode of automated vehicles is a 5G-enabled teleoperation system controlled by remote drivers. However, knowledge is missing regarding understanding of the human-machine interaction in teleoperation from the perspective of remote drivers. To address this research gap, this study qualitatively investigated the acceptance, attitudes, needs and requirements of remote drivers when teleoperating a 5G-enabled Level 4 automated vehicle (5G L4 AV) in the real world. The results showed that remote drivers are positive towards the 5G L4 AV. They would like to constantly monitor the driving when they are not controlling the vehicle remotely. Improving their field of vision for driving and enhancing the perception of physical motion feedback are the two key supports required by remote drivers in 5G L4 AVs. The knowledge gained in this study provides new insights into facilitating the design and development of safe, effective and user-friendly teleoperation systems in vehicle automation.

Quantitative and qualitative workload assessment in steep terrain forest operations: fostering a safer work environment through yarder automation.

Many forestry roles have changed from being manual tasks with a high physical workload to being a machine operator task with a high mental workload. Automation can support a decrease in mental fatigue by removing tasks that are repetitive and monotonous for the operators. Cable yarding presents an ideal opportunity for early adoption of automation technology; specifically the carriage movement along a defined corridor. A Valentini V-850 cable yarder was used in an Italian harvesting setting, in order to gauge the ergonomic benefit of carriage control automation. The study showed that automating yarder carriage movements improved the ergonomic situation of the workers directly involved in the related primary tasks. However, the caveat is that improving one work task may negatively affect the other work tasks, and therefore introducing automation to a worksite must be done after considering all impacts on the whole system. Practitioner summary: Automation decreased the winch operator's mental workload while improving overall productivity. At the same time, the mental and physiological workload of the operator tasked with bucking were slightly increased. Ideally, winch automation should be coupled with bucking mechanisation to balance the intervention and boost both operator well-being and productivity.

Ferrobotic swarms enable accessible and adaptable automated viral testing.

Expanding our global testing capacity is critical to preventing and containing pandemics1-9. Accordingly, accessible and adaptable automated platforms that in decentralized settings perform nucleic acid amplification tests resource-efficiently are required10-14. Pooled testing can be extremely efficient if the pooling strategy is based on local viral prevalence15-20; however, it requires automation, small sample volume handling and feedback not available in current bulky, capital-intensive liquid handling technologies21-29. Here we use a swarm of millimetre-sized magnets as mobile robotic agents ('ferrobots') for precise and robust handling of magnetized sample droplets and high-fidelity delivery of flexible workflows based on nucleic acid amplification tests to overcome these limitations. Within a palm-sized printed circuit board-based programmable platform, we demonstrated the myriad of laboratory-equivalent operations involved in pooled testing. These operations were guided by an introduced square matrix pooled testing algorithm to identify the samples from infected patients, while maximizing the testing efficiency. We applied this automated technology for the loop-mediated isothermal amplification and detection of the SARS-CoV-2 virus in clinical samples, in which the test results completely matched those obtained off-chip. This technology is easily manufacturable and distributable, and its adoption for viral testing could lead to a 10-300-fold reduction in reagent costs (depending on the viral prevalence) and three orders of magnitude reduction in instrumentation cost. Therefore, it is a promising solution to expand our testing capacity for pandemic preparedness and to reimagine the automated clinical laboratory of the future.

A Complete Framework for a Behavioral Planner with Automated Vehicles: A Car-Sharing Fleet Relocation Approach.

Currently, research on automated vehicles is strongly related to technological advances to achieve a safe, more comfortable driving process in different circumstances. The main achievements are focused mainly on highway and interurban scenarios. The urban environment remains a complex scenario due to the number of decisions to be made in a restrictive context. In this context, one of the main challenges is the automation of the relocation process of car-sharing in urban areas, where the management of the platooning and automatic parking and de-parking maneuvers needs a solution from the decision point of view. In this work, a novel behavioral planner framework based on a Finite State Machine (FSM) is proposed for car-sharing applications in urban environments. The approach considers four basic maneuvers: platoon following, parking, de-parking, and platoon joining. In addition, a basic V2V communication protocol is proposed to manage the platoon. Maneuver execution is achieved by implementing both classical (i.e., PID) and Model-based Predictive Control (i.e., MPC) for the longitudinal and lateral control problems. The proposed behavioral planner was implemented in an urban scenario with several vehicles using the Carla Simulator, demonstrating that the proposed planner can be helpful to solve the car-sharing fleet relocation problem in cities.

Biofoundry Palette: Planning-Assistant Software for Liquid Handler-Based Experimentation and Operation in the Biofoundry Workflow.

Lab automation has facilitated synthetic biology applications in an automated workflow, and biofoundry facilities have enabled automated high-throughput experiments of gene cloning and genome engineering to be conducted following a precise experimental design and protocol. However, before-experiment procedures in biofoundry applications have been underdetermined. We aimed to develop a Python-based planning-assistant software, namely Biofoundry Palette, for liquid handler-based experimentation and operation in the biofoundry workflow. Depending on the synthetic biology project, variable information and content information may vary; the Biofoundry Palette provides precise information for the before-experiment units for each process module in the biofoundry workflow. As a demonstration, more than 200 unique information sets, generated by Biofoundry Palette, were used in automated gene cloning or pathway construction. The information on planning and management can potentially help the operator faithfully execute the biofoundry workflow after securing the before-experiment unit, thereby lowering the risk of human errors and performing successful biofoundry operations for synthetic biology applications.

Antha-Guided Automation of Darwin Assembly for the Construction of Bespoke Gene Libraries.

Protein engineering through directed evolutison is facilitated by the screening and characterization of protein libraries. Efficient and effective methods for multiple site-saturation mutagenesis, such as Darwin Assembly, can accelerate the sampling of relevant sequence space and the identification of variants with desired functionalities. Here, we present the automation of the Darwin Assembly method, using a Gilson PIPETMAX™ liquid handling platform under the control of the Antha software platform, which resulted in the accelerated construction of complex, multiplexed gene libraries error-free and with minimal hands-on time, while maintaining flexibility over experimental parameters through a graphical user interface rather than requiring user-driven library-dependent programming of the liquid handling platform. We also present an approach for barcoding libraries that overcomes amplicon length limitations in next generation sequencing and enables fast reconstruction of library reads.

Advancing automation in high-throughput screening: Modular unguarded systems enable adaptable drug discovery.

Challenged by ageing infrastructure and increasingly demanding screening cascades, AstraZeneca High Throughput Screening department has developed advanced automation systems that can support both current needs and future strategies in drug discovery. Through collaboration with HighRes Biosolutions and other third-party vendors, highly versatile automated modular platforms have been designed. Safety features such as collaborative robots allow enhanced system accessibility, and adaptive scheduling software has improved protocol design and system recovery. These innovations have led to significant improvements in system flexibility while maintaining screening productivity.

Pandemic effects to autonomous vehicles test operations in California.

Companies developing automated driving system (ADS) technologies have spent heavily in recent years to conduct live testing of autonomous vehicles operating in real world environments to ensure their reliable and safe operations. However, the unexpected onset and ongoing resurgent effects of the Covid-19 pandemic starting in March 2020 has serve to halt, change, or delay the achievement of these new product development test objectives. This study draws on data obtained from the California automated vehicle test program to determine the extent that testing trends, test resumptions, and test environments have been affected by the pandemic. The importance of government policies to support and enable autonomous vehicles development during pandemic conditions is highlighted.

Automating insect monitoring using unsupervised near-infrared sensors.

Insect monitoring is critical to improve our understanding and ability to preserve and restore biodiversity, sustainably produce crops, and reduce vectors of human and livestock disease. Conventional monitoring methods of trapping and identification are time consuming and thus expensive. Automation would significantly improve the state of the art. Here, we present a network of distributed wireless sensors that moves the field towards automation by recording backscattered near-infrared modulation signatures from insects. The instrument is a compact sensor based on dual-wavelength infrared light emitting diodes and is capable of unsupervised, autonomous long-term insect monitoring over weather and seasons. The sensor records the backscattered light at kHz pace from each insect transiting the measurement volume. Insect observations are automatically extracted and transmitted with environmental metadata over cellular connection to a cloud-based database. The recorded features include wing beat harmonics, melanisation and flight direction. To validate the sensor's capabilities, we tested the correlation between daily insect counts from an oil seed rape field measured with six yellow water traps and six sensors during a 4-week period. A comparison of the methods found a Spearman's rank correlation coefficient of 0.61 and a p-value = 0.0065, with the sensors recording approximately 19 times more insect observations and demonstrating a larger temporal dynamic than conventional yellow water trap monitoring.

Round Trip: An Automated Pipeline for Experimental Design, Execution, and Analysis.

Synthetic biology is a complex discipline that involves creating detailed, purpose-built designs from genetic parts. This process is often phrased as a Design-Build-Test-Learn loop, where iterative design improvements can be made, implemented, measured, and analyzed. Automation can potentially improve both the end-to-end duration of the process and the utility of data produced by the process. One of the most important considerations for the development of effective automation and quality data is a rigorous description of implicit knowledge encoded as a formal knowledge representation. The development of knowledge representation for the process poses a number of challenges, including developing effective human-machine interfaces, protecting against and repairing user error, providing flexibility for terminological mismatches, and supporting extensibility to new experimental types. We address these challenges with the DARPA SD2 Round Trip software architecture. The Round Trip is an open architecture that automates many of the key steps in the Test and Learn phases of a Design-Build-Test-Learn loop for high-throughput laboratory science. The primary contribution of the Round Trip is to assist with and otherwise automate metadata creation, curation, standardization, and linkage with experimental data. The Round Trip's focus on metadata supports fast, automated, and replicable analysis of experiments as well as experimental situational awareness and experimental interpretability. We highlight the major software components and data representations that enable the Round Trip to speed up the design and analysis of experiments by 2 orders of magnitude over prior ad hoc methods. These contributions support a number of experimental protocols and experimental types, demonstrating the Round Trip's breadth and extensibility. We describe both an illustrative use case using the Round Trip for an on-the-loop experimental campaign and overall contributions to reducing experimental analysis time and increasing data product volume in the SD2 program.

Leveraging human agency to improve confidence and acceptability in human-machine interactions.

Repeated interactions with automated systems are known to affect how agents experience their own actions and choices. The present study explores the possibility of partially restoring sense of agency in operators interacting with automated systems by providing additional information about the system's decision, i.e. its confidence. To do so, we implemented an obstacle avoidance task with different levels of automation and explicability. Levels of automation were varied by implementing conditions in which the participant was free or not free to choose which direction to take, whereas levels of explicability were varied by providing or not providing the participant with the system's confidence in the direction to take. We first assessed how automation and explicability interacted with participants' sense of agency, and then tested whether increased self-agency was systematically associated with greater confidence in the decision and improved system acceptability. The results showed an overall positive effect of system assistance. Providing additional information about the system's decision (explicability effect) and reducing the cognitive load associated with the decision itself (automation effect) was associated with stronger sense of agency, greater confidence in the decision, and better performance. In addition to the positive effects of system assistance, acceptability scores revealed that participants perceived "explicable" systems more favorably. These results highlight the potential value of studying self-agency in human-machine interaction as a guideline for making automation technologies more acceptable and, ultimately, improving the usefulness of these technologies.

An Open-Source Modular Framework for Automated Pipetting and Imaging Applications.

The number of samples in biological experiments is continuously increasing, but complex protocols and human error in many cases lead to suboptimal data quality and hence difficulties in reproducing scientific findings. Laboratory automation can alleviate many of these problems by precisely reproducing machine-readable protocols. These instruments generally require high up-front investments, and due to the lack of open application programming interfaces (APIs), they are notoriously difficult for scientists to customize and control outside of the vendor-supplied software. Here, automated, high-throughput experiments are demonstrated for interdisciplinary research in life science that can be replicated on a modest budget, using open tools to ensure reproducibility by combining the tools OpenFlexure, Opentrons, ImJoy, and UC2. This automated sample preparation and imaging pipeline can easily be replicated and established in many laboratories as well as in educational contexts through easy-to-understand algorithms and easy-to-build microscopes. Additionally, the creation of feedback loops, with later pipetting or imaging steps depending on the analysis of previously acquired images, enables the realization of fully autonomous "smart" microscopy experiments. All documents and source files are publicly available to prove the concept of smart lab automation using inexpensive, open tools. It is believed this democratizes access to the power and repeatability of automated experiments.

Adaptable (Not Adaptive) Automation: Forefront of Human-Automation Teaming.

OBJECTIVE: Identify a critical research gap for the human factors community that has implications for successful human-automation teaming. BACKGROUND: There are a variety of approaches for applying automation in systems. Flexible application of automation such that its level and/or type changes during system operations has been shown to enhance human-automation system performance. METHOD: This mini-review describes flexible automation in which the level of automated support varies across tasks during system operation, rather than remaining fixed. Two types distinguish the locus of authority to change automation level: adaptable automation (the human operator assigns how automation is applied) has been found to aid human's situation awareness and provide more perceived control versus adaptive automation (the system assigns automation level) that may impose less workload and attentional demands by automatically adjusting levels in response to changes in one or more states of the human, task, environment, and so on. RESULTS: In contrast to vast investments in adaptive automation approaches, limited research has been devoted to adaptable automation. Experiments directly comparing adaptable and adaptive automation are particularly scant. These few studies show that adaptable automation was not only preferred over adaptive automation, but it also resulted in improved task performance and, notably, less perceived workload. CONCLUSION: Systematic research examining adaptable automation is overdue, including hybrid approaches with adaptive automation. Specific recommendations for further research are provided. APPLICATION: Adaptable automation together with effective human-factored interface designs to establish working agreements are key to enabling human-automation teaming in future complex systems.

The Role of Artificial Intelligence and Machine Learning in Clinical Cardiac Electrophysiology.

In recent years, numerous applications for artificial intelligence (AI) in cardiology have been found, due in part to large digitized data sets and the evolution of high-performance computing. In the discipline of cardiac electrophysiology (EP), a number of clinical, imaging, and electrical waveform data are considered in the diagnosis, prognostication, and management of arrhythmias, which lend themselves well to automation through AI. But equally relevant, AI offers a unique opportunity to discover novel EP concepts and improve clinical care through its inherent, hierarchical tenets of self-learning. In this review we focus on the application of AI in clinical EP and summarize state-of-the art, large, clinical studies in the following key domains: (1) electrocardiogram-based arrhythmia and disease classification; (2) atrial fibrillation source detection; (3) substrate and risk assessment for atrial fibrillation and ventricular tachyarrhythmias; and (4) predicting outcomes after cardiac resynchronization therapy. Many are small, single-centre, proof-of-concept investigations, but they still show ground-breaking performance of deep learning, a subdomain of AI, which surpasses traditional statistical analysis. Larger studies, for instance classifying arrhythmias from electrocardiogram recordings, have further provided external validation of their high accuracy. Ultimately, the performance of AI is dependent on the quality of the input data and the rigour of algorithm development. The field is still nascent and several barriers will need to be overcome, including prospective validation in large, well labelled data sets and more seamless information technology-based data collection/integration, before AI can be adopted into broader clinical EP practice. This review concludes with a discussion of these challenges and future work.

Automated multi-attribute method sample preparation using high-throughput buffer exchange tips.

RATIONALE: The multi-attribute method (MAM) has become a valuable mass spectrometry (MS)-based tool that can identify and quantify the site-specific product attributes and purity information for biotherapeutics such as monoclonal antibodies (mAbs) and fusion molecules in recent years. As we expand the use of the MAM at various stages of drug development, it is critical to enhance the sample preparation throughput without additional chemical modifications and variability. METHODS: In this study, a fully automated MAM sample preparation protocol is presented, where rapid desalting in less than 15 minutes is achieved using miniaturized size-exclusion chromatography columns in pipette tips on an automated liquid handler. The peptide samples were analyzed using an electrospray ionization (ESI) orbitrap mass spectrometer coupled to an ultra-high-performance liquid chromatography (UHPLC) system with a dual column switching system. RESULTS: No significant change was observed in product attributes and their quantities compared with manual, low-artifact sample preparation. The sample recovery using the buffer exchange tips was greatly enhanced over the manual spin cartridges while still demonstrating excellent reproducibility for a wide variety of starting sample concentrations. Unlike a plate desalting system, the individual columns provide flexibility in the number of samples prepared at a time and sample locations within plates. CONCLUSIONS: This automated protocol enables the preparation of up to 96 samples with less "at-bench" time than the manual preparation of a smaller batch of samples, thereby greatly facilitating support of process development and the use of the MAM in quality control.

ZAF, the first open source fully automated feeder for aquatic facilities.

In the past few decades, aquatic animals have become popular model organisms in biology, spurring a growing need for establishing aquatic facilities. Zebrafish are widely studied and relatively easy to culture using commercial systems. However, a challenging aspect of maintaining aquatic facilities is animal feeding, which is both time- and resource-consuming. We have developed an open-source fully automatic daily feeding system, Zebrafish Automatic Feeder (ZAF). ZAF is reliable, provides a standardized amount of food to every tank, is cost-efficient and easy to build. The advanced version, ZAF+, allows for the precise control of food distribution as a function of fish density per tank, and has a user-friendly interface. Both ZAF and ZAF+ are adaptable to any laboratory environment and facilitate the implementation of aquatic colonies. Here, we provide all blueprints and instructions for building the mechanics, electronics, fluidics, as well as to setup the control software and its user-friendly graphical interface. Importantly, the design is modular and can be scaled to meet different user needs. Furthermore, our results show that ZAF and ZAF+ do not adversely affect zebrafish culture, enabling fully automatic feeding for any aquatic facility.