Sensor-based characterization of construction and demolition waste at high occupancy densities using synthetic training data and deep learning.

Sensor-based monitoring of construction and demolition waste (CDW) streams plays an important role in recycling (RC). Extracted knowledge about the composition of a material stream helps identifying RC paths, optimizing processing plants and form the basis for sorting. To enable economical use, it is necessary to ensure robust detection of individual objects even with high material throughput. Conventional algorithms struggle with resulting high occupancy densities and object overlap, making deep learning object detection methods more promising. In this study, different deep learning architectures for object detection (Region-based CNN/Region-based Convolutional Neural Network (Faster R-CNN), You only look once (YOLOv3), Single Shot MultiBox Detector (SSD)) are investigated with respect to their suitability for CDW characterization. A mixture of brick and sand-lime brick is considered as an exemplary waste stream. Particular attention is paid to detection performance with increasing occupancy density and particle overlap. A method for the generation of synthetic training images is presented, which avoids time-consuming manual labelling. By testing the models trained on synthetic data on real images, the success of the method is demonstrated. Requirements for synthetic training data composition, potential improvements and simplifications of different architecture approaches are discussed based on the characteristic of the detection task. In addition, the required inference time of the presented models is investigated to ensure their suitability for use under real-time conditions.

Determination of Sugars and Acids in Grape Must Using Miniaturized Near-Infrared Spectroscopy.

An automatic determination of grape must ingredients during the harvesting process would support cellar logistics and enables an early termination of the harvest if quality parameters are not met. One of the most important quality-determining characteristics of grape must is its sugar and acid content. Among others, the sugars in particular determine the quality of the must and wine. Chiefly in wine cooperatives, in which a third of all German winegrowers are organized, these quality characteristics serve as the basis for payment. They are acquired upon delivery at the cellar of the cooperative or the winery and result in the acceptance or rejection of grapes and must. The whole process is very time-consuming and expensive, and sometimes grapes that do not meet the quality requirements for sweetness, acidity, or healthiness are destroyed or not used at all, which leads to economic loss. Near-infrared spectroscopy is now a widely used technique to detect a wide variety of ingredients in biological samples. In this study, a miniaturized semi-automated prototype apparatus with a near-infrared sensor and a flow cell was used to acquire spectra (1100 nm to 1350 nm) of grape must at defined temperatures. Data of must samples from four different red and white Vitis vinifera (L.) varieties were recorded throughout the whole growing season of 2021 in Rhineland Palatinate, Germany. Each sample consisted of 100 randomly sampled berries from the entire vineyard. The contents of the main sugars (glucose and fructose) and acids (malic acid and tartaric acid) were determined with high-performance liquid chromatography. Chemometric methods, using partial least-square regression and leave-one-out cross-validation, provided good estimates of both sugars (RMSEP = 6.06 g/L, R2 = 89.26%), as well as malic acid (RMSEP = 1.22 g/L, R2 = 91.10%). The coefficient of determination (R2) was comparable for glucose and fructose with 89.45% compared to 89.08%, respectively. Although tartaric acid was predictable for only two of the four varieties using near-infrared spectroscopy, calibration and validation for malic acid were accurate for all varieties in an equal extent like the sugars. These high prediction accuracies for the main quality determining grape must ingredients using this miniaturized prototype apparatus might enable an installation on a grape harvester in the future.

An Extended Modular Processing Pipeline for Event-Based Vision in Automatic Visual Inspection.

Dynamic Vision Sensors differ from conventional cameras in that only intensity changes of individual pixels are perceived and transmitted as an asynchronous stream instead of an entire frame. The technology promises, among other things, high temporal resolution and low latencies and data rates. While such sensors currently enjoy much scientific attention, there are only little publications on practical applications. One field of application that has hardly been considered so far, yet potentially fits well with the sensor principle due to its special properties, is automatic visual inspection. In this paper, we evaluate current state-of-the-art processing algorithms in this new application domain. We further propose an algorithmic approach for the identification of ideal time windows within an event stream for object classification. For the evaluation of our method, we acquire two novel datasets that contain typical visual inspection scenarios, i.e., the inspection of objects on a conveyor belt and during free fall. The success of our algorithmic extension for data processing is demonstrated on the basis of these new datasets by showing that classification accuracy of current algorithms is highly increased. By making our new datasets publicly available, we intend to stimulate further research on application of Dynamic Vision Sensors in machine vision applications.

SmartSpectrometer-Embedded Optical Spectroscopy for Applications in Agriculture and Industry.

The ongoing digitization of industry and agriculture can benefit significantly from optical spectroscopy. In many cases, optical spectroscopy enables the estimation of properties such as substance concentrations and compositions. Spectral data can be acquired and evaluated in real time, and the results can be integrated directly into process and automation units, saving resources and costs. Multivariate data analysis is needed to integrate optical spectrometers as sensors. Therefore, a spectrometer with integrated artificial intelligence (AI) called SmartSpectrometer and its interface is presented. The advantages of the SmartSpectrometer are exemplified by its integration into a harvesting vehicle, where quality is determined by predicting sugar and acid in grapes in the field.

Non-destructive quantification of key quality characteristics in individual grapevine berries using near-infrared spectroscopy.

It is crucial for winegrowers to make informed decisions about the optimum time to harvest the grapes to ensure the production of premium wines. Global warming contributes to decreasing acidity and increasing sugar levels in grapes, resulting in bland wines with high contents of alcohol. Predicting quality in viticulture is thus pivotal. To assess the average ripeness, typically a sample of one hundred berries representative for the entire vineyard is collected. However, this process, along with the subsequent detailed must analysis, is time consuming and expensive. This study focusses on predicting essential quality parameters like sugar and acid content in Vitis vinifera (L.) varieties 'Chardonnay', 'Riesling', 'Dornfelder', and 'Pinot Noir'. A small near-infrared spectrometer was used measuring non-destructively in the wavelength range from 1 100 nm to 1 350 nm while the reference contents were measured using high-performance liquid chromatography. Chemometric models were developed employing partial least squares regression and using spectra of all four grapevine varieties, spectra gained from berries of the same colour, or from the individual varieties. The models exhibited high accuracy in predicting main quality-determining parameters in independent test sets. On average, the model regression coefficients exceeded 93% for the sugars fructose and glucose, 86% for malic acid, and 73% for tartaric acid. Using these models, prediction accuracies revealed the ability to forecast individual sugar contents within an range of ± 6.97 g/L to ± 10.08 g/L, and malic acid within ± 2.01 g/L to ± 3.69 g/L. This approach indicates the potential to develop robust models by incorporating spectra from diverse grape varieties and berries of different colours. Such insight is crucial for the potential widespread adoption of a handheld near-infrared sensor, possibly integrated into devices used in everyday life, like smartphones. A server-side and cloud-based solution for pre-processing and modelling could thus avoid pitfalls of using near-infrared sensors on unknown varieties and in diverse wine-producing regions.

Handheld Spectral Sensing Devices Should Not Mislead Consumers as Far as Non-Authentic Food Is Concerned: A Case Study with Adulteration of Milk Powder.

With the rising trend of consumers being offered by start-up companies portable devices and applications for checking quality of purchased products, it appears of paramount importance to assess the reliability of miniaturized sensors embedded in such devices. Here, eight sensors were assessed for food fraud applications in skimmed milk powder. The performance was evaluated with dry- and wet-blended powders mimicking adulterated materials by addition of either ammonium sulfate, semicarbazide, or cornstarch in the range 0.5-10% of profit. The quality of the spectra was assessed for an adequate identification of the outliers prior to a deep assessment of performance for both non-targeted (soft independent modelling of class analogy, SIMCA) and targeted analyses (partial least square regression with orthogonal signal correction, OPLS). Here, we show that the sensors have generally difficulties in detecting adulterants at ca. 5% supplementation, and often fail in achieving adequate specificity and detection capability. This is a concern as they may mislead future users, particularly consumers, if they are intended to be developed for handheld devices available publicly in smartphone-based applications.