Digital plant pathology: a foundation and guide to modern agriculture.

Over the last 20 years, researchers in the field of digital plant pathology have chased the goal to implement sensors, machine learning and new technologies into knowledge-based methods for plant phenotyping and plant protection. However, the application of swiftly developing technologies has posed many challenges. Greenhouse and field applications are complex and differ in their study design requirements. Selecting a sensor type (e.g., thermography or hyperspectral imaging), sensor platform (e.g., rovers, unmanned aerial vehicles, or satellites), and the problem-specific spatial and temporal scale adds to the challenge as all pathosystems are unique and differ in their interactions and symptoms, or lack thereof. Adding host-pathogen-environment interactions across time and space increases the complexity even further. Large data sets are necessary to enable a deeper understanding of these interactions. Therefore, modern machine learning methods are developed to realize the fast data analysis of such complex data sets. This reduces not only human effort but also enables an objective data perusal. Especially deep learning approaches show a high potential to identify probable cohesive parameters during plant-pathogen-environment interactions. Unfortunately, the performance and reliability of developed methods are often doubted by the potential user. Gaining their trust is thus needed for real field applications. Linking biological causes to machine learning features and a clear communication, even for non-experts of such results, is a crucial task that will bridge the gap between theory and praxis of a newly developed application. Therefore, we suggest a global connection of experts and data as the basis for defining a common and goal-oriented research roadmap. Such high interconnectivity will likely increase the chances of swift, successful progress in research and practice. A coordination within international excellence clusters will be useful to reduce redundancy of research while supporting the creation and progress of complementary research. With this review, we would like to discuss past research, achievements, as well as recurring and new challenges. Having such a retrospect available, we will attempt to reveal future challenges and provide a possible direction elevating the next decade of research in digital plant pathology.

Quantitative and qualitative phenotyping of disease resistance of crops by hyperspectral sensors: seamless interlocking of phytopathology, sensors, and machine learning is needed!

Determination and characterization of resistance reactions of crops against fungal pathogens are essential to select resistant genotypes. In plant breeding, phenotyping of genotypes is realized by time consuming and expensive visual plant ratings. During resistance reactions and during pathogenesis plants initiate different structural and biochemical defence mechanisms, which partly affect the optical properties of plant organs. Recently, intensive research has been conducted to develop innovative optical methods for an assessment of compatible and incompatible plant pathogen interaction. These approaches, combining classical phytopathology or microbiology with technology driven methods - such as sensors, robotics, machine learning, and artificial intelligence - are summarized by the term digital phenotyping. In contrast to common visual rating, detection and assessment methods, optical sensors in combination with advanced data analysis methods are able to retrieve pathogen induced changes in the physiology of susceptible or resistant plants non-invasively and objectively. Phenotyping disease resistance aims different tasks. In an early breeding step, a qualitative assessment and characterization of specific resistance action is aimed to link it, for example, to a genetic marker. Later, during greenhouse and field screening, the assessment of the level of susceptibility of different genotypes is relevant. Within this review, recent advances of digital phenotyping technologies for the detection of subtle resistance reactions and resistance breeding are highlighted and methodological requirements are critically discussed.

Discovering coherency of specific gene expression and optical reflectance properties of barley genotypes differing for resistance reactions against powdery mildew.

Hyperspectral imaging has proved its potential for evaluating complex plant-pathogen interactions. However, a closer link of the spectral signatures and genotypic characteristics remains elusive. Here, we show relation between gene expression profiles and specific wavebands from reflectance during three barley-powdery mildew interactions. Significant synergistic effects between the hyperspectral signal and the corresponding gene activities has been shown using the linear discriminant analysis (LDA). Combining the data sets of hyperspectral signatures and gene expression profiles allowed a more precise differentiation of the three investigated barley-Bgh interactions independent from the time after inoculation. This shows significant synergistic effects between the hyperspectral signal and the corresponding gene activities. To analyze this coherency between spectral reflectance and seven different gene expression profiles, relevant wavelength bands and reflectance intensities for each gene were computed using the Relief algorithm. Instancing, xylanase activity was indicated by relevant wavelengths around 710 nm, which are characterized by leaf and cell structures. HvRuBisCO activity underlines relevant wavebands in the green and red range, elucidating the coherency of RuBisCO to the photosynthesis apparatus and in the NIR range due to the influence of RuBisCO on barley leaf cell development. These findings provide the first insights to links between gene expression and spectral reflectance that can be used for an efficient non-invasive phenotyping of plant resistance and enables new insights into plant-pathogen interactions.

Monitoring wound healing in a 3D wound model by hyperspectral imaging and efficient clustering.

Wound healing is a complex and dynamic process with different distinct and overlapping phases from homeostasis, inflammation and proliferation to remodelling. Monitoring the healing response of injured tissue is of high importance for basic research and clinical practice. In traditional application, biological markers characterize normal and abnormal wound healing. Understanding functional relationships of these biological processes is essential for developing new treatment strategies. However, most of the present techniques (in vitro or in vivo) include invasive microscopic or analytical tissue sampling. In the present study, a non-invasive alternative for monitoring processes during wound healing is introduced. Within this context, hyperspectral imaging (HSI) is an emerging and innovative non-invasive imaging technique with different opportunities in medical applications. HSI acquires the spectral reflectance of an object, depending on its biochemical and structural characteristics. An in-vitro 3-dimensional (3-D) wound model was established and incubated without and with acute and chronic wound fluid (AWF, CWF), respectively. Hyperspectral images of each individual specimen of this 3-D wound model were assessed at day 0/5/10 in vitro, and reflectance spectra were evaluated. For analysing the complex hyperspectral data, an efficient unsupervised approach for clustering massive hyperspectral data was designed, based on efficient hierarchical decomposition of spectral information according to archetypal data points. It represents, to the best of our knowledge, the first application of an advanced Data Mining approach in context of non-invasive analysis of wounds using hyperspectral imagery. By this, temporal and spatial pattern of hyperspectral clusters were determined within the tissue discs and among the different treatments. Results from non-invasive imaging were compared to the number of cells in the various clusters, assessed by Hematoxylin/Eosin (H/E) staining. It was possible to correlate cell quantity and spectral reflectance during wound closure in a 3-D wound model in vitro.

Spectral Patterns Reveal Early Resistance Reactions of Barley Against Blumeria graminis f. sp. hordei.

Differences in early plant-pathogen interactions are mainly characterized by using destructive methods. Optical sensors are advanced techniques for phenotyping host-pathogen interactions on different scales and for detecting subtle plant resistance responses against pathogens. A microscope with a hyperspectral camera was used to study interactions between Blumeria graminis f. sp. hordei and barley (Hordeum vulgare) genotypes with high susceptibility or resistance due to hypersensitive response (HR) and papilla formation. Qualitative and quantitative assessment of pathogen development was used to explain changes in hyperspectral signatures. Within 48 h after inoculation, genotype-specific changes in the green and red range (500 to 690 nm) and a blue shift of the red-edge inflection point were observed. Manual analysis indicated resistance-specific reflectance patterns from 1 to 3 days after inoculation. These changes could be linked to host plant modifications depending on individual host-pathogen interactions. Retrospective analysis of hyperspectral images revealed spectral characteristics of HR against B. graminis f. sp. hordei. For early HR detection, an advanced data mining approach localized HR spots before they became visible on the RGB images derived from hyperspectral imaging. The link among processes during pathogenesis and host resistance to changes in hyperspectral signatures provide evidence that sensor-based phenotyping is suitable to advance time-consuming and cost-expensive visual rating of plant disease resistances.

Observation of plant-pathogen interaction by simultaneous hyperspectral imaging reflection and transmission measurements.

Hyperspectral imaging sensors are valuable tools for plant disease detection and plant phenotyping. Reflectance properties are influenced by plant pathogens and resistance responses, but changes of transmission characteristics of plants are less described. In this study we used simultaneously recorded reflectance and transmittance imaging data of resistant and susceptible barley genotypes that were inoculated with Blumeria graminis f. sp. hordei to evaluate the added value of imaging transmission, reflection and absorption for characterisation of disease development. These datasets were statistically analysed using principal component analysis, and compared with visual and molecular disease estimation. Reflection measurement performed significantly better for early detection of powdery mildew infection, colonies could be detected 2 days before symptoms became visible in RGB images. Transmission data could be used to detect powdery mildew 2 days after symptoms becoming visible in reflection based RGB images. Additionally distinct transmission changes occurred at 580-650nm for pixels containing disease symptoms. It could be shown that the additional information of the transmission data allows for a clearer spatial differentiation and localisation between powdery mildew symptoms and necrotic tissue on the leaf then purely reflectance based data. Thus the information of both measurement approaches are complementary: reflectance based measurements facilitate an early detection, and transmission measurements provide additional information to better understand and quantify the complex spatio-temporal dynamics of plant-pathogen interactions.