Automatic method for segmenting leaves by combining 2D and 3D image-processing techniques.

In this study, a method to automatically segment plant leaves from three-dimensional (3D) images using structure from motion is proposed. First, leaves in the 3D images are roughly segmented using a region-growing method in which near points with distances less than 0.2 cm are assigned to the same group. By repeating this process, the leaves not touching each other can be segmented. Then, each segmented leaf is projected onto two-dimensional (2D) images, and the watershed algorithm is executed. This process successfully segments overlapping leaves.

Simple and effective tool for estimating tree trunk diameters and tree species classification.

Tree trunk diameter and tree species are two of the most important parameters in analyzing trees in urban areas and forests. Conventionally, diameters have been measured manually, and the species were determined by sight. An automated tool for these assessments was developed. Tree trunks are automatically detected from captured stereo images. Then, tree trunk diameters are estimated, and the species are determined. The developed graphical user interface tool enables fast and accurate estimation even while one is walking, which reduces the time spent in measuring trees.

Automated tree detection from 3D lidar images using image processing and machine learning.

Trees in 3D images obtained from lidar were automatically extracted in the presence of other objects that were not trees. We proposed a method combining 3D image processing and machine learning techniques for this automatic detection. Consequently, tree detection could be done with 95% accuracy. First, the objects in the 3D images were segmented one by one; then, each of the segmented objects was projected onto 2D images. Finally, the 2D image was classified into "tree" and "not tree" using a one-class support vector machine, and trees in the 3D image were successfully extracted.

Three-Dimensional Monitoring of Plant Structural Parameters and Chlorophyll Distribution.

Image analysis is widely used for accurate and efficient plant monitoring. Plants have complex three-dimensional (3D) structures; hence, 3D image acquisition and analysis is useful for determining the status of plants. Here, 3D images of plants were reconstructed using a photogrammetric approach, called "structure from motion". Chlorophyll content is an important parameter that determines the status of plants. Chlorophyll content was estimated from 3D images of plants with color information. To observe changes in the chlorophyll content and plant structure, a potted plant was kept for five days under a water stress condition and its 3D images were taken once a day. As a result, the normalized Red value and the chlorophyll content were correlated; a high R² value (0.81) was obtained. The absolute error of the chlorophyll content estimation in cross-validation studies was 4.0 × 10-2 µg/mm². At the same time, the structural parameters (i.e., the leaf inclination angle and the azimuthal angle) were calculated by simultaneously monitoring the changes in the plant's status in terms of its chlorophyll content and structural parameters. By combining these parameters related to plant information in plant image analysis, early detection of plant stressors, such as water stress, becomes possible.

Automatic Leaf Segmentation for Estimating Leaf Area and Leaf Inclination Angle in 3D Plant Images.

Automatic and efficient plant monitoring offers accurate plant management. Construction of three-dimensional (3D) models of plants and acquisition of their spatial information is an effective method for obtaining plant structural parameters. Here, 3D images of leaves constructed with multiple scenes taken from different positions were segmented automatically for the automatic retrieval of leaf areas and inclination angles. First, for the initial segmentation, leave images were viewed from the top, then leaves in the top-view images were segmented using distance transform and the watershed algorithm. Next, the images of leaves after the initial segmentation were reduced by 90%, and the seed regions for each leaf were produced. The seed region was re-projected onto the 3D images, and each leaf was segmented by expanding the seed region with the 3D information. After leaf segmentation, the leaf area of each leaf and its inclination angle were estimated accurately via a voxel-based calculation. As a result, leaf area and leaf inclination angle were estimated accurately after automatic leaf segmentation. This method for automatic plant structure analysis allows accurate and efficient plant breeding and growth management.

Classification of soybean chemical characteristics by excitation emission matrix coupled with t-SNE dimensionality reduction.

Measuring the chemical composition in soybeans is time-consuming and laborious, and even simple near-infrared sensors generally require the creation of calibration curves before application. In this study, a new screening method for soybeans without calibration curves was investigated by combining the excitation emission matrix (EEM) and dimensionality reduction analysis. The EEMs of 34 soybean samples were measured, and representative chemical contents including crude protein, crude oil and isoflavone contents were measured by chemical analysis. Two methods of dimensionality reduction: principal component analysis (PCA) and t-distributed Stochastic Neighbor Embedding (t-SNE) were applied on the EEM data to obtain two-dimensional plots, which were divided into two regions with large or small amount of each chemical components. To classify the large or small levels of each of the chemical composition, machine learning classification models were constructed on the two-dimensional plots after dimensionality reduction. As a result, the classification accuracy was higher in t-SNE than in the combinations of PC1 and PC2 from PCA. Furthermore, in t-SNE, the classification accuracy reached over 90% for all the chemical components. From these results, t-SNE dimensionality reduction on the soybean EEM has the potential for easy and accurate screening of soybeans especially based on isoflavone contents.

Prediction of protein and oil contents in soybeans using fluorescence excitation emission matrix.

To investigate the potential of fluorescence spectroscopy in evaluating soybean protein and oil content, excitation emission matrix (EEM) was measured on 34 samples of soybean flours using a front-face measurement, and the accuracy of the protein and oil content prediction was evaluated. The EEM showed four main peaks at excitation/emission (Ex/Em) wavelengths of 230/335, 285/335, 365/475, and 435/495 nm. Furthermore, second derivative synchronous fluorescence (SDSF) spectra were extracted from the EEMs, and partial least square regression and support vector machine models were developed on each of the EEMs and SDSF spectra. The R2 values reached 0.86 and 0.74 for protein and oil, respectively. From the loading spectra, fluorescence at Ex/Em of 230-285/335 nm and 350/500 nm mainly contribute to the protein and oil content prediction, respectively. Those results revealed the potential of fluorescence spectroscopy as a tool for a rapid prediction of soybean protein and oil content.