Editorial for the Special Issue "Sensing-Based Biomedical Communication and Intelligent Identification for Healthcare".

The integration of sensor technology in healthcare has become crucial for disease diagnosis and treatment [...].

The effect of green channel for stroke patients on treatment of severe aneurysmal subarachnoid hemorrhage.

PURPOSE: To explore the effect of green channel for stroke patients on the treatment of severe aneurysmal subarachnoid hemorrhage. METHODS: This is a retrospective case-control study. The clinical data of patients with severe aneurysmal subarachnoid hemorrhage admitted to the emergency department of our hospital from January 2015 to June 2022 were retrospectively analyzed. Patients diagnosed with subarachnoid hemorrhage, confirmed intracranial aneurysm by preoperative CT angiography or digital subtraction, graded Hunt-Hess grade III, IV, and V, < 72 h from the onset to the time of consultation received surgical treatment in our hospital were included in this study. Patients with serious underlying diseases, such as heart, liver, kidney diseases, or malignant tumors, traumatic subarachnoid hemorrhage, previous history of cerebral hemorrhage, and incomplete data were excluded. The control group included patients with severe aneurysmal subarachnoid hemorrhage admitted from January 2015 to December 2018 before the establishment of the green channel for stroke patients, and the observation group included patients with severe aneurysmal subarachnoid hemorrhage admitted from January 2019 to June 2022 after the establishment of the green channel. The control group received routine treatment in the emergency department; the observation group received improved treatment of green channel for stroke patients. Gender, age, Hunt-Hess grade on admission, modified Rankin scale (mRS) on admission, aneurysm location, aneurysm size and whether accompanied by intracerebral hemorrhage, the time from onset to emergency department, the time from emergency department to vascular diagnostic examination, the time from onset to surgery, the time from emergency department to surgery, the time from hospital admission to surgery, length of hospital stay, complications, treatment effect were analyzed and compared between the 2 groups. SPSS 23.0 software was utilized to conduct comparisons between the 2 groups. The t-test, Chi-square test, or Mann-Whitney U test was chosen based on the data type. Statistical significance was established when p < 0.05. RESULTS: A total of 71 patients were included in this study, of whom 37 were in the control group and 34 were in the observation group. There were no statistical differences in age, gender, Hunt-Hess grade, mRS scores, aneurysm location, aneurysm size, intracerebral hemorrhage, the time from onset to emergency department, length of hospital stay, complications between the observation group and the control group (all p > 0.05). The time (min) from visit to vascular diagnostic test (60.50 vs. 120.00, p = 0.027), the time (min) from onset to surgery (1792.00 vs. 2868.00, p = 0.023), the time (min) from emergency department to surgery (1568.50 vs. 2778.00, p = 0.016), the time (min) from hospital admission to surgery (1188.50 vs. 2708.00, p = 0.043), all of them were shorter in the observation group than those in the control group. The relative values of admission and 7-day postoperative mRS scores and the relative values of admission and discharge mRS scores ≥ 2 were used as the criteria for determining better efficacy, and the treatment effect was better than that in the control group, and the differences were statistically significant (admission to 7 days postoperative mRS score ≥ 2, 17 (50.0 %) vs. 8 (21.6 %), p = 0.012; admission to discharge mRS score ≥ 2, 19 (55.9 %) vs. 11 (29.7 %), p = 0.026). CONCLUSION: The green channel for stroke patients with severe aneurysmal subarachnoid hemorrhage can effectively shorten the time from arrival at the emergency department to vascular diagnostic examination and the time from the emergency department to surgery, and achieve a better therapeutic effect, which is worth popularizing and applying.

Are Highly Stable Covalent Organic Frameworks the Key to Universal Chiral Stationary Phases for Liquid and Gas Chromatographic Separations?

High-performance liquid chromatography (HPLC) and gas chromatography (GC) over chiral stationary phases (CSPs) represent the most popular and highly applicable technology in the field of chiral separation, but there are currently no CSPs that can be used for both liquid and gas chromatography simultaneously. We demonstrate here that two olefin-linked covalent organic frameworks (COFs) featuring chiral crown ether groups can be general CSPs for extensive separation not only in GC but also in normal-phase and reversed-phase HPLC. Both COFs have the same 2D layered porous structure but channels of different sizes and display high stability under different chemical environments including water, organic solvents, acids, and bases. Chiral crown ethers are periodically aligned within the COF channels, allowing for enantioselective recognition of guest molecules through intermolecular interactions. The COF-packed HPLC and GC columns show excellent complementarity and each affords high resolution, selectivity, and durability for the separation of a wide range of racemic compounds, including amino acids, esters, lactones, amides, alcohols, aldehydes, ketones, and drugs. The resolution performances are comparable to and the versatility is superior to those of the most widely used commercial chiral columns, showing promises for practical applications. This work thus advances COFs with high stability as potential universal CSPs for chromatography that are otherwise hard or impossible to produce.

Feasibility of the automatic ingestion monitor (AIM-2) for infant feeding assessment: a pilot study among breast-feeding mothers from Ghana.

OBJECTIVE: Passive, wearable sensors can be used to obtain objective information in infant feeding, but their use has not been tested. Our objective was to compare assessment of infant feeding (frequency, duration and cues) by self-report and that of the Automatic Ingestion Monitor-2 (AIM-2). DESIGN: A cross-sectional pilot study was conducted in Ghana. Mothers wore the AIM-2 on eyeglasses for 1 d during waking hours to assess infant feeding using images automatically captured by the device every 15 s. Feasibility was assessed using compliance with wearing the device. Infant feeding practices collected by the AIM-2 images were annotated by a trained evaluator and compared with maternal self-report via interviewer-administered questionnaire. SETTING: Rural and urban communities in Ghana. PARTICIPANTS: Participants were thirty eight (eighteen rural and twenty urban) breast-feeding mothers of infants (child age ≤7 months). RESULTS: Twenty-five mothers reported exclusive breast-feeding, which was common among those < 30 years of age (n 15, 60 %) and those residing in urban communities (n 14, 70 %). Compliance with wearing the AIM-2 was high (83 % of wake-time), suggesting low user burden. Maternal report differed from the AIM-2 data, such that mothers reported higher mean breast-feeding frequency (eleven v. eight times, P = 0·041) and duration (18·5 v. 10 min, P = 0·007) during waking hours. CONCLUSION: The AIM-2 was a feasible tool for the assessment of infant feeding among mothers in Ghana as a passive, objective method and identified overestimation of self-reported breast-feeding frequency and duration. Future studies using the AIM-2 are warranted to determine validity on a larger scale.

Improved Wearable Devices for Dietary Assessment Using a New Camera System.

An unhealthy diet is strongly linked to obesity and numerous chronic diseases. Currently, over two-thirds of American adults are overweight or obese. Although dietary assessment helps people improve nutrition and lifestyle, traditional methods for dietary assessment depend on self-report, which is inaccurate and often biased. In recent years, as electronics, information, and artificial intelligence (AI) technologies advanced rapidly, image-based objective dietary assessment using wearable electronic devices has become a powerful approach. However, research in this field has been focused on the developments of advanced algorithms to process image data. Few reports exist on the study of device hardware for the particular purpose of dietary assessment. In this work, we demonstrate that, with the current hardware design, there is a considerable risk of missing important dietary data owing to the common use of rectangular image screen and fixed camera orientation. We then present two designs of a new camera system to reduce data loss by generating circular images using rectangular image sensor chips. We also present a mechanical design that allows the camera orientation to be adjusted, adapting to differences among device wearers, such as gender, body height, and so on. Finally, we discuss the pros and cons of rectangular versus circular images with respect to information preservation and data processing using AI algorithms.

A Novel Approach to Dining Bowl Reconstruction for Image-Based Food Volume Estimation.

Knowing the amounts of energy and nutrients in an individual's diet is important for maintaining health and preventing chronic diseases. As electronic and AI technologies advance rapidly, dietary assessment can now be performed using food images obtained from a smartphone or a wearable device. One of the challenges in this approach is to computationally measure the volume of food in a bowl from an image. This problem has not been studied systematically despite the bowl being the most utilized food container in many parts of the world, especially in Asia and Africa. In this paper, we present a new method to measure the size and shape of a bowl by adhering a paper ruler centrally across the bottom and sides of the bowl and then taking an image. When observed from the image, the distortions in the width of the paper ruler and the spacings between ruler markers completely encode the size and shape of the bowl. A computational algorithm is developed to reconstruct the three-dimensional bowl interior using the observed distortions. Our experiments using nine bowls, colored liquids, and amorphous foods demonstrate high accuracy of our method for food volume estimation involving round bowls as containers. A total of 228 images of amorphous foods were also used in a comparative experiment between our algorithm and an independent human estimator. The results showed that our algorithm overperformed the human estimator who utilized different types of reference information and two estimation methods, including direct volume estimation and indirect estimation through the fullness of the bowl.

An automatic electronic instrument for accurate measurements of food volume and density.

OBJECTIVE: Accurate measurements of food volume and density are often required as 'gold standards' for calibration of image-based dietary assessment and food database development. Currently, there is no specialised laboratory instrument for these measurements. We present the design of a new volume of density (VD) meter to bridge this technological gap. DESIGN: Our design consists of a turntable, a load sensor, a set of cameras and lights installed on an arc-shaped stationary support, and a microcomputer. It acquires an array of food images, reconstructs a 3D volumetric model, weighs the food and calculates both food volume and density, all in an automatic process controlled by the microcomputer. To adapt to the complex shapes of foods, a new food surface model, derived from the electric field of charged particles, is developed for 3D point cloud reconstruction of either convex or concave food surfaces. RESULTS: We conducted two experiments to evaluate the VD meter. The first experiment utilised computer-synthesised 3D objects with prescribed convex and concave surfaces of known volumes to investigate different food surface types. The second experiment was based on actual foods with different shapes, colours and textures. Our results indicated that, for synthesised objects, the measurement error of the electric field-based method was <1 %, significantly lower compared with traditional methods. For real-world foods, the measurement error depended on the types of food volumes (detailed discussion included). The largest error was approximately 5 %. CONCLUSION: The VD meter provides a new electronic instrument to support advanced research in nutrition science.

Hyperandrogenism and insulin resistance-induced fetal loss: evidence for placental mitochondrial abnormalities and elevated reactive oxygen species production in pregnant rats that mimic the clinical features of polycystic ovary syndrome.

KEY POINTS: Women with polycystic ovary syndrome (PCOS) commonly suffer from miscarriage, but the underlying mechanisms remain unknown. Herein, pregnant rats chronically treated with 5α-dihydrotestosterone (DHT) and insulin exhibited hyperandrogenism and insulin resistance, as well as increased fetal loss, and these features are strikingly similar to those observed in pregnant PCOS patients. Fetal loss in our DHT+insulin-treated pregnant rats was associated with mitochondrial dysfunction, disturbed superoxide dismutase 1 and Keap1/Nrf2 antioxidant responses, over-production of reactive oxygen species (ROS) and impaired formation of the placenta. Chronic treatment of pregnant rats with DHT or insulin alone indicated that DHT triggered many of the molecular pathways leading to placental abnormalities and fetal loss, whereas insulin often exerted distinct effects on placental gene expression compared to co-treatment with DHT and insulin. Treatment of DHT+insulin-treated pregnant rats with the antioxidant N-acetylcysteine improved fetal survival but was deleterious in normal pregnant rats. Our results provide insight into the fetal loss associated with hyperandrogenism and insulin resistance in women and suggest that physiological levels of ROS are required for normal placental formation and fetal survival during pregnancy. ABSTRACT: Women with polycystic ovary syndrome (PCOS) commonly suffer from miscarriage, but the underlying mechanism of PCOS-induced fetal loss during pregnancy remains obscure and specific therapies are lacking. We used pregnant rats treated with 5α-dihydrotestosterone (DHT) and insulin to investigate the impact of hyperandrogenism and insulin resistance on fetal survival and to determine the molecular link between PCOS conditions and placental dysfunction during pregnancy. Our study shows that pregnant rats chronically treated with a combination of DHT and insulin exhibited endocrine aberrations such as hyperandrogenism and insulin resistance that are strikingly similar to those in pregnant PCOS patients. Of pathophysiological significance, DHT+insulin-treated pregnant rats had greater fetal loss and subsequently decreased litter sizes compared to normal pregnant rats. This negative effect was accompanied by impaired trophoblast differentiation, increased glycogen accumulation, and decreased angiogenesis in the placenta. Mechanistically, we report that over-production of reactive oxygen species (ROS) in the placenta, mitochondrial dysfunction, and disturbed superoxide dismutase 1 (SOD1) and Keap1/Nrf2 antioxidant responses constitute important contributors to fetal loss in DHT+insulin-treated pregnant rats. Many of the molecular pathways leading to placental abnormalities and fetal loss in DHT+insulin treatment were also seen in pregnant rats treated with DHT alone, whereas pregnant rats treated with insulin alone often exerted distinct effects on placental gene expression compared to insulin treatment in combination with DHT. We also found that treatment with the antioxidant N-acetylcysteine (NAC) improved fetal survival in DHT+insulin-treated pregnant rats, an effect related to changes in Keap1/Nrf2 and nuclear factor-κB signalling. However, NAC administration resulted in fetal loss in normal pregnant rats, most likely due to PCOS-like endocrine abnormality induced by the treatment. Our results suggest that the deleterious effects of hyperandrogenism and insulin resistance on fetal survival are related to a constellation of mitochondria-ROS-SOD1/Nrf2 changes in the placenta. Our findings also suggest that physiological levels of ROS are required for normal placental formation and fetal survival during pregnancy.

Hyperandrogenism and insulin resistance induce gravid uterine defects in association with mitochondrial dysfunction and aberrant reactive oxygen species production.

Women with polycystic ovary syndrome (PCOS) are at increased risk of miscarriage, which often accompanies the hyperandrogenism and insulin resistance seen in these patients. However, neither the combinatorial interaction between these two PCOS-related etiological factors nor the mechanisms of their actions in the uterus during pregnancy are well understood. We hypothesized that hyperandrogensim and insulin resistance exert a causative role in miscarriage by inducing defects in uterine function that are accompanied by mitochondrial-mediated oxidative stress, inflammation, and perturbed gene expression. Here, we tested this hypothesis by studying the metabolic, endocrine, and uterine abnormalities in pregnant rats after exposure to daily injection of 5α-dihydrotestosterone (DHT; 1.66 mg·kg body wt-1·day-1) and/or insulin (6.0 IU/day) from gestational day 7.5 to 13.5. We showed that whereas DHT-exposed and insulin-exposed pregnant rats presented impaired insulin sensitivity, DHT + insulin-exposed pregnant rats exhibited hyperandrogenism and peripheral insulin resistance, which mirrors pregnant PCOS patients. Compared with controls, hyperandrogenism and insulin resistance in the dam were associated with alterations in uterine morphology and aberrant expression of genes responsible for decidualization (Prl8a2, Fxyd2, and Mt1g), placentation (Fcgr3 and Tpbpa), angiogenesis (Flt1, Angpt1, Angpt2, Ho1, Ccl2, Ccl5, Cxcl9, and Cxcl10) and insulin signaling (Akt, Gsk3, and Gluts). Moreover, we observed changes in uterine mitochondrial function and homeostasis (i.e., mitochondrial DNA copy number and the expression of genes responsible for mitochondrial fusion, fission, biogenesis, and mitophagy) and suppression of both oxidative and antioxidative defenses (i.e., reactive oxygen species, Nrf2 signaling, and interactive networks of antioxidative stress responses) in response to the hyperandrogenism and insulin resistance. These findings demonstrate that hyperandrogenism and insulin resistance induce mitochondria-mediated damage and a resulting imbalance between oxidative and antioxidative stress responses in the gravid uterus.

Image-based food portion size estimation using a smartphone without a fiducial marker.

OBJECTIVE: Current approaches to food volume estimation require the person to carry a fiducial marker (e.g. a checkerboard card), to be placed next to the food before taking a picture. This procedure is inconvenient and post-processing of the food picture is time-consuming and sometimes inaccurate. These problems keep people from using the smartphone for self-administered dietary assessment. The current bioengineering study presents a novel smartphone-based imaging approach to table-side estimation of food volume which overcomes current limitations. DESIGN: We present a new method for food volume estimation without a fiducial marker. Our mathematical model indicates that, using a special picture-taking strategy, the smartphone-based imaging system can be calibrated adequately if the physical length of the smartphone and the output of the motion sensor within the device are known. We also present and test a new virtual reality method for food volume estimation using the International Food Unit™ and a training process for error control. RESULTS: Our pilot study, with sixty-nine participants and fifteen foods, indicates that the fiducial-marker-free approach is valid and that the training improves estimation accuracy significantly (P0·05). CONCLUSIONS: Elimination of a fiducial marker and application of virtual reality, the International Food Unit™ and an automated training allowed quick food volume estimation and control of the estimation error. The estimated volume could be used to search a nutrient database and determine energy and nutrients in the diet.

Reliability and validity of food portion size estimation from images using manual flexible digital virtual meshes.

OBJECTIVE: The eButton takes frontal images at 4s intervals throughout the day. A three-dimensional manually administered wire mesh procedure has been developed to quantify portion sizes from the two-dimensional images. The present paper reports a test of the inter-rater reliability and validity of use of the wire mesh procedure. DESIGN: Seventeen foods of diverse shapes and sizes served on plates, bowls and cups were selected to rigorously test the portion assessment procedure. A dietitian not involved in inter-rater reliability assessment used standard cups to independently measure the quantities of foods to generate the 'true' value for a total of seventy-five 'served' and seventy-five smaller 'left' images with diverse portion sizes. SETTING: The images appeared on the computer to which the digital wire meshes were applied. SUBJECTS: Two dietitians and three engineers independently estimated portion size of the larger ('served') and smaller ('left') images for the same foods. RESULTS: The engineers had higher reliability and validity than the dietitians. The dietitians had lower reliabilities and validities for the smaller more irregular images, but the engineers did not, suggesting training could overcome this limitation. The lower reliabilities and validities for foods served in bowls, compared with plates, suggest difficulties with the curved nature of the bowls. CONCLUSIONS: The wire mesh procedure is an important step forward in quantifying portion size, which has been subject to substantial self-report error. Improved training procedures are needed to overcome the identified problems.

Automatic food detection in egocentric images using artificial intelligence technology.

OBJECTIVE: To develop an artificial intelligence (AI)-based algorithm which can automatically detect food items from images acquired by an egocentric wearable camera for dietary assessment. DESIGN: To study human diet and lifestyle, large sets of egocentric images were acquired using a wearable device, called eButton, from free-living individuals. Three thousand nine hundred images containing real-world activities, which formed eButton data set 1, were manually selected from thirty subjects. eButton data set 2 contained 29 515 images acquired from a research participant in a week-long unrestricted recording. They included both food- and non-food-related real-life activities, such as dining at both home and restaurants, cooking, shopping, gardening, housekeeping chores, taking classes, gym exercise, etc. All images in these data sets were classified as food/non-food images based on their tags generated by a convolutional neural network. RESULTS: A cross data-set test was conducted on eButton data set 1. The overall accuracy of food detection was 91·5 and 86·4 %, respectively, when one-half of data set 1 was used for training and the other half for testing. For eButton data set 2, 74·0 % sensitivity and 87·0 % specificity were obtained if both 'food' and 'drink' were considered as food images. Alternatively, if only 'food' items were considered, the sensitivity and specificity reached 85·0 and 85·8 %, respectively. CONCLUSIONS: The AI technology can automatically detect foods from low-quality, wearable camera-acquired real-world egocentric images with reasonable accuracy, reducing both the burden of data processing and privacy concerns.

A Hierarchical Deep Fusion Framework for Egocentric Activity Recognition Using a Wearable Hybrid Sensor System.

Recently, egocentric activity recognition has attracted considerable attention in the pattern recognition and artificial intelligence communities because of its wide applicability in medical care, smart homes, and security monitoring. In this study, we developed and implemented a deep-learning-based hierarchical fusion framework for the recognition of egocentric activities of daily living (ADLs) in a wearable hybrid sensor system comprising motion sensors and cameras. Long short-term memory (LSTM) and a convolutional neural network are used to perform egocentric ADL recognition based on motion sensor data and photo streaming in different layers, respectively. The motion sensor data are used solely for activity classification according to motion state, while the photo stream is used for further specific activity recognition in the motion state groups. Thus, both motion sensor data and photo stream work in their most suitable classification mode to significantly reduce the negative influence of sensor differences on the fusion results. Experimental results show that the proposed method not only is more accurate than the existing direct fusion method (by up to 6%) but also avoids the time-consuming computation of optical flow in the existing method, which makes the proposed algorithm less complex and more suitable for practical application.

Utility of eButton images for identifying food preparation behaviors and meal-related tasks in adolescents.

BACKGROUND: Food preparation skills may encourage healthy eating. Traditional assessment of child food preparation employs self- or parent proxy-reporting methods, which are prone to error. The eButton is a wearable all-day camera that has promise as an objective, passive method for measuring child food preparation practices. PURPOSE: This paper explores the feasibility of the eButton to reliably capture home food preparation behaviors and practices in a sample of pre- and early adolescents (ages 9 to 13). METHODS: This is a secondary analysis of two eButton pilot projects evaluating the dietary intake of pre- and early adolescents in or around Houston, Texas. Food preparation behaviors were coded into seven major categories including: browsing, altering food/adding seasoning, food media, meal related tasks, prep work, cooking and observing. Inter-coder reliability was measured using Cohen's kappa and percent agreement. RESULTS: Analysis was completed on data for 31 participants. The most common activity was browsing in the pantry or fridge. Few participants demonstrated any food preparation work beyond unwrapping of food packages and combining two or more ingredients; actual cutting or measuring of foods were rare. CONCLUSIONS: Although previous research suggests children who "help" prepare meals may obtain some dietary benefit, accurate assessment tools of food preparation behavior are lacking. The eButton offers a feasible approach to food preparation behavior measurement among pre- and early adolescents. Follow up research exploring the validity of this method in a larger sample, and comparisons between cooking behavior and dietary intake are needed.

[Effects of Biejiajian Pill on Proliferation and Apoptosis of Hepatic Stellate Cells in Mice].

Objective To observe the possible mechanism of Biejiajian Pill (BP) in fighting a- gainst hepatic fibrosis of hepatic stellate cell T6 ( HSC-T6) by studying effect of BP containing serum on inhibiting proliferation and inducing apoptosis of HSC-T6. Methods Forty Wistar rats were randomly di- vided into the negative control group (NC) , the positive drug control group (P) , high, middle, and low dose groups (H, M, L) , 8 in each group. BP suspension was administered by gastrogavage to rats in Group H, M, L at 21. 87, 43. 75, and 87. 50 mg/mL, respectively. Rats in Group NC were administered with equal volume of normal saline. Rats in Group P were administered with 0. 01 mg/mL colchicine solu- tion by gastrogavage. Each rat received 2 mL corresponding solution, twice per day, with an interval of 12 h gastrogavage, a total of 7 successive times to prepare drug containing serum. HSC-T6 cells were then randomly divided into drug containing serum groups (group H/M/L/NC) , colchicine positive control group (group P) , and the blank control group (BC). Cells in Group H/M/L/NC/P were fed with correspond- ing drug containing serums, while those in-Group BC were cultured with free drug serum. The proliferation inhibition rate of HSC-T6 was detected using CCK8 method at 24, 48, and 72 h, respectively. The apop- totic rate and cell cycle were detected using flow cytometry. Protein expressions of B cell lymphoma-2 (Bcl-2) and Bcl-2-associated X protein (Bax) were detected using Western blot. Results Compared with Group NC, 24-h proliferation inhibition rate of HSC-T6 was obviously elevated in Group M, H, P (P < 0. 05). Compared with Group NC, 48- and 72-h proliferation inhibition rate of HSC-T6 was obviously ele- vated in Group L, M, H, P (P <0. 05). But there was no statistical difference in 24-, 48-, and 72-h prolif- eration inhibition rate of HSC-T6 among Group L, M, H, P (P >0. 05). Compared with Group NC and BC, early-and late-stage apoptosis rates of HSC-T6 obviously increased in Group M, H, P (P<0. 05) ; G,/G1 phase cell number obviously increased in Group M, H, P (P <0. 05) ; S phase and G2/M phase cell num- bers obviously decreased in Group L, M, H, P (P <0. 05). There was no statistical difference in Bcl-2 protein expression among each group (P>0. 05). Compared with Group NC, Bax protein expression ob- viously increased Group L, M, H, P (P <0. 01). Conclusion The mechanism of BP for fighting against hepatic fibrosis might be associated with inhibiting proliferation of HSC-T6 and inducing apoptosis.

Multiview stereo and silhouette fusion via minimizing generalized reprojection error.

Accurate reconstruction of 3D geometrical shape from a set of calibrated 2D multiview images is an active yet challenging task in computer vision. The existing multiview stereo methods usually perform poorly in recovering deeply concave and thinly protruding structures, and suffer from several common problems like slow convergence, sensitivity to initial conditions, and high memory requirements. To address these issues, we propose a two-phase optimization method for generalized reprojection error minimization (TwGREM), where a generalized framework of reprojection error is proposed to integrate stereo and silhouette cues into a unified energy function. For the minimization of the function, we first introduce a convex relaxation on 3D volumetric grids which can be efficiently solved using variable splitting and Chambolle projection. Then, the resulting surface is parameterized as a triangle mesh and refined using surface evolution to obtain a high-quality 3D reconstruction. Our comparative experiments with several state-of-the-art methods show that the performance of TwGREM based 3D reconstruction is among the highest with respect to accuracy and efficiency, especially for data with smooth texture and sparsely sampled viewpoints.

An adaptive Hidden Markov model for activity recognition based on a wearable multi-sensor device.

Human activity recognition is important in the study of personal health, wellness and lifestyle. In order to acquire human activity information from the personal space, many wearable multi-sensor devices have been developed. In this paper, a novel technique for automatic activity recognition based on multi-sensor data is presented. In order to utilize these data efficiently and overcome the big data problem, an offline adaptive-Hidden Markov Model (HMM) is proposed. A sensor selection scheme is implemented based on an improved Viterbi algorithm. A new method is proposed that incorporates personal experience into the HMM model as a priori information. Experiments are conducted using a personal wearable computer eButton consisting of multiple sensors. Our comparative study with the standard HMM and other alternative methods in processing the eButton data have shown that our method is more robust and efficient, providing a useful tool to evaluate human activity and lifestyle.

Fast single image haze removal via local atmospheric light veil estimation.

In this study, a novel single-image based dehazing framework is proposed to remove haze artifacts from images through local atmospheric light estimation. We use a novel strategy based on a physical model where the extreme intensity of each RGB pixel is used to define an initial atmospheric veil (local atmospheric light veil). Across bilateral filter is applied to each veil to achieve both local smoothness and edge preservation. A transmission map and a reflection component of each RGB channel are constructed from the physical atmospheric scattering model. The proposed approach avoids adverse effects caused by the error in estimating the global atmospheric light. Experimental results on outdoor hazy images demonstrate that the proposed method produces image output with satisfactory visual quality and color fidelity. Our comparative study demonstrates a higher performance of our method over several state-of-the-art methods.

Accuracy of food portion size estimation from digital pictures acquired by a chest-worn camera.

OBJECTIVE: Accurate estimation of food portion size is of paramount importance in dietary studies. We have developed a small, chest-worn electronic device called eButton which automatically takes pictures of consumed foods for objective dietary assessment. From the acquired pictures, the food portion size can be calculated semi-automatically with the help of computer software. The aim of the present study is to evaluate the accuracy of the calculated food portion size (volumes) from eButton pictures. DESIGN: Participants wore an eButton during their lunch. The volume of food in each eButton picture was calculated using software. For comparison, three raters estimated the food volume by viewing the same picture. The actual volume was determined by physical measurement using seed displacement. SETTING: Dining room and offices in a research laboratory. SUBJECTS: Seven lab member volunteers. RESULTS: Images of 100 food samples (fifty Western and fifty Asian foods) were collected and each food volume was estimated from these images using software. The mean relative error between the estimated volume and the actual volume over all the samples was -2·8 % (95 % CI -6·8 %, 1·2 %) with sd of 20·4 %. For eighty-five samples, the food volumes determined by computer differed by no more than 30 % from the results of actual physical measurements. When the volume estimates by the computer and raters were compared, the computer estimates showed much less bias and variability. CONCLUSIONS: From the same eButton pictures, the computer-based method provides more objective and accurate estimates of food volume than the visual estimation method.

Obstacle classification and 3D measurement in unstructured environments based on ToF cameras.

Inspired by the human 3D visual perception system, we present an obstacle detection and classification method based on the use of Time-of-Flight (ToF) cameras for robotic navigation in unstructured environments. The ToF camera provides 3D sensing by capturing an image along with per-pixel 3D space information. Based on this valuable feature and human knowledge of navigation, the proposed method first removes irrelevant regions which do not affect robot's movement from the scene. In the second step, regions of interest are detected and clustered as possible obstacles using both 3D information and intensity image obtained by the ToF camera. Consequently, a multiple relevance vector machine (RVM) classifier is designed to classify obstacles into four possible classes based on the terrain traversability and geometrical features of the obstacles. Finally, experimental results in various unstructured environments are presented to verify the robustness and performance of the proposed approach. We have found that, compared with the existing obstacle recognition methods, the new approach is more accurate and efficient.