Application of Queueing Theory to the Analysis of Changes in Outpatients' Waiting Times in Hospitals Introducing EMR.

OBJECTIVES: This research used queueing theory to analyze changes in outpatients' waiting times before and after the introduction of Electronic Medical Record (EMR) systems. METHODS: We focused on the exact drawing of two fundamental parameters for queueing analysis, arrival rate (λ) and service rate (µ), from digital data to apply queueing theory to the analysis of outpatients' waiting times. We used outpatients' reception times and consultation finish times to calculate the arrival and service rates, respectively. RESULTS: Using queueing theory, we could calculate waiting time excluding distorted values from the digital data and distortion factors, such as arrival before the hospital open time, which occurs frequently in the initial stage of a queueing system. We analyzed changes in outpatients' waiting times before and after the introduction of EMR using the methodology proposed in this paper, and found that the outpatients' waiting time decreases after the introduction of EMR. More specifically, the outpatients' waiting times in the target public hospitals have decreased by rates in the range between 44% and 78%. CONCLUSIONS: It is possible to analyze waiting times while minimizing input errors and limitations influencing consultation procedures if we use digital data and apply the queueing theory. Our results verify that the introduction of EMR contributes to the improvement of patient services by decreasing outpatients' waiting time, or by increasing efficiency. It is also expected that our methodology or its expansion could contribute to the improvement of hospital service by assisting the identification and resolution of bottlenecks in the outpatient consultation process.

Diffusion of Electronic Medical Record Based Public Hospital Information Systems.

OBJECTIVES: This study was conducted to evaluate the adoption behavior of a newly developed Electronic Medical Record (EMR)-based information system (IS) at three public hospitals in Korea with a focus on doctors and nurses. METHODS: User satisfaction scores from four performance layers were analyzed before and two times after the newly develop system was introduced to evaluate the adoption process of the IS with Rogers' diffusion theory. RESULTS: The 'intention to use' scores, the most important indicator for determining whether or not to adopt the IS in Rogers' confirmation stage for doctors, were very high in the third survey (4.21). In addition, the scores for 'reduced medication errors', which is the key indicator for evaluating the success of the IS, increased in the third survey for both doctors and nurses. The factors influencing 'intention to use' with a high odds ratio (>1.5) were the 'frequency of attendance of user training sessions', 'mandatory use of system', 'reduced medication errors', and 'reduced medical record documentation time' for both doctors and nurses. CONCLUSIONS: These findings show that the new EMR-based IS was well accepted by doctors. Both doctors and nurses also positively considered the effects of the new IS on their clinical environments.

Performance evaluation of public hospital information systems by the information system success model.

OBJECTIVES: This study was to evaluate the performance of the newly developed information system (IS) implemented on July 1, 2014 at three public hospitals in Korea. METHODS: User satisfaction scores of twelve key performance indicators of six IS success factors based on the DeLone and McLean IS Success Model were utilized to evaluate IS performance before and after the newly developed system was introduced. RESULTS: All scores increased after system introduction except for the completeness of medical records and impact on the clinical environment. The relationships among six IS factors were also analyzed to identify the important factors influencing three IS success factors (Intention to Use, User Satisfaction, and Net Benefits). All relationships were significant except for the relationships among Service Quality, Intention to Use, and Net Benefits. CONCLUSIONS: The results suggest that hospitals should not only focus on systems and information quality; rather, they should also continuously improve service quality to improve user satisfaction and eventually reach full the potential of IS performance.

Validation of Performance Indicators for Evaluation of Workplace Health Promotion.

PURPOSE: To validate performance indicators for evaluating workplace health promotion (WHP) programs based on a logic model and to analyze the structural relationships between constructs. DESIGN: The study design is cross-sectional. SETTING: Design setting was small manufacturing companies implementing WHP programs provided by the Korea Industrial Health Association. SUBJECTS: Seventeen occupational health experts completed a questionnaire to determine the content validity of indicators. In addition, 58 health care managers completed a questionnaire to determine reliability and construct validation. The response rate was 84.1%. MEASURES: Based on a logic model, 13 constructs of WHP programs were identified: WHP program input, four activities for workplace environment management, two activities for employee health care management, two outputs, and two short-term outcomes. ANALYSIS: Interrater agreement index was used for testing the content validity of indicators. Confirmatory factor analysis was used to test for the reliabilities, and the convergent and discriminant validities. Structuring equation modeling was also used to analyze the relationships among constructs. RESULTS: A total of 35 performance indicators from 11 constructs showed good reliability and validity. All relationships among WHP input, activities, outputs, and short-term outcomes were significant, except for the relationship between environment outputs and short-term outcome. CONCLUSION: These findings illustrate that the logic model and structuring equation modeling can be used to develop and validate performance indicators for planning and evaluation of the WHP program.

Performance analysis of hospital information system of the national health insurance corporation ilsan hospital.

OBJECTIVES: This study evaluated the qualitative and quantitative performances of the newly developed information system which was implemented on November 4, 2011 at the National Health Insurance Corporation Ilsan Hospital. METHODS: Registration waiting time and changes in the satisfaction scores for the key performance indicators (KPI) before and after the introduction of the system were compared; and the economic effects of the system were analyzed by using the information economics approach. RESULTS: After the introduction of the system, the waiting time for registration was reduced by 20%, and the waiting time at the internal medicine department was reduced by 15%. The benefit-to-cost ratio was increased to 1.34 when all intangible benefits were included in the economic analysis. CONCLUSIONS: The economic impact and target satisfaction rates increased due to the introduction of the new system. The results were proven by the quantitative and qualitative analyses carried out in this study. This study was conducted only seven months after the introduction of the system. As such, a follow-up study should be carried out in the future when the system stabilizes.

A Study on User Satisfaction regarding the Clinical Decision Support System (CDSS) for Medication.

OBJECTIVES: Many medication errors can occur when ordering and dispensing medicine in hospitals. The clinical decision support system (CDSS) is widely used in an effort to reduce medication errors. This study focused on the evaluation of user satisfaction with the CDSS for medication at a university hospital. Specifically, this study aimed to identify the factors influencing user satisfaction and to examine user requirements in order to further improve user satisfaction and drug safety. METHODS: The study was based on survey data from 218 users (103 doctors, 103 nurses, and 15 pharmacists) at a university hospital that uses the CDSS. In order to identify the factors influencing user satisfaction with the CDSS, a multiple linear regression was performed. In order to compare the satisfaction level among the professional groups, an analysis of variance (ANOVA) was performed. RESULTS: The reliability of information, decision supporting capability, and departmental support were significant factors in influencing user satisfaction. In addition, nurses were the most satisfied group, followed by pharmacists and doctors according to the ANOVA. Areas for further improvement in enhancing drug safety were real time information searching and decision supporting capabilities to prevent adverse drug events (ADE) in a timely manner. CONCLUSIONS: We found that the CDSS users were generally satisfied with the system and that it complements the nationwide drug utilization review (DUR) system in reducing ADE. Further CDSS evaluation in other hospitals is needed to improve user satisfaction and drug safety.

A comparison of logistic regression analysis and an artificial neural network using the BI-RADS lexicon for ultrasonography in conjunction with introbserver variability.

To determine which Breast Imaging Reporting and Data System (BI-RADS) descriptors for ultrasound are predictors for breast cancer using logistic regression (LR) analysis in conjunction with interobserver variability between breast radiologists, and to compare the performance of artificial neural network (ANN) and LR models in differentiation of benign and malignant breast masses. Five breast radiologists retrospectively reviewed 140 breast masses and described each lesion using BI-RADS lexicon and categorized final assessments. Interobserver agreements between the observers were measured by kappa statistics. The radiologists' responses for BI-RADS were pooled. The data were divided randomly into train (n = 70) and test sets (n = 70). Using train set, optimal independent variables were determined by using LR analysis with forward stepwise selection. The LR and ANN models were constructed with the optimal independent variables and the biopsy results as dependent variable. Performances of the models and radiologists were evaluated on the test set using receiver-operating characteristic (ROC) analysis. Among BI-RADS descriptors, margin and boundary were determined as the predictors according to stepwise LR showing moderate interobserver agreement. Area under the ROC curves (AUC) for both of LR and ANN were 0.87 (95% CI, 0.77-0.94). AUCs for the five radiologists ranged 0.79-0.91. There was no significant difference in AUC values among the LR, ANN, and radiologists (p > 0.05). Margin and boundary were found as statistically significant predictors with good interobserver agreement. Use of the LR and ANN showed similar performance to that of the radiologists for differentiation of benign and malignant breast masses.

The adoption of electronic medical records and decision support systems in Korea.

OBJECTIVES: To examine the current status of hospital information systems (HIS), analyze the effects of Electronic Medical Records (EMR) and Clinical Decision Support Systems (CDSS) have upon hospital performance, and examine how management issues change over time according to various growth stages. METHODS: Data taken from the 2010 survey on the HIS status and management issues for 44 tertiary hospitals and 2009 survey on hospital performance appraisal were used. A chi-square test was used to analyze the association between the EMR and CDSS characteristics. A t-test was used to analyze the effects of EMR and CDSS on hospital performance. RESULTS: Hospital size and top management support were significantly associated with the adoption of EMR. Unlike the EMR results, however, only the standardization characteristic was significantly associated with CDSS adoption. Both EMR and CDSS were associated with the improvement of hospital performance. The EMR adoption rates and outsourcing consistently increased as the growth stage increased. The CDSS, Knowledge Management System, standardization, and user training adoption rates for Stage 3 hospitals were higher than those found for Stage 2 hospitals. CONCLUSIONS: Both EMR and CDSS influenced the improvement of hospital performance. As hospitals advanced to Stage 3, i.e. have more experience with information systems, they adopted EMRs and realized the importance of each management issue.

New integrated information system for pusan national university hospital.

OBJECTIVES: This study presents the information system for Pusan National University Hospital (PNUH), evaluates its performance qualitatively, and conducts economic analysis. METHODS: Information system for PNUH was designed by component-based development and developed by internet technologies. Order Communication System, Electronic Medical Record, and Clinical Decision Support System were newly developed. The performance of the hospital information system was qualitatively evaluated based on the performance reference model in order to identify problem areas for the old system. The Information Economics approach was used to analyze the economic feasibility of hospital information system in order to account for the intangible benefits. RESULTS: Average performance scores were 3.16 for input layer, 3.35 for process layer, and 3.57 for business layer. In addition, the cumulative benefit to cost ratio was 0.50 in 2011, 1.73 in 2012, 1.76 in 2013, 1.71 in 2014, and 1.71 in 2015. The B/C ratios steadily increase as value items are added. CONCLUSIONS: While overall performance scores were reasonably high, doctors were less satisfied with the system, perhaps due to the weak clinical function in the systems. The information economics analysis demonstrated the economic profitability of the information systems if all intangible benefits were included. The second qualitative evaluation survey and economic analysis were proposed to evaluate the changes in performance of the new system.

Burnout and job stress among mongolian doctors and nurses.

Due to the inherent demands of their profession, doctors and nurses are at great risk of suffering from burnout caused by job stress. This study examined the prevalence of burnout among doctors and nurses in Mongolia and identified the factors influencing their burnout. A self-administered questionnaire of 180 doctors (45.9%) and 212 nurses (54.1%) resulted in a response rate of 87%. Burnout was measured by the Copenhagen Burnout Inventory (CBI) in three scales: personal burnout, work-related burnout, and client-related burnout. Job stress was measured by the effort-reward imbalance (ERI) model. Compared with the prior studies of hospital staffs in other countries, doctors and nurses in Mongolia had relatively higher burnout rates, with personal, work-related and client-related average scores of 45.39, 44.45, and 32.46, respectively. Multiple regression analysis revealed that ERI significantly influenced all dimensions of burnout but over-commitment significantly influenced only personal and work-related burnout. Both ERI and over-commitment were different among professions.

Evaluation of a mobile phone-based diet game for weight control.

We developed an interactive mobile-phone based application, SmartDiet, that analyzes daily nutrition intake and patterns of daily exercise. It provides a personalized diet profile and promotes knowledge about nutrition using a diet game. We evaluated the effectiveness of the SmartDiet application in terms of acquiring dietary information, weight control and user satisfaction. A case-control study was conducted over a six-week period, with 19 people in the intervention group and 17 people in the control group. During the study, a total of 235 successful data transmissions were performed from the mobile phones and there was a mean of 12.4 transmissions per participant. The three body composition measures (fat mass, weight and body mass index) decreased significantly after the intervention in the intervention group, but there were no significant changes in the control group. In a questionnaire survey at the end of the study, the majority of the participants responded that the system was useful for obtaining information and managing the diet process. The SmartDiet mobile weight management application appears to contribute to weight loss in obese adults.

Associations between smoking, screening, and death caused by cervical cancer in Korean women.

PURPOSE: Cervical cancer is a major women's health problem in the world today. The purpose of this study was to estimate the incidence and mortality rates and to investigate risk factors for cervical cancer in Korean women. MATERIALS AND METHODS: Reproductive factors, cigarette smoking, as well as the risk of incidence and death from cervical cancer were examined in a 12-year prospective cohort study of 475,398 Korean women aged 30 to 95 years who received health insurance from the National Health Insurance Corporation and who had a medical evaluation in 1992. Relative risks (RR) and 95% confidence intervals (CI) were calculated using the Cox proportional hazards model after adjusting for age, body mass index, cigarette smoking, alcohol use, menarche, parity, and Papanicolaou test status. RESULTS: This study showed that the RR of death due to cervical cancer among current smokers was two times higher compared with non- smokers (RR=2.00; 95% CI, 1.23-2.91). In addition, the RR of death due to cervical cancer among all women who smoked > or = 10 cigarettes/day was 2.4 times higher than the RR among women that had never smoked. More interestingly, those who had never been screened by Papanicolaou smears had twice the risk of death due to cervical cancer (RR =2.00; 95% CI, 1.37-1.81). CONCLUSION: Our prospective study concluded that current smokers had an increased risk of death due to cervical cancer. We suggest that the target age group for cervical cancer screening tests be reconsidered and should begin as early as possible.

Does the physician order-entry system increase the revenue of a general hospital?

OBJECTIVE: The purpose of this study was to examine whether the physician order-entry system (POE) could increase the outpatient and inpatient revenue of hospitals. METHOD: We analyzed the inpatient and outpatient revenue data of all general hospitals (212) in South Korea obtained from the Korean National Health Insurance Corporation (KNHIC) during the period from 1996 to 1999 using the mixed model for repeated measure data. RESULTS: Analysis of the 4-years' panel data showed that both outpatient and inpatient revenues increased significantly after POE introduction. The hospital characteristics significantly influencing inpatient revenue were the number of beds, number of physicians and the tertiary status of a hospital; whereas those for outpatient revenue were the number of beds, number of physicians, the private status of a hospital, the tertiary status of a hospital and the urban status of a hospital. CONCLUSION: The revenues from both outpatients and inpatients were found to be increased after the introduction of the POE, while controlling for population size, competition, income, hospital location, hospital size, tertiary status and public status.

The development of an intelligent laboratory information system for a community health promotion centre.

This study aimed to develop an Intelligent Laboratory Information System (ILIS) for the community health promotion centre in Kwachun city to help process an increasing amount of laboratory test data in an efficient manner, and to support the clinical decision-making of public health doctors. A sample of 170 cases was used for validation of the system. Overall, the system correctly predicted 92.5% of the cases. This paper also analysed the economic feasibility of the ILIS based on the Information Economics approach. The results showed that the ILIS not only helps screen more people by increasing the capacity of a health promotion centre, but also brings in more revenue to the centre.