Engaging the next generation of physician-informaticians through early exposure to the field: successes and challenges associated with starting a novel clinical informatics interest group.

Clinical informatics remains underappreciated among medical students in part due to a lack of integration into undergraduate medical education (UME). New developments in the study and practice of medicine are traditionally introduced via formal integration into undergraduate medical curricula. While this path has certain advantages, curricular changes are slow and may fail to showcase the breadth of clinical informatics activities. Less formal and more flexible approaches can circumvent these drawbacks. Interest groups (IGs), which are organized through the Association of American Medical College Careers in Medicine (CiM) program, exemplify the informal approach. CiM IGs are student-led groups that provide exposure to different specialty options, acting as an adjunct to the traditional medical curriculum. While the primary purpose of these groups is to assist students applying to residency programs, we took a novel approach of using an IG to increase student exposure to an area of medicine that had not yet been formally integrated at our institution. IGs provide unique advantages to formal integration into a curriculum as they can be more easily setup and can quickly respond to student interests. Furthermore, IGs can act synergistically with UME, acting as proving grounds for ideas that can lead to new courses. We believe that the lessons and takeaways from our experience can act as a guide for those interested in starting similar organizations at their own schools.

A computerized provider order entry intervention for medication safety during acute kidney injury: a quality improvement report.

BACKGROUND: Frequently, prescribers fail to account for changing kidney function when prescribing medications. We evaluated the use of a computerized provider order entry intervention to improve medication management during acute kidney injury. STUDY DESIGN: Quality improvement report with time series analyses. SETTING & PARTICIPANTS: 1,598 adult inpatients with a minimum 0.5-mg/dL increase in serum creatinine level over 48 hours after an order for at least one of 122 nephrotoxic or renally cleared medications. QUALITY IMPROVEMENT PLAN: Passive noninteractive warnings about increasing serum creatinine level appeared within the computerized provider order entry interface and on printed rounding reports. For contraindicated or high-toxicity medications that should be avoided or adjusted, an interruptive alert within the system asked providers to modify or discontinue the targeted orders, mark the current dosing as correct and to remain unchanged, or defer the alert to reappear in the next session. OUTCOMES & MEASUREMENTS: Intervention effect on drug modification or discontinuation, time to modification or discontinuation, and provider interactions with alerts. RESULTS: The modification or discontinuation rate per 100 events for medications included in the interruptive alert within 24 hours of increasing creatinine level improved from 35.2 preintervention to 52.6 postintervention (P < 0.001); orders were modified or discontinued more quickly (P < 0.001). During the postintervention period, providers initially deferred 78.1% of interruptive alerts, although 54% of these eventually were modified or discontinued before patient death, discharge, or transfer. The response to passive alerts about medications requiring review did not significantly change compared with baseline. LIMITATIONS: Single tertiary-care academic medical center; provider actions were not independently adjudicated for appropriateness. CONCLUSIONS: A computerized provider order entry-based alerting system to support medication management after acute kidney injury significantly increased the rate and timeliness of modification or discontinuation of targeted medications.

Desiderata for a computer-assisted audit tool for clinical data source verification audits.

Clinical data auditing often requires validating the contents of clinical research databases against source documents available in health care settings. Currently available data audit software, however, does not provide features necessary to compare the contents of such databases to source data in paper medical records. This work enumerates the primary weaknesses of using paper forms for clinical data audits and identifies the shortcomings of existing data audit software, as informed by the experiences of an audit team evaluating data quality for an international research consortium. The authors propose a set of attributes to guide the development of a computer-assisted clinical data audit tool to simplify and standardize the audit process.

Domains, tasks, and knowledge for health informatics practice: results of a practice analysis.

OBJECTIVE: To develop a comprehensive and current description of what health informatics (HI) professionals do and what they need to know. MATERIALS AND METHODS: Six independent subject-matter expert panels drawn from and representative of HI professionals contributed to the development of a draft HI delineation of practice (DoP). An online survey was distributed to HI professionals to validate the draft DoP. A total of 1011 HI practitioners completed the survey. Survey respondents provided domain, task, knowledge and skill (KS) ratings, qualitative feedback on the completeness of the DoP, and detailed professional background and demographic information. RESULTS: This practice analysis resulted in a validated, comprehensive, and contemporary DoP comprising 5 domains, 74 tasks, and 144 KS statements. DISCUSSION: The HI practice analysis defined "health informatics professionals" to include practitioners with clinical (eg, dentistry, nursing, pharmacy), public health, and HI or computer science training. The affirmation of the DoP by reviewers and survey respondents reflects the emergence of a core set of tasks performed and KSs used by informaticians representing a broad spectrum of those currently practicing in the field. CONCLUSION: The HI practice analysis represents the first time that HI professionals have been surveyed to validate a description of their practice. The resulting HI DoP is an important milestone in the maturation of HI as a profession and will inform HI certification, accreditation, and education activities.

Forecasting emergency department crowding: a prospective, real-time evaluation.

OBJECTIVE: Emergency department crowding threatens quality and access to health care, and a method of accurately forecasting near-future crowding should enable novel ways to alleviate the problem. The authors sought to implement and validate the previously developed ForecastED discrete event simulation for real-time forecasting of emergency department crowding. DESIGN AND MEASUREMENTS: The authors conducted a prospective observational study during a three-month period (5/1/07-8/1/07) in the adult emergency department of a tertiary care medical center. The authors connected the forecasting tool to existing information systems to obtain real-time forecasts of operational data, updated every 10 minutes. The outcome measures included the emergency department waiting count, waiting time, occupancy level, length of stay, boarding count, boarding time, and ambulance diversion; each forecast 2, 4, 6, and 8 hours into the future. RESULTS: The authors obtained crowding forecasts at 13,239 10-minute intervals, out of 13,248 possible (99.9%). The R(2) values for predicting operational data 8 hours into the future, with 95% confidence intervals, were 0.27 (0.26, 0.29) for waiting count, 0.11 (0.10, 0.12) for waiting time, 0.57 (0.55, 0.58) for occupancy level, 0.69 (0.68, 0.70) for length of stay, 0.61 (0.59, 0.62) for boarding count, and 0.53 (0.51, 0.54) for boarding time. The area under the receiver operating characteristic curve for predicting ambulance diversion 8 hours into the future, with 95% confidence intervals, was 0.85 (0.84, 0.86). CONCLUSIONS: The ForecastED tool provides accurate forecasts of several input, throughput, and output measures of crowding up to 8 hours into the future. The real-time deployment of the system should be feasible at other emergency departments that have six patient-level variables available through information systems.

Forecasting emergency department crowding: an external, multicenter evaluation.

STUDY OBJECTIVE: We apply a previously described tool to forecast emergency department (ED) crowding at multiple institutions and assess its generalizability for predicting the near-future waiting count, occupancy level, and boarding count. METHODS: The ForecastED tool was validated with historical data from 5 institutions external to the development site. A sliding-window design separated the data for parameter estimation and forecast validation. Observations were sampled at consecutive 10-minute intervals during 12 months (n=52,560) at 4 sites and 10 months (n=44,064) at the fifth. Three outcome measures-the waiting count, occupancy level, and boarding count-were forecast 2, 4, 6, and 8 hours beyond each observation, and forecasts were compared with observed data at corresponding times. The reliability and calibration were measured following previously described methods. After linear calibration, the forecasting accuracy was measured with the median absolute error. RESULTS: The tool was successfully used for 5 different sites. Its forecasts were more reliable, better calibrated, and more accurate at 2 hours than at 8 hours. The reliability and calibration of the tool were similar between the original development site and external sites; the boarding count was an exception, which was less reliable at 4 of 5 sites. Some variability in accuracy existed among institutions; when forecasting 4 hours into the future, the median absolute error of the waiting count ranged between 0.6 and 3.1 patients, the median absolute error of the occupancy level ranged between 9.0% and 14.5% of beds, and the median absolute error of the boarding count ranged between 0.9 and 2.8 patients. CONCLUSION: The ForecastED tool generated potentially useful forecasts of input and throughput measures of ED crowding at 5 external sites, without modifying the underlying assumptions. Noting the limitation that this was not a real-time validation, ongoing research will focus on integrating the tool with ED information systems.

Peers, regulators, and professions: the influence of organizations in intensive insulin therapy adoption.

INTRODUCTION: Following the landmark Leuven study in 2001, health care organizations implemented intensive insulin therapy (IIT) as the standard of care for critically ill patients. However, a recent meta-analysis showed no mortality benefit and an increased safety risk for patients treated with IIT. IIT affects labor and capital decisions related to nurses, physicians, pharmacists, managers, laboratory personnel, and informatics staff. The expenditure of labor and capital to provide IIT without corresponding outcome improvements suggests the adoption of IIT produces inefficiency in hospital. THEORETICAL BACKGROUND: In sociology and organizational studies, the tendency for organizations to become more similar without necessarily becoming more efficient is called normalfont institutional isomorphism. Institutional isomorphism examines the pressure that organizations encounter from peers, regulators, and professions through mimetic, coercive, and normative mechanisms, respectively. To enhance their prospects of survival, organizations establish and maintain legitimacy by adopting socially acceptable approaches to work endorsed by successful peer organizations, regulatory agencies, and professional societies. ORGANIZATIONAL INFLUENCE IN THE ADOPTION OF IIT: This paper describes how organizational influence-through the Leuven study, the Joint Commission, and professional organizations-played a role in the widespread adoption of IIT. Divergence from institutionalized forms may explain variation in IIT studies following Leuven. CONCLUSION: Health care researchers practitioners, and managers should consider organizational influence when implementing large-scale clinical activities.

Crossing the implementation chasm: a proposal for bold action.

As health care organizations dramatically increase investment in information technology (IT) and the scope of their IT projects, implementation failures become critical events. Implementation failures cause stress on clinical units, increase risk to patients, and result in massive costs that are often not recoverable. At an estimated 28% success rate, the current level of investment defies management logic. This paper asserts that there are "chasms" in IT implementations that represent risky stages in the process. Contributors to the chasms are classified into four categories: design, management, organization, and assessment. The American College of Medical Informatics symposium participants recommend bold action to better understand problems and challenges in implementation and to improve the ability of organizations to bridge these implementation chasms. The bold action includes the creation of a Team Science for Implementation strategy that allows for participation from multiple institutions to address the long standing and costly implementation issues. The outcomes of this endeavor will include a new focus on interdisciplinary research and an inter-organizational knowledge base of strategies and methods to optimize implementations and subsequent achievement of organizational objectives.

Forecasting emergency department crowding: a discrete event simulation.

STUDY OBJECTIVE: To develop a discrete event simulation of emergency department (ED) patient flow for the purpose of forecasting near-future operating conditions and to validate the forecasts with several measures of ED crowding. METHODS: We developed a discrete event simulation of patient flow with evidence from the literature. Development was purely theoretical, whereas validation involved patient data from an academic ED. The model inputs and outputs, respectively, are 6-variable descriptions of every present and future patient in the ED. We validated the model by using a sliding-window design, ensuring separation of fitting and validation data in time series. We sampled consecutive 10-minute observations during 2006 (n=52,560). The outcome measures--all forecast 2, 4, 6, and 8 hours into the future from each observation--were the waiting count, waiting time, occupancy level, length of stay, boarding count, boarding time, and ambulance diversion. Forecasting performance was assessed with Pearson's correlation, residual summary statistics, and area under the receiver operating characteristic curve. RESULTS: The correlations between crowding forecasts and actual outcomes started high and decreased gradually up to 8 hours into the future (lowest Pearson's r for waiting count=0.56; waiting time=0.49; occupancy level=0.78; length of stay=0.86; boarding count=0.79; boarding time=0.80). The residual means were unbiased for all outcomes except the boarding time. The discriminatory power for ambulance diversion remained consistently high up to 8 hours into the future (lowest area under the receiver operating characteristic curve=0.86). CONCLUSION: By modeling patient flow, rather than operational summary variables, our simulation forecasts several measures of near-future ED crowding, with various degrees of good performance.

Next generation pathways into biomedical informatics: lessons from 10 years of the Vanderbilt Biomedical Informatics Summer Internship Program.

OBJECTIVES: To examine roles for summer internship programs in expanding pathways into biomedical informatics, based on 10 years of the Vanderbilt Department of Biomedical Informatics (DBMI) Summer Research Internship Program. MATERIALS AND METHODS: Vanderbilt DBMI's internship program is a research-intensive paid 8-10 week program for high school, undergraduate, and graduate students. The program is grounded in a "Windows, Mirrors, and Open Doors" educational framework, and is guided by an evolving set of design principles, including providing meaningful research experiences, applying a multi-factor approach to diversity, and helping interns build peer connections. RESULTS: Over 10 years, 90 individuals have participated in the internship program, with nine students participating for more than one summer. Of 90 participants, 38 were women and 52 were men. Participants represented a range of racial/ethnic groups. A total of 39 faculty members have served as primary mentor for one or more interns. Five key lessons emerged from our program experience: Festina Lente ("Make haste slowly"), The Power of Community, Learning by Doing, Thoughtful Partnerships Lead to Innovation, and The Whole is More Than the Sum of Its Parts. DISCUSSION: Based on our experience, we suggest that internship programs should become a core element of the biomedical informatics educational ecosystem. Continued development and growth of this important educational outreach approach requires stable funding sources and building connections between programs to share best practices. CONCLUSION: Internship programs can play a substantial role in the biomedical informatics educational ecosystem, helping introduce individuals to the field earlier in their educational trajectories.

Exploring the role of GIS during community health assessment problem solving: experiences of public health professionals.

BACKGROUND: A Community health assessment (CHA) involves the use of Geographic Information Systems (GIS) in conjunction with other software to analyze health and population data and perform numerical-spatial problem solving. There has been little research on identifying how public health professionals integrate this software during typical problem solving scenarios. A better understanding of this is needed to answer the "What" and the "How". The "What" identifies the specific software being used and the "How" explains the way they are integrated together during problem solving steps. This level of understanding will highlight the role of GIS utilization during problem solving and suggest to developers how GIS can be enhanced to better support data analysis during community health assessment. RESULTS: An online survey was developed to identify the information technology used during CHA analysis. The tasks were broken down into steps and for our analysis these steps were categorized by action: Data Management/Access, Data Navigation, Geographic Comparison, Detection of Spatial Boundaries, Spatial Modelling, and Ranking Analysis. 27 CHA professionals completed the survey, with the majority of participants (14) being from health departments. Statistical software (e.g. SPSS) was the most popular software for all but one of the types of steps. For this step (detection of spatial boundaries), GIS was identified as the most popular technology. CONCLUSION: Most CHA professionals indicated they use statistical software in conjunction with GIS. The statistical software appears to drive the analysis, while GIS is used primarily for simple spatial display (and not complex spatial analysis). This purpose of this survey was to thoroughly examine into the process of problem solving during community health assessment data analysis and to gauge how GIS is integrated with other software for this purpose. These findings suggest that GIS is used more for spatial display while other software such as statistical packages (the "What") are used to drive data management, data navigation, and data calculation (the "How"). Focusing at the level of how public health problems are solved, can shed light on how GIS technology can be enhanced to encompass a stronger role during community health assessment problem solving.

Creating advanced health informatics certification.

In 2005, AMIA leaders and members concluded that certification of advanced health informatics professionals would offer value to individual practitioners, organizations that hire them, and society at large. AMIA's work to create advanced informatics certification began by leading a successful effort to create the clinical informatics subspecialty for American Board of Medical Specialties board-certified physicians. Since 2012, AMIA has been working to establish advanced health informatics certification (AHIC) for all health informatics practitioners regardless of their primary discipline. In November 2015, AMIA completed the first of 3 key tasks required to establish AHIC, with the AMIA Board of Directors' endorsement of proposed eligibility requirements. This AMIA Board white paper describes efforts to establish AHIC, reports on the current status of AHIC components, and provides a context for the proposed AHIC eligibility requirements.

Eligibility requirements for advanced health informatics certification.

AMIA is leading the effort to strengthen the health informatics profession by creating an advanced health informatics certification (AHIC) for individuals whose informatics work directly impacts the practice of health care, public health, or personal health. The AMIA Board of Directors has endorsed a set of proposed AHIC eligibility requirements that will be presented to the future AHIC certifying entity for adoption. These requirements specifically establish who will be eligible to sit for the AHIC examination and more generally signal the depth and breadth of knowledge and experience expected from certified individuals. They also inform the development of the accreditation process and provide guidance to graduate health informatics programs as well as individuals interested in pursuing AHIC. AHIC eligibility will be determined by practice focus, education in primary field and health informatics, and significant health informatics experience.

Perceived Reasons for High and Low Quality Observational HIV Research Data.

Audits of data quality in a Latin America HIV research network revealed that study sites collected weight measurements, laboratory results, and medication data of inconsistent quality. We surveyed site personnel about perceived drivers of their high or low quality data. Most sites reported their research teams contained no data specialists and that missing data stemmed primarily from incomplete patient assessments at the point of care rather than inconsistent data recording. The root causes of data errors resulted from limited clinic resources (e.g., broken scales, limited record storage space), workflow complications, or the indifference of external participants towards research activities. Understanding these factors supports targeted quality improvement processes.

A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year.

BACKGROUND: Quantitative studies are becoming more recognized as important to understanding health care with all of its richness and complexities. The purpose of this descriptive survey was to provide a quantitative evaluation of the qualitative studies published in 170 core clinical journals for 2000. METHODS: All identified studies that used qualitative methods were reviewed to ascertain which clinical journals publish qualitative studies and to extract research methods, content (persons and health care issues studied), and whether mixed methods (quantitative and qualitative methods) were used. RESULTS: 60 330 articles were reviewed. 355 reports of original qualitative studies and 12 systematic review articles were identified in 48 journals. Most of the journals were in the discipline of nursing. Only 4 of the most highly cited health care journals, based on ISI Science Citation Index (SCI) Impact Factors, published qualitative studies. 37 of the 355 original reports used both qualitative and quantitative (mixed) methods. Patients and non-health care settings were the most common groups of people studied. Diseases and conditions were cancer, mental health, pregnancy and childbirth, and cerebrovascular disease with many other diseases and conditions represented. Phenomenology and grounded theory were commonly used; substantial ethnography was also present. No substantial differences were noted for content or methods when articles published in all disciplines were compared with articles published in nursing titles or when studies with mixed methods were compared with studies that included only qualitative methods. CONCLUSIONS: The clinical literature includes many qualitative studies although they are often published in nursing journals or journals with low SCI Impact Factor journals. Many qualitative studies incorporate both qualitative and quantitative methods.

Predicting the impact of a new information system on workflow using a discrete event simulation.

Computer simulation of an information system prior to its implementation can predict time and workflow changes in a hospital department, while offering a common ground of communication across various levels in the organization. Often, the simulation can predict unexpected effects of changes to the work environment and allow experimentation with alternative scenarios at minimal cost to the department or the organization. In this paper we describe a discrete-event simulation experiment that predicted an unexpected increase in routine specimen processing time with the introduction of an information system in the HLA tissue typing lab at a major transplant center. The computer simulation enabled the reallocation of existing staff prior to the system implementation.

A novel approach to supporting relationship-centered care through electronic health record ergonomic training in preclerkship medical education.

PROBLEM: How can physicians incorporate the electronic health record (EHR) into clinical practice in a relationship-enhancing fashion ("EHR ergonomics")? APPROACH: Three convenience samples of 40 second-year medical students with varying levels of EHR ergonomic training were compared in the 2012 spring semester. All participants first received basic EHR training and completed a presurvey. Two study groups were then instructed to use the EHR during the standardized patient (SP) encounter in each of four regularly scheduled Doctoring (clinical skills) course sessions. One group received additional ergonomic training in each session. Ergonomic assessment data were collected from students, faculty, and SPs in each session. A postsurvey was administered to all students, and data were compared across all three groups to assess the impact of EHR use and ergonomic training. OUTCOMES: There was a significant positive effect of EHR ergonomics skills training on students' relationship-centered EHR use (P<.005). Students who received training reported that they were able to use the EHR to engage with patients more effectively, better articulate the benefits of using the EHR, better address patient concerns, more appropriately position the EHR device, and more effectively integrate the EHR into patient encounters. Additionally, students' self-assessments were strongly corroborated by SP and faculty assessments. A minimum of three ergonomic training sessions were needed to see an overall improvement in EHR use. NEXT STEPS: In addition to replication of these results, further effectiveness studies of this educational intervention need to be carried out in GME, practice, and other environments.

Bridging organizational divides in health care: an ecological view of health information exchange.

BACKGROUND: The fragmented nature of health care delivery in the United States leads to fragmented health information and impedes patient care continuity and safety. Technologies to support interorganizational health information exchange (HIE) are becoming more available. Understanding how HIE technology changes health care delivery and affects people and organizations is crucial to long-term successful implementation. OBJECTIVE: Our study investigated the impacts of HIE technology on organizations, health care providers, and patients through a new, context-aware perspective, the Regional Health Information Ecology. METHODS: We conducted more than 180 hours of direct observation, informal interviews during observation, and 9 formal semi-structured interviews. Data collection focused on workflow and information flow among health care team members and patients and on health care provider use of HIE technology. RESULTS: We structured the data analysis around five primary information ecology components: system, locality, diversity, keystone species, and coevolution. Our study identified three main roles, or keystone species, involved in HIE: information consumers, information exchange facilitators, and information repositories. The HIE technology impacted patient care by allowing providers direct access to health information, reducing time to obtain health information, and increasing provider awareness of patient interactions with the health care system. Developing the infrastructure needed to support HIE technology also improved connections among information technology support groups at different health care organizations. Despite the potential of this type of technology to improve continuity of patient care, HIE technology adoption by health care providers was limited. CONCLUSIONS: To successfully build a HIE network, organizations had to shift perspectives from an ownership view of health data to a continuity of care perspective. To successfully integrate external health information into clinical work practices, health care providers had to move toward understanding potential contributions of external health information. Our study provides a foundation for future context-aware development and implementation of HIE technology. Integrating concepts from the Regional Health Information Ecology into design and implementation may lead to wider diffusion and adoption of HIE technology into clinical work.

Mediation of adoption and use: a key strategy for mitigating unintended consequences of health IT implementation.

OBJECTIVE: Without careful attention to the work of users, implementation of health IT can produce new risks and inefficiencies in care. This paper uses the technology use mediation framework to examine the work of a group of nurses who serve as mediators of the adoption and use of a barcode medication administration (BCMA) system in an inpatient setting. MATERIALS AND METHODS: The study uses ethnographic methods to explore the mediators' work. Data included field notes from observations, documents, and email communications. This variety of sources enabled triangulation of findings between activities observed, discussed in meetings, and reported in emails. RESULTS: Mediation work integrated the BCMA tool with nursing practice, anticipating and solving implementation problems. Three themes of mediation work include: resolving challenges related to coordination, integrating the physical aspects of BCMA into everyday practice, and advocacy work. DISCUSSION: Previous work suggests the following factors impact mediation effectiveness: proximity to the context of use, understanding of users' practices and norms, credibility with users, and knowledge of the technology and users' technical abilities. We describe three additional factors observed in this case: 'influence on system developers,' 'influence on institutional authorities,' and 'understanding the network of organizational relationships that shape the users' work.' CONCLUSION: Institutionally supported clinicians who facilitate adoption and use of health IT systems can improve the safety and effectiveness of implementation through the management of unintended consequences. Additional research on technology use mediation can advance the science of implementation by providing decision-makers with theoretically durable, empirically grounded evidence for designing implementations.

The financial impact of health information exchange on emergency department care.

OBJECTIVE: To examine the financial impact health information exchange (HIE) in emergency departments (EDs). MATERIALS AND METHODS: We studied all ED encounters over a 13-month period in which HIE data were accessed in all major emergency departments Memphis, Tennessee. HIE access encounter records were matched with similar encounter records without HIE access. Outcomes studied were ED-originated hospital admissions, admissions for observation, laboratory testing, head CT, body CT, ankle radiographs, chest radiographs, and echocardiograms. Our estimates employed generalized estimating equations for logistic regression models adjusted for admission type, length of stay, and Charlson co-morbidity index. Marginal probabilities were used to calculate changes in outcome variables and their financial consequences. RESULTS: HIE data were accessed in approximately 6.8% of ED visits across 12 EDs studied. In 11 EDs directly accessing HIE data only through a secure Web browser, access was associated with a decrease in hospital admissions (adjusted odds ratio (OR)=0.27; p<0001). In a 12th ED relying more on print summaries, HIE access was associated with a decrease in hospital admissions (OR=0.48; p<0001) and statistically significant decreases in head CT use, body CT use, and laboratory test ordering. DISCUSSION: Applied only to the study population, HIE access was associated with an annual cost savings of $1.9 million. Net of annual operating costs, HIE access reduced overall costs by $1.07 million. Hospital admission reductions accounted for 97.6% of total cost reductions. CONCLUSION: Access to additional clinical data through HIE in emergency department settings is associated with net societal saving.