Cost of Hospitalization Associated with Inpatient Goals-of-Care Program Implementation at a Comprehensive Cancer Center: A Propensity Score Analysis.

The impact of goals-of-care programs on acute hospitalization costs is unclear. We compared the hospitalization cost in an 8-month period before implementation of a multimodal interdisciplinary goals-of-care program (1 May 2019 to 31 December 2019) to an 8-month period after program implementation (1 May 2020 to 31 December 2020). Propensity score weighting was used to adjust for differences in potential covariates. The primary outcome was total direct cost during the hospital stay for each index hospitalization. This analysis included 6977 patients in 2019 and 5964 patients in 2020. The total direct cost decreased by 3% in 2020 but was not statistically significant (ratio 0.97, 95% CI 0.92, 1.03). Under individual categories, there was a significant decrease in medical oncology (ratio 0.58, 95% CI 0.50, 0.68) and pharmacy costs (ratio 0.86, 95% CI 0.79, 0.96), and an increase in room and board (ratio 1.06, 95% CI 1.01, 1.10). In subgroup analysis, ICU patients had a significant reduction in total direct cost after program implementation (ratio 0.83, 95% CI 0.72, 0.94). After accounting for the length of ICU admission, we found that the total direct cost per hospital day was no longer different between 2019 and 2020 (ratio 0.986, 95% CI 0.92, 1.05), suggesting that shorter ICU admissions likely explained much of the observed cost savings. This study provides real-world data on how "in-the-moment" GOC conversations may contribute to reduced hospitalization costs among ICU patients.

The impact of a multidisciplinary goals-of-care program on unplanned readmission rates at a comprehensive cancer center.

PURPOSE: This study examined the 30-day unplanned readmission rate in the medical oncology population before and after the implementation of an institution-wide multicomponent interdisciplinary goals of care (myGOC) program. METHODS: This retrospective study compared the 30-day unplanned readmission rates in consecutive medical patients during the pre-implementation period (May 1, 2019, to December 31, 2019) and the post-implementation period (May 1, 2020, to December 31, 2020). Secondary outcomes included 7-day unplanned readmission rates, inpatient do-not-resuscitate (DNR) orders, and palliative care consults. We randomly selected a hospitalization encounter for each unique patient during each study period for statistical analysis. A multivariate analysis model was used to examine the association between 30-day unplanned readmission rates and implementation of the myGOC program. RESULTS: There were 7028 and 5982 unique medical patients during the pre- and post-implementation period, respectively. The overall 30-day unplanned readmission rate decreased from 24.0 to 21.3% after implementation of the myGOC program. After adjusting for covariates, the myGOC program implementation remained significantly associated with a reduction in 30-day unplanned readmission rates (OR [95% CI] 0.85 [0.77, 0.95], p = 0.003). Other factors significantly associated with a decreased likelihood of a 30-day unplanned readmission were an inpatient DNR order, advanced care planning documentation, and an emergent admission type. We also observed a significant decrease in 7-day unplanned readmission rates (OR [95% CI] 0.75 [0.64, 0.89]) after implementation of the myGOC program. CONCLUSION: The 30-day and 7-day unplanned readmission rates decreased in our hospital after implementation of a system-wide multicomponent GOC intervention.

The importance of facilitating goal-concordant care (GCC) in a pandemic: the MD Anderson Experience with hospitalized COVID-19-positive patients.

PURPOSE: Provider-patient communication (PPC) about goals of care (GOC) facilitates goal-concordant care (GCC) delivery. Hospital resource limitations imposed during the pandemic made it vital to deliver GCC to a patient cohort with COVID-19 and cancer. We aimed to evaluate the implementation of a real-time goals of care intervention and to make recommendations for future pandemics with similar clinical scenarios. METHODS: This is a retrospective cohort study, of all COVID-19 positive patients admitted to The University of Texas MD Anderson Cancer Center between March of 2020 and January of 2021. The cohort included the following: (1) patients 18 years of age or older; (2) positive COVID-19 infection; (3) requiring hospitalization. Medical records were reviewed and all patient data including demographics, comorbidities, and outcomes were collected and analyzed in the Syntropy platform, Palantir Foundry, as part of the institutional Data-Driven Determinants of COVID-19 Oncology Discovery Effort (D3CODE) protocol. A multidisciplinary GOC task force developed processes for ease of conducting GOC-PPC and implemented structured documentation. We looked at ACP documentation pre- and post-implementation alongside demographics, length of stay (LOS), 30-day readmission rate and mortality. RESULTS: There were 494 unique patients identified, 53% male, 61.5% Caucasian, 16.8% African American, and 3.2% Asian. Active cancer was identified in 84.6% patients, of which 65.6% were solid tumors and 34.4% hematologic malignancies. LOS was 9 days with a 30-day readmission rate of 15% and inpatient mortality of 14%. Inpatient ACP note documentation was significantly higher post-implementation as compared to pre-implementation (90% vs 8%, P<0.05). We saw sustained ACP documentation throughout the pandemic suggesting effective processes. CONCLUSIONS: The implementation of institutional structured processes for GOC-PPC resulted in rapid sustainable adoption of ACP documentation for COVID-19-positive cancer patients. This was highly beneficial for this population during the pandemic, as it demonstrated the role of agile processes in care delivery models, which will be beneficial in the future when rapid implementation is needed.

Impact of an Institution-Wide Goals of Care Program on the Timing of Referrals to Outpatient Palliative Care.

CONTEXT: Palliative care has received increased interest since the COVID-19 pandemic due to its role in guiding goals of care (GOC) discussions. OBJECTIVES: We assessed the change in the timing of outpatient palliative care referrals before and after implementing an institution-wide multicomponent interdisciplinary GOC (myGOC) program. METHODS: We reviewed 200 random supportive care center (SCC) consult visits each from June to November 2019 (before myGOC) and June to November 2020 (after myGOC). Data regarding Edmonton Symptom Assessment Scale (ESAS) scores, time from hospital registration to SCC visit, SCC visit until death/last follow-up, and advance care planning (ACP) notes were collected. Kaplan-Meier curves were used to evaluate overall survival (OS). RESULTS: The median OS from the SCC consult visit was 15.2 months (95% CI:11.7-19.7) before and 14.0 months (95% CI:10.8-17.9) after the myGOC program (P = 0.646). There were no significant differences in the median time between the SCC consult visit to death/last follow-up (11.95 vs. 12.0 months after myGOC; P = 0.841) and the first visits to our cancer center and SCC (6.1 vs. 5.29 months after myGOC; P = 0.689). Patients seen after myGOC had significantly lower ESAS symptom scores, better performance status (2 [1-2] vs. 2 [1-3]; P = 0.018], and more ACP notes composed by medical oncology teams (25.5% vs. 4.5%; P < 0.001). CONCLUSION: There were no significant differences in OS among patients seen in the SCC before and after myGOC, likely related to a ceiling effect. More oncologists had ACP discussions with patients, and patients had lower symptom scores on ESAS after myGOC, likely indicating that more patients were referred for GOC discussions and ACP rather than for symptom distress.

The Importance of Facilitating Goal-Concordant Care (GCC) in a Pandemic: The MD Anderson Experience with hospitalized COVID-19 positive patients.

Purpose: Provider-patient communication (PPC) about goals of care (GOC) facilitates goal-concordant care (GCC) delivery. Hospital resource limitations imposed during the pandemic made it vital to deliver GCC to a patient cohort with COVID-19 and cancer. Our aim was to understand the population and adoption of GOC-PPC along with structured documentation in the form of an Advance Care Planning (ACP) note. Methods: A multidisciplinary GOC task force developed processes for ease of conducting GOC-PPC and implemented structured documentation. Data were obtained from multiple electronic medical record elements, with each source identified, data integrated and analyzed. We looked at PPC and ACP documentation pre and post implementation alongside demographics, length of stay (LOS), 30-day readmission rate and mortality. Results: 494 unique patients were identified, 52% male, 63% Caucasian, 28% Hispanic, 16% African American and 3% Asian. Active cancer was identified in 81% patients, of which 64% were solid tumors and 36% hematologic malignancies. LOS was 9 days with a 30-day readmission rate of 15% and inpatient mortality of 14%. Inpatient ACP note documentation was significantly higher post-implementation as compared to pre-implementation (90% vs 8%, P < 0.05). We saw sustained ACP documentation throughout the pandemic suggesting effective processes. Conclusions: The implementation of institutional structured processes for GOC-PPC resulted in rapid sustainable adoption of ACP documentation for COVID-19 positive cancer patients. This was highly beneficial for this population during the pandemic, as it demonstrated the role of agile processes in care delivery models, which will be beneficial in the future when rapid implementation is needed.

Advance Care Planning conversations: What constitutes best practice and the way forward: Advance Care Planning-Gespräche: Was Best Practice ausmacht und wie es weitergehen kann.

BACKGROUND: Advance Care Planning (ACP) conversations are a cornerstone of modern health care and need to be supported. However, research indicates that the uptake thereof is limited, regardless of various campaigns. ACP conversations are complex and specific elements thereof should be discussed at various timepoints during the illness trajectory. OBJECTIVE: This narrative review delineates what ACP conversation should entail, and a way forward. METHODS: A PEO (Population, Exposure, Outcome) search was performed using relevant keywords, and 615 articles were identified. Through screening and coding, this number was reduced to 24 articles. All the authors were involved in the final selection of the articles. RESULTS: Various themes developed throughout the review which include timing early on in the disease trajectory; incorporating beliefs and culturally relevant contexts; conversations needing to be iterative and short; involving surrogates and family; applying various media formats. DISCUSSION: ACP conversations are relevant. ACP is not static and needs to be dynamic as patients' illness trajectories and goals change. The care team needs to guard themselves against having ACP conversations to satisfy a metric and should instead be guided by the patient's expressed values and wishes. A system-wide operational plan will help alleviate common barriers in having appropriate ACP conversations.

To have done everything.

When a patient loses decisional capacity, the responsibility to make treatment decisions often falls on a family member who becomes the surrogate decision-maker. This case study provides an example of a situation where the medical team and the surrogate decision-maker initially disagreed on the best course of action for the patient. The ethicist was called in to lead a guided conversation to help the team and the surrogate decision-maker reach a consensus. This case illustrates the importance of allowing the surrogate decision-maker to ask clarifying questions and process their emotions before making a decision.

Differential Impact of a Multicomponent Goals-of-Care Program in Patients with Hematologic and Solid Malignancies.

We recently reported that an interdisciplinary multicomponent goals-of-care (myGOC) program was associated with an improvement in goals-of-care (GOC) documentation and hospital outcomes; however, it is unclear if the benefit was uniform between patients with hematologic malignancies and solid tumors. In this retrospective cohort study, we compared the change in hospital outcomes and GOC documentation before and after myGOC program implementation between patients with hematologic malignancies and solid tumors. We examined the change in outcomes in consecutive medical inpatients before (May 2019-December 2019) and after (May 2020-December 2020) implementation of the myGOC program. The primary outcome was intensive care unit (ICU) mortality. Secondary outcomes included GOC documentation. In total, 5036 (43.4%) patients with hematologic malignancies and 6563 (56.6%) with solid tumors were included. Patients with hematologic malignancies had no significant change in ICU mortality between 2019 and 2020 (26.4% vs. 28.3%), while patients with solid tumors had a significant reduction (32.6% vs. 18.8%) with a significant between-group difference (OR 2.29, 95% CI 1.35, 3.88; p = 0.004). GOC documentation improved significantly in both groups, with greater changes observed in the hematologic group. Despite greater GOC documentation in the hematologic group, ICU mortality only improved in patients with solid tumors.

Oncologist Participation and Performance in the Merit-Based Incentive Payment System.

The merit-based incentive payment system (MIPS) is a value-based payment model created by the Centers for Medicare & Medicaid Services (CMS) to promote high-value care through performance-based adjustments of Medicare reimbursements. In this cross-sectional study, we examined the participation and performance of oncologists in the 2019 MIPS. Oncologist participation was low (86%) compared to all-specialty participation (97%). After adjusting for practice characteristics, higher MIPS scores were observed among oncologists with alternative payment models (APMs) as their filing source (mean score, 91 for APMs vs. 77.6 for individuals; difference, 13.41 [95% CI, 12.21, 14.6]), indicating the importance of greater organizational resources for participants. Lower scores were associated with greater patient complexity (mean score, 83.4 for highest quintile vs. 84.9 for lowest quintile, difference, -1.43 [95% CI, -2.48, -0.37]), suggesting the need for better risk-adjustment by CMS. Our findings may guide future efforts to improve oncologist engagement in MIPS.

Just-in-Time Decision Making: Preliminary Findings of a Goals of Care Rapid Response Team.

CONTEXT: The COVID-19 pandemic placed the issue of resource utilization front and center. Our comprehensive cancer center developed a Goals of Care Rapid Response Team (GOC RRT) to optimize resource utilization balanced with goal-concordant patient care. OBJECTIVES: Primary study objective was to evaluate feasibility of the GOC RRT by describing the frequency of consultations that occurred from those requested. Secondary objectives included adherence to consultation processes in terms of core team member participation and preliminary efficacy in limiting care escalation. METHODS: We conducted a retrospective chart review of patients referred to GOC RRT (3/23/2020-9/30/2020). Analysis was descriptive. Categorical variables were compared with Fisher's exact or Chi-Square tests and continuous variables with Mann-Whitney U tests. RESULTS: A total of 89 patients were referred. Eighty-five percent (76 of 89) underwent a total of 95 consultations. Median (range) patient age was 61 (49, 69) years, 54% (48 of 89) male, 19% (17 of 89) Hispanic, 48% (43/89) White, 73% (65 of 89) married/partnered and 66% (59 of 89) Christian. Hematologic malignancies and solid tumors were evenly balanced (53% [47/89] vs. 47% [42 of 89, P = 0.199]). Most patients (82%, 73 of 89) had metastatic disease or relapsed leukemia. Seven percent (6 of 89) had confirmed COVID-19. Sixty-nine percent (61 of 89) died during the index hospitalization. There was no statistically significant difference in demographic or clinical characteristics among groups (no consultation, 1 consultation, >1 consultation). Core team members were present at 64% (61 of 95) of consultations. Care limitation occurred in 74% (56 of 76) of patients. CONCLUSION: GOC RRT consultations were feasible and associated with care limitation. Adherence to core team participation was fair.

Impact of an Interdisciplinary Goals-of-Care Program Among Medical Inpatients at a Comprehensive Cancer Center During the COVID-19 Pandemic: A Propensity Score Analysis.

PURPOSE: Many hospitals have established goals-of-care programs in response to the coronavirus disease 2019 pandemic; however, few have reported their outcomes. We examined the impact of a multicomponent interdisciplinary goals-of-care program on intensive care unit (ICU) mortality and hospital outcomes for medical inpatients with cancer. METHODS: This single-center study with a quasi-experimental design included consecutive adult patients with cancer admitted to medical units at the MD Anderson Cancer Center, TX, during the 8-month preimplementation (May 1, 2019-December 31, 2019) and postimplementation period (May 1, 2020-December 31, 2020). The primary outcome was ICU mortality. Secondary outcomes included ICU length of stay, hospital mortality, and proportion/timing of care plan documentation. Propensity score weighting was used to adjust for differences in potential covariates, including age, sex, cancer diagnosis, race/ethnicity, and Sequential Organ Failure Assessment score. RESULTS: This study involved 12,941 hospitalized patients with cancer (pre n = 6,977; post n = 5,964) including 1,365 ICU admissions (pre n = 727; post n = 638). After multicomponent goals-of-care program initiation, we observed a significant reduction in ICU mortality (28.2% v 21.9%; change -6.3%, 95% CI, -9.6 to -3.1; P = .0001). We also observed significant decreases in length of ICU stay (mean change -1.4 days, 95% CI, -2.0 to -0.7; P < .0001) and in-hospital mortality (7% v 6.1%, mean change -0.9%, 95% CI, -1.5 to -0.3; P = .004). The proportion of hospitalized patients with an in-hospital do-not-resuscitate order increased significantly from 14.7% to 19.6% after implementation (odds ratio, 1.4; 95% CI, 1.3 to 1.5; P < .0001), and do-not-resuscitate order was established earlier (mean difference -3.0 days, 95% CI, -3.9 to -2.1; P < .0001). CONCLUSION: This study showed improvement in hospital outcomes and care plan documentation after implementation of a system-wide, multicomponent goals-of-care intervention.

Appreciating the Dynamicity of Values at the End of Life: A Psychological and Ethical Analysis.

It can be difficult for families to accept when loved ones experience a change in saliency of values due to serious illness and inevitable death. When patients lose decision-making capacity, family members often refuse to withdraw care and insist on the continuation of non-beneficial treatment. Through a joint ethical and psychological analysis, this case study examines the narrative of a husband and wife, wed for over 50 years, and how the patient's values, his life's story, and the wife's interpretation of his preferences were reconciled to achieve a resolution that respected the patient's autonomy and previously expressed wishes.

Continue with ICU care - she is a spiritual being.

This case study discusses a dispute between the healthcare team and the patient's surrogate decision maker at a cancer centre. While the healthcare team deemed further care to be futile, the patient's husband argued that they should continue to try to reverse his wife's acute decline. This case study illustrates the inertia and moral distress that can result when there are differences between patients/surrogates and the healthcare team in their goals for intensive care. The issues of moral distress and an inability to make decisions were addressed by involving an ethics consultant, and by creating institutional mechanisms to address end-of-life issues at an earlier stage.

#ColonCancer: Social Media Discussions About Colorectal Cancer During the COVID-19 Pandemic.

PURPOSE: Colorectal cancer (CRC) is the second leading cause of cancer-related mortality worldwide. Social media platforms such as Twitter are extensively used to communicate about cancer care, yet little is known about the role of these online platforms in promoting early detection or sharing the lived experiences of patients with CRC. This study tracked Twitter discussions about CRC and characterized participating users to better understand public communication and perceptions of CRC during the COVID-19 pandemic. METHODS: Tweets containing references to CRC were collected from January 2020 to April 2021 using Twitter's Application Programming Interface. Account metadata was used to predict user demographic information and classify users as either organizations, individuals, clinicians, or influencers. We compared the number of impressions across users and analyzed the content of tweets using natural language processing models to identify prominent topics of discussion. RESULTS: There were 72,229 unique CRC-related tweets by 31,170 users. Most users were male (66%) and older than 40 years (57%). Individuals accounted for most users (44%); organizations (35%); clinicians (19%); and influencers (2%). Influencers made the most median impressions (35,853). Organizations made the most overall impressions (1,067,189,613). Tweets contained the following topics: bereavement (20%), appeals for early detection (20%), research (17%), National Colorectal Cancer Awareness Month (15%), screening access (14%), and risk factors (14%). CONCLUSION: Discussions about CRC largely focused on bereavement and early detection. Online coverage of National Colorectal Cancer Awareness Month and personal experiences with CRC effectively stimulated goal-oriented tweets about early detection. Our findings suggest that although Twitter is commonly used for communicating about CRC, partnering with influencers may be an effective strategy for improving communication of future public health recommendations related to CRC.

Perceptions of Life Support and Advance Care Planning During the COVID-19 Pandemic: A Global Study of Twitter Users.

BACKGROUND: The COVID-19 pandemic has presented new challenges surrounding end-of-life planning and has been associated with increased online discussion about life support. RESEARCH QUESTION: How has online communication about advance care planning (ACP) and specific life-sustaining interventions (LSIs) changed during the pandemic? STUDY DESIGN AND METHODS: Conversations on Twitter containing references to LSIs (eg, "ECMO") or ACP (eg, "DNR/DNI") were collected between January 2019 and May 2021. User account metadata were used to predict user demographic information and to classify users as organizations, individuals, clinicians, or influencers. The number of impressions was compared across these user categories and the content of tweets analyzed by using natural language processing models to identify topics of discussion and associated emotional sentiment. RESULTS: There were 202,585 unique tweets about LSIs and 67,162 unique tweets about ACP. Users who were younger, male, or influencers were more likely to discuss LSIs online. Tweets about LSIs were associated with more positive emotional sentiment scores than tweets about ACP (LSIs, 0.3; ACP, -0.2; P < .001). Among tweets about ACP, most contained personal experiences related to the death of loved ones (27%) or discussed discrimination through do-not-resuscitate orders directed at the elderly and disabled (19%). Personal experiences had the greatest retweet-to-tweet-ratio (4.7), indicating high levels of user engagement. Tweets about discrimination contained the most negative net sentiment score (-0.5). INTERPRETATION: The observed increase in tweets regarding LSIs and ACP suggests that Twitter was consistently used to discuss treatment modalities and preferences related to intensive care during the pandemic. Future interventions to increase online engagement with ACP may consider leveraging influencers and personal stories. Finally, we identified do-not-resuscitate-related discrimination as a commonly held public fear, which should be further explored as a barrier to ACP completion and can be proactively addressed by clinicians during bedside goals-of-care discussions.

The Hidden Curriculum and Integrating Cure- and Care-Based Approaches to Medicine.

Although current literature about the "cure versus care" issue tends to promote a patient-centered approach, the disease-centered approach remains the prevailing model in practice. The perceived dichotomy between the two approaches has created a barrier that could make it difficult for medical students and physicians to integrate psychosocial aspects of patient care into the prevailing disease-based model. This article examines the influence of the formal and hidden curricula on the perception of these two approaches and finds that the hidden curriculum perpetuates the notion that "cure" and "care" based approaches are dichotomous despite significant changes in formal curricula that promote a more integrated approach. The authors argue that it is detrimental for clinicians to view the two approaches as oppositional rather than complementary and attempt to give recommendations on how the influence of the hidden curriculum can be reduced to get a both-cure-and-care-approach, rather than an either-cure-or-care-approach.

A Practical Approach to Hospital Visitation During a Pandemic: Responding With Compassion to Unjustified Restrictions.

During the COVID-19 pandemic, evidence-based resources have been sought to support decision-making and strategically inform hospitals' policies, procedures, and practices. While greatly emphasizing protection, most guiding documents have neglected to support and protect the psychosocial needs of frontline health care workers and patients and their families during provision of palliative and end-of-life care. Consequently, the stage has been set for increased anxiety, moral distress, and moral injury and extreme moral hazard. A family-centered approach to care has been unilaterally relinquished to a secondary and nonessential role during the current crisis. This phenomenon violates a foundational public health principle, namely, to apply the least restrictive means to achieve good for the many. Instead, there has been widespread adoption of utilitarian and paternalistic approaches. In many cases the foundational principles of palliative care have also been neglected. No circumstance, even a global public health emergency, should ever cause health care providers to deny their ethical obligations and human commitment to compassion. The lack of responsive protocols for family visitation, particularly at the end of life, is an important gap in the current recommendations for pandemic triage and contingency planning. A stepwise approach to hospital visitation using a tiered, standardized process for responding to emerging clinical circumstances and individual patients' needs should be considered, following the principle of proportionality. A contingency plan, based on epidemiological data, is the best strategy to refocus health care ethics in practice now and for the future.

Exploring values among three cultures from a global bioethics perspective.

The United Nations Educational, Scientific and Cultural Organisation's (UNESCO) Declaration on Bioethics and Human Rights refers to the importance of cultural diversity and pluralism in ethical discourse and care of humanity. The aim of this meta-narrative review is to identify indigenous ethical values pertaining to the Ojibway (Canada), Xhosa (South Africa), and Mayan (Mexico and Central American) cultures from peer-reviewed sources and cultural review, and to ascertain if there are shared commonalities. Three main themes were identified, namely illness, healing, and health care choices. Illness was described with a more complex and dynamic picture than from the western view, as illness is not considered to be one dimensional. Healing needs to take place on various levels in order to restore a state of equilibrium between the different spheres. Health care choices were also considered from a multi-level perspective. In all three of the indigenous cultures explored, good decision-making is seen to have occurred when choices are informed by commitments to one's moral and ethical responsibilities towards the community, nature, and the spirit world.

Advance Care Planning Conversations in the Oncology Setting: Tips from the Experts.

Advance care planning (ACP) has been identified as a fundamental part of every patient's total health care plan and is actively supported by a number of health care organizations. Despite these endorsements, however, having advance care planning conversations has not come easily for physicians. Training future physicians should include practical ways to address this issue. Fifty physicians at an oncology hospital, who were identified as having the most ACP conversations, were approached. Twenty-six percent participated in a survey which was sent out electronically via Qualitrics. All answers were recorded online and responses were collected and analyzed according to thematic analysis methodology. Major themes were noted and summarized for each of the survey's 10 questions, resulting in how the physicians can successfully plan for and initiate advance care planning conversations with their patients and families. Themes touched upon self-awareness, one's outlook on the value of life, and the importance of death as part of the care continuum. A physician's own perception of the value of ACP conversations greatly influences them having those conversations. Furthermore, it is key that the physician understands and be aware of the patient's perspective regarding their cancer and how it impacts them. This dynamic will then allow the physician to better align their plan of care with the treatment goals and expectations of the patient. Future training programs should incorporate these suggestions.