Culturally adapted flowcharts in obstetric emergencies: a participatory action research study.

INTRODUCTION: Maternal mortality is a health problem in developing countries and is the result of several factors such as sociodemographic and economic inequalities and difficulties in accessing the health services. In addition, training strategies in obstetric emergencies targeting the non-medical personnel such as traditional midwives are scarce. The focus of this study is to develop learning and communication bridges on the management of obstetric emergencies and on policies of patients' referral to the biomedical health system in rural areas. METHODOLOGY: A Participant Action Research (PAR) study with a mixed methods approach was set up to elaborate culturally adapted flowcharts. The project lasted approximately 3,5 years, from September 2016 to January 2021. RESULTS: The study was conducted with 94 traditional midwives from southern Ecuador and is divided into 4 phases, namely: 1) Exploration: focus groups and interviews were conducted to document the management of obstetric emergencies through the presentation of "clinical case" scenarios in three important topics, namely: pre-eclampsia, shoulder dystocia and postpartum hemorrhage, 2) Planning: a number of reflective sessions were conducted between the researchers and the healers/midwives to elaborate flowcharts. 3) Action: the training was conducted in rooms dedicated to proficiency in the aforementioned topics and using the flowcharts, 4) Evaluation: 90% of the participants reported having used the flowcharts during the first year after the training. The most frequently used flowchart was that of pre-eclampsia for the recognition of warning signs during pregnancy control. CONCLUSION: This study documents common practices of pregnancy and delivery management by traditional midwives. Furthermore, cultural flowcharts were developed for and together with midwives to improve the clinical response to obstetric emergencies. The preliminary evaluation was favorable; the most frequently used flowchart concerned preeclampsia. In this process, establishing a partnership was crucial for successful intercultural collaboration.

Improving Self-Reflection Assessment Practices: Comparative Judgment as an Alternative to Rubrics.

CONSTRUCT: The authors aimed to investigate the utility of the comparative judgment method for assessing students' written self-reflections. BACKGROUND: Medical practitioners' reflective skills are increasingly considered important and therefore included in the medical education curriculum. However, assessing students' reflective skills using rubrics does not appear to guarantee adequate inter-rater reliabilities. Recently, comparative judgment was introduced as a new method to evaluate performance assessments. This study investigates the merits and limitations of the comparative judgment method for assessing students' written self-reflections. More specifically, it examines the reliability in relation to the time spent assessing, the correlation between the scores obtained using the two methods (rubrics and comparative judgment), and, raters' perceptions of the comparative judgment method. APPROACH: Twenty-two self-reflections, that had previously been scored using a rubric, were assessed by a group of eight raters using comparative judgment. Two hundred comparisons were completed and a rank order was calculated. Raters' impressions were investigated using a focus group. FINDINGS: Using comparative judgment, each self-reflection needed to be compared seven times with another self-reflection to reach a scale separation reliability of .55. The inter-rater reliability of rating (ICC, (1, k)) using rubrics was .56. The time investment required for these reliability levels in both methods was around 24 minutes. The Kendall's tau rank correlation indicated a strong correlation between the scores obtained via both methods. Raters reported that making comparisons made them evaluate the quality of self-reflections in a more nuanced way. Time investment was, however, considered heavy, especially for the first comparisons. Although raters appreciated that they did not have to assign a grade to each self-reflection, the fact that the method does not automatically lead to a grade or feedback was considered a downside. CONCLUSIONS: First evidence was provided for the comparative judgment method as an alternative to using rubrics for assessing students' written self-reflections. Before comparative judgment can be implemented for summative assessment, more research is needed on the time investment required to ensure no contradictory feedback is given back to students. Moreover, as the comparative judgment method requires an additional standard setting exercise to obtain grades, more research is warranted on the merits and limitations of this method when a pass/fail approach is used.

Towards an indigenous definition of health: an explorative study to understand the indigenous Ecuadorian people's health and illness concepts.

BACKGROUNDS: An intercultural society facilitates equitable and respectful interrelations. Knowing and understanding each other's sociocultural and linguitic contexts is a prerequisite for an intercultural society. This study explores the concepts of health and illness among healers of indigenous ethnicities in Southern Ecuador. METHODS: A qualitative observational study with eleven focus groups was conducted in three locations in Southern Ecuador; a total of 110 participants the Shuar, Kichwa and Mestizo ethnic groups were included. A phenomenological and hermeneutic analysis was conducted. RESULTS: Fourteen main subtopics around of two predefined themes, i.e., "Health" and "Illness" were identified: 1) four bodies, 2) religiosity, 3) health as a good diet, 4) health as god's blessing or a gift, 5) health as balance/ harmony, 6) health as community and social welfare, 7) health as potentiality or a skill, 8) health as peacefulness, 9) heath as individual will, 10) illness as an imbalance, 11) illness as bad energy, 12) illness as a bad diet, 13) illness as suffering or worry, and 14) illness from God, Nature and People illness. By analysing all the topics' and subtopics' narratives, a health and illness definition was developed. The principal evidence for this new framework is the presence of interculturality as a horizontal axis in health. The indigenous perspective of health and illness focus on a balance between 4 bodies: the physical, spiritual, social and mental bodies. Additionally, "good health" is obtained through of the good diet and balanced/harmony. CONCLUSION: Indigenous healers in Southern Ecuador have views on health and illness that differ from the Western biomedical model of care. These different views must be recognized and valued in order to build an intercultural (health) system that empowers both ancestral and modern medical knowledge and healing.

Educational training requirements for general practice/family medicine specialty training: recommendations for trainees, trainers and training institutions.

High-quality training is a prerequisite to teaching future general practitioners. To inspire and guide all countries to implement General Practice (GP) specialist education and training and bring it to the highest standards, we aimed, within the European context, to produce a collaborative document entitled 'Educational Requirements for GP Specialty Training'. Through an iterative process existing documents from the European Academy of Teachers in GP and Family Medicine (EURACT) and the World Organization of Family Medicine Doctors (WONCA) were collated. Other reports, grey literature about specialty GP training and requirements for trainees, trainers and training institutions were included. State-of-the-art GP specialty training 'core' competences, characteristics and essential features of GP are described. General principles and specified tools for training and assessment are summarised. Recommendations on the duration and place(s) of training and selection of trainees are provided. Trainers should be accredited teachers and quality training institutions are essential. New insights, existing gaps and issues for debate have highlighted areas for further research. This document was produced in the specific context of Europe but its general principles are relevant to GP training in all countries.

Content validity of workplace-based portfolios: A multi-centre study.

BACKGROUND: Portfolios are used as tools to coach and assess students in the workplace. This study sought to evaluate the content validity of portfolios as reflected in their capacity to adequately assess achieved competences of medical students during clerkships. METHODS: We reviewed 120 workplace portfolios at three medical universities (Belgium and the Netherlands). To validate their content, we developed a Validity Inventory for Portfolio Assessment (VIPA) based on the CanMEDS roles. Two raters evaluated each portfolio and indicated for each VIPA item whether the portfolio provided sufficient information to enable satisfactory assessment of the item. We ran a descriptive analysis on the validation data and computed Cohen's Kappa to investigate interrater agreement. RESULTS: The portfolios adequately covered the items pertaining to the communicator (90%) and professional (87%) roles. Coverage of the medical expert, collaborator, scholar and manager roles ranged between 75% and 85%. The health advocate role, covering 59%, was clearly less well represented. This role also exhibited little interrater agreement (Kappa < 0.4). CONCLUSIONS: This study lends further credence to the evidence that portfolios can indeed adequately assess the different CanMEDS roles during clerkships, the health advocate role, which was less well represented in the portfolio content, excepted.

Improving the Management of Children with Fevers by Healers in Native Rural Areas in the South of Ecuador.

BACKGROUND: Indigenous populations are represented among the poor and disadvantaged in rural areas. High rates of infectious diseases are observed in indigenous child populations, and fever as a general symptom is common. OBJECTIVE: We aim to improve the skills of healers in rural indigenous areas in the South of Ecuador for managing children with fevers. METHOD: We performed participatory action research (PAR) for this study with 65 healers. RESULTS: The PAR focused on the following four phases: (1) 'observation,' eight focus groups were used. (2) 'planning' phase was developed, and with culturally reflective peer group sessions, a culturally adapted flowchart was constructed titled "Management of children with fever." In phase (3): 'action', the healers were trained to manage children with fever. Phase (4): 'evaluation', 50% of the healers used the flowchart. CONCLUSIONS: Explicit recognition of the need for traditional healers and health professionals in indigenous communities to work together to improve health indicators such as infant mortality exists. Additionally, strengthening the transfer system in rural areas is based on knowledge and cooperation between the community and the biomedical system.

A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment.

BACKGROUND: During workplace based learning students develop professional competences and an appropriate performance. To gain insight in the learning process and to evaluate competences and performance, assessment tools are essential and need to be of good quality. We aimed to construct a competence inventory applicable as an instrument to measure the content validity of workplace based assessment tools, such as portfolio. METHODS: A Delphi study was carried out based on the CanMEDS Roles Framework. In three rounds, experts (N = 25-30) were invited to score the key competences per CanMEDS role on relevance (6-point Likert-scale), and to comment on the content and formulation bearing in mind its use in workplace based assessment. A descriptive analysis of relevances and comments was performed. RESULTS: Although all competences were scored as relevant, many comments pointed at a lack of concrete, transparent and applicable descriptions of the key competences for the purpose of assessment. Therefore, the CanMEDS roles were reformulated in this Delphi procedure as concrete learning outcomes, observable and suitable for workplace based assessment. CONCLUSIONS: A competence based inventory, ready for validating workplace based assessment tools, was constructed using a Delphi procedure and based on a clarification and concretisation of the CanMEDS roles.

Personalised versus non-individualised case-based CME: A randomised pilot study.

The PinPoint Case Platform (PPCP) offers independent online case-based CME. To align with personal learning needs, a functionality of needs assessments ("QuickScan") was developed, directing users to follow personalised case journeys. A randomised study was conducted, comparing its effectiveness, time efficiency and user experience with a format of non-individualised case-based learning. Forty-two residents in urology from five European countries were randomly assigned to follow non-individualised case-based learning (control group) or a needs assessment plus personalised case journeys on different topics in prostate cancer. After performing a pre- and post-assessment, both groups showed a similar increase in test scores (Mann-Whitney U = 247; p = .113), but the time needed for completing the learning exercise was significantly lower in the group with the personalised approach (median: 45 vs 90 minutes; Mann-Whitney U = 97.5; p = .0141). The quality of the two learning methods was similarly well received by both groups. In conclusion, learners who followed personalised case journeys learned similarly effective but more time efficient than non-individualised case-based learners. Future studies should determine if these findings can be extrapolated to board-certified physicians following CME activities.

Teaching and Learning Core Values in General Practice/Family Medicine: A Narrative Review.

General Practice/Family Medicine (GP/FM) is a key discipline within primary health care and so by extension for the whole health care system. An essential condition for effective GP/FM care is a work force that is highly qualified. As society is changing rapidly, a revision of the GP/FM definition is ongoing, in addition to a recent movement of identifying related core values. In this paper, we want to give an overview on how these new paths and perspectives are currently reflected in GP/FM teaching and training. We selected four core values that fit in with possible future visions: person-centered care, continuity of care, cooperation in care, and community-oriented care. By a narrative review, we observed that GP/FM education toward core values is often built around overarching topics. Teaching and learning take place in specific contexts, most of all through placements within communities, primary care settings, or hospital wards. Mixed teaching- and training methods are used combining knowledge, skills, and attitude. Furthermore, collaboration with other health professionals and peers is stressed, in addition to the importance of role models, a holistic focus and the involvement of patients. Since these core values are important within GP/FM and rather few studies on the educational aspects and learning tools were found we advocate encouraging each other more to share good practices, certainly the innovative ones specifically related to GP/FM.

Perceptions of Ecuadorian indigenous healers on their relationship with the formal health care system: barriers and opportunities.

BACKGROUND: The new paradigm of intercultural policies focuses on rethinking the common public culture. In Ecuador, the "Buen Vivir" plan seeks to incorporate the ancestral medical knowledge, experience and beliefs of traditional healers into the formal health services. This study explores views on the formal health system from the perspective of the healers belonging to the Kichwa and Shuar ethnicities in the South of Ecuador. METHODS: A qualitative study with a phenomenological approach was performed. Focus groups were conducted in three locations in Southern Ecuador. Shuar, Kichwa and Mestizo ethnic groups were included in the research. RESULTS: Eleven focus groups with a total of 110 participants belonging to the Shuar, Kichwa and Mestizo ethnic groups participated in the study. Six themes were created through analysis: 1) conflicts with health professionals, 2) acceptance of traditional healers, 3) respect, 4) work as a team, 5) environment and patient care, and 6) salary and recognition. CONCLUSION: This study indicated the perceived barriers compromising respectful collaboration between health staff and traditional healers from an indigenous perspective. Power inequalities and a historically unidirectional relationship and, in addition, differences in health beliefs, seem to create misunderstandings regarding each other's approach when faced with health and disease. However, insight in these barriers can create opportunities towards collaboration, which will have a positive effect on patient confidence in one or both systems and support continuity between traditional healers and the formal health system.

Portfolio assessment during medical internships: How to obtain a reliable and feasible assessment procedure?

BACKGROUND: A portfolio is used to mentor and assess students' clinical performance at the workplace. However, students and raters often perceive the portfolio as a time-consuming instrument. PURPOSE: In this study, we investigated whether assessment during medical internship by a portfolio can combine reliability and feasibility. METHODS: The domain-oriented reliability of 61 double-rated portfolios was measured, using a generalisability analysis with portfolio tasks and raters as sources of variation in measuring the performance of a student. RESULTS: We obtained reliability (Phi coefficient) of 0.87 with this internship portfolio containing 15 double-rated tasks. The generalisability analysis showed that an acceptable level of reliability (Phi = 0.80) was maintained when the amount of portfolio tasks was decreased to 13 or 9 using one and two raters, respectively. CONCLUSIONS: Our study shows that a portfolio can be a reliable method for the assessment of workplace learning. The possibility of reducing the amount of tasks or raters while maintaining a sufficient level of reliability suggests an increase in feasibility of portfolio use for both students and raters.