Perceived knowledge of scheme members and their satisfaction with their medical schemes: a cross-sectional study in South Africa.

BACKGROUND: South Africa has a dual healthcare system comprising of private and public sectors covering 16% and 84% of the population, respectively. Medical schemes are the primary source of health insurance in the private sector. The aim of this study was to assess members of medical schemes' perceived knowledge and satisfaction with their medical schemes. METHODS: A cross-sectional survey was conducted using a stratified systematic sample of members of 22 open medical schemes. Medical schemes members completed an online questionnaire on knowledge and satisfaction with their medical schemes. We calculated a composite perceived knowledge and satisfaction score. Descriptive, bivariate and multivariate analysis was conducted. RESULTS: A total of 336 members of medical schemes participated in this study. Respondents generally perceived themselves to have good knowledge of their medical schemes. Eighty-one percent of participants were satisfied with the quality of services received from their designated service providers (DSPs), however, only 9% were satisfied with accessibility of doctors under their DSP arrangement. Twenty-five percent of respondents were satisfied with scheme contributions and only 46% were satisfied with the prescribed minimum benefit package. CONCLUSION: Medical schemes remain a key element of private healthcare in South Africa. The analysis shows that medical schemes, should put more effort into the accessibility of general practitioner under their designated service providers. Furthermore, the prescribed minimum benefits should be reviewed to provide a comprehensive benefits basket without co-payment for members as recommended by the Medical Schemes Act Amendment Bill of 2018.

Feasibility and Acceptability of Web-Based Structured Oral Examinations for Postgraduate Certification: Mixed Methods Preliminary Evaluation.

BACKGROUND: The COVID-19 pandemic disrupted postgraduate certification examinations globally. The Colleges of Medicine of South Africa continued hosting certification examinations through the pandemic. This was achieved by effecting a rapid transition from in-person to web-based certification examinations. OBJECTIVE: This formative evaluation explored candidates' acceptability of web-based structured oral examinations (SOEs) hosted via Zoom (Zoom Communications Inc). We also reported the audiovisual quality and technical challenges encountered while using Zoom and candidates' overall experience with these examinations conducted during the early part of the COVID-19 pandemic. Additionally, performance in web-based certification examinations was compared with previous in-person certification examinations. METHODS: This mixed methods, single-arm evaluation anonymously gathered candidates' perceptions of web-based SOE acceptability, audiovisual quality, and overall experience with Zoom using a web-based survey. Pass rates of web-based and previous in-person certification examinations were compared using chi-square tests, with a Yates correction. A thematic analysis approach was adopted for qualitative data. RESULTS: Between June 2020 and June 2021, 3105 candidates registered for certification examinations, 293 (9.4%) withdrew, 2812 (90.6%) wrote, and 2799 (99.9%) passed, and 1525 (54.2%) were invited to a further web-based SOE. Examination participation was 96.2% (n=1467). During the first web-based examination cycle (2020), 542 (87.1%) of 622 web-based SOE candidates completed the web-based survey. They reported web-based SOEs as fair (374/542, 69%) and adequately testing their clinical reasoning and insight (396/542, 73.1%). Few would have preferred real patient encounters (173/542, 31.9%) or in-person oral examinations (152/542, 28%). Most found Zoom acceptable (434/542, 80%) and fair (396/542, 73.1%) for hosting web-based SOEs. SOEs resulted in financial (434/542, 80%) and time (428/542, 79%) savings for candidates. Many (336/542, 62%) supported the ongoing use of web-based certification examinations. Only 169 technical challenges in using Zoom were reported, which included connectivity-related issues, poor audio quality, and poor image quality. The thematic analysis identified 4 themes of positive and negative experiences related to web-based SOE station design and content, examination station environment, examiner-candidate interactions, and personal benefits for candidates. Our qualitative analysis identified 10 improvements for future web-based SOEs. Candidates achieved high pass rates in web-based certification examinations in 2020 (1583/1732, 91.39%) and 2021 (850/1067, 79.66%). These were significantly higher (2020: N=8635; χ21=667; P<.001; 2021: N=7988; χ21=178; P<.001) than the previous in-person certification examination pass rate of 58.23% (4030/6921; 2017-2019). CONCLUSIONS: Web-based SOEs conducted by the Colleges of Medicine of South Africa during the COVID-19 pandemic were well received by candidates, and few technical difficulties were encountered while using Zoom. Better performance was observed in web-based examinations than in previous in-person certification examinations. These early findings support the ongoing use of this assessment method.