RESUMO
BACKGROUND: The Collaboration for Health Equity in Education and Research (CHEER) is unique in the composition of its members who represent all the Faculties of Health Sciences in South Africa. Over the past 10 years, CHEER has conducted 18 peer reviews involving all the institutions. In August 2012, CHEER embarked on its pilot peer review on Social Accountability in Health Sciences in South Africa. This paper shares the lessons learned and insights from the pilot process. METHODS: A descriptive study design, using qualitative methods, which focused primarily on semi-structured interviews and focus group discussions, supplemented with supporting documentation, was employed. The protocol was developed by CHEER members and ethics approval was obtained. RESULTS: Arising from our pilot peer review, reviewers identified several key components of the review process that should be noted for future reviews on social accountability. These relate to: (a) The composition of the review team; (b) the review process; (c) data collection and analysis; and (d) the reporting process. DISCUSSION: Peer review is a useful way of building consensus and a common set of values that become more explicit through the process. We found that six criteria, namely, values, reference population, partnerships, student profile, graduate outcomes and impact, provide the basis for establishing standards for reflecting social accountability. The peer review is a process of institutional self-review supported by 'a panel of critical friends' and is useful when considered as part of the process of preparation for the formal accreditation review at Health Sciences educational institutions.