Capturing pan-Canadian Primary Health Care indicator data using multiple approaches for data collection.

The Canadian Institute for Health Information (CIHI), in collaboration with diverse stakeholders, led the development of pan-Canadian indicators to measure primary health care. In 2006, CIHI released a set of 105 pan-Canadian Primary Health Care (PHC) indicators that were developed with the assistance of national, provincial and territorial representatives, clinicians and researchers. Additionally, data gaps were identified in a series of reports. In 2006 and 2007, CIHI assessed options for closing the data gaps so that the indicators could be measured and reported. CIHI then began a program to build the data infrastructure needed for the PHC indicators. The program included the development of content standards for electronic medical records, a prototype of a voluntary reporting system, enhancements to surveys, and the development of reports. In 2006, fewer than 10% of the 105 indicators could be calculated with existing data sources. Now, four projects have begun and over 50% of the indicators are being captured. Important relationships have been established with key collaborators. These relationships will lead to the development of a reporting system prototype and to the refinement of PHC indicators and electronic medical record (EMR) content standards. The project for pan-Canadian PHC indicators has encouraged consultation and synergy. It has motivated CIHI to establish an information program to fill data gaps and to make PHC indicators available.

Identifying performance indicators for family practice: assessing levels of consensus.

OBJECTIVE: To identify performance indicators for family practice that focus on organizational structures and clinical processes of care, to review evidence linking indicators to patient outcomes, to have providers select indicators they consider important for performance assessment, and to obtain provider views on challenges to developing a performance assessment system. DESIGN: Review of published and unpublished literature and contact with international experts resulted in a list of 131 structure and process indicators and associated evidence. This information was used in a two-round modified Delphi consensus process, which was followed by interviews with each of the 12 consensus panel members. SETTING: Ontario family practices. PARTICIPANTS: Eleven family physicians and one nurse practitioner from Ontario. MAIN OUTCOME MEASURES: Survey package with 131 indicators and associated evidence was mailed to panel members who rated each of the indicators on a Likert scale from 1 (not at all important for performance assessment) to 9 (essential for performance assessment). Interviews were conducted with panel members to discuss indicator feasibility and data sources. Consensus score and median importance score for each indicator were main outcome measures; interviews identified barriers to performance assessment. RESULTS: Fifty-one indicators achieved high consensus, 19 moderate consensus, and 38 low consensus. Clinical indicators that reached a high level of consensus were generally supported by grade A or B recommendations and level I to III evidence. Clinical indicators that achieved moderate consensus often had fair support in the literature. Low consensus was mainly associated with fair or equivocal evidence. During follow-up interviews, consensus panel members voiced frustration with inconsistencies in the evidence and practice guidelines upon which indicators are often based, and with poor transfer of patient information between health care providers. Lack of detail in patient care documentation and inconsistent documentation were mentioned frequently as threats to data quality. CONCLUSION: Despite challenges to performance measurement noted by the panel, study results support the continued development, refinement, and testing of primary care performance indicators.