Cluster Effects in a National Dental PBRN restorative study.

Items in clusters, such as patients of the same clinician or teeth within the same patient, tend to be more similar than items from different groups. This within-group similarity, represented by the intraclass correlation coefficient (ICC), reduces precision, yielding less statistical power and wider confidence intervals, compared with non-clustered samples of the same size. This must be considered in the design of studies including clusters. We present ICC estimates from a study of 7,826 restorations placed in previously unrestored tooth surfaces of 4,672 patients by 222 clinicians in the National Dental Practice-Based Research Network, as a resource for sample size planning in restorative studies. Our findings suggest that magnitudes of ICCs in practice-based research can be substantial. These can have large effects on precision and the power to detect treatment effects. Generally, we found relatively large ICCs for characteristics that are influenced by clinician choice (e.g., 0.36 for rubber dam use). ICCs for outcomes within individual patients, such as tooth surfaces affected by a caries lesion, tended to be smaller (from 0.03 to 0.15), but were still sufficiently large to substantially affect statistical power. Clustering should be taken into account in the design of oral health studies and derivation of statistical power estimates for these studies (ClinicalTrials.gov, NCT00847470).

Differences between reported and actual restored caries lesion depths: results from The Dental PBRN.

OBJECTIVE: The objectives of this research were to (1) quantify the discordance between the caries lesion depth at which dentists restored initial lesions during a clinical study ("actual depth") and the lesion depth that they reported during a hypothetical clinical scenario ("reported depth"); (2) test the hypothesis that certain practitioner, practice, patient, and caries lesion characteristics are significantly associated with this discordance. METHODS: Practitioner-investigators who perform restorative dentistry in their practices completed an enrollment questionnaire and participated in two consecutive studies on caries diagnosis and treatment. The first study was a survey asking about caries treatment. The second study collected data on restorations placed in routine clinical practice due to caries in patients over 19 years of age on occlusal surfaces only or proximal surfaces only. We report results on 2691 restorations placed by 205 dentists in 1930 patients with complete data. RESULTS: Discordance between actual depth and reported depth occurred in only about 2% of the restorations done due to proximal caries, but about 49% of the restorations done due to occlusal caries. Practice type, restorative material used and the diagnostic methods used were significantly associated with discordance. CONCLUSION: Dentists frequently restored occlusal caries at a shallower depth as compared to their reported depth, but the discordance was very small for proximal lesions. Discordance for occlusal caries was more common when radiographs were not taken or if a resin restoration was placed.

ONJ in two dental practice-based research network regions.

The incidence of osteonecrosis of the jaw (ONJ) in the population is low, but specifics are unknown. Potential risk factors include bisphosphonate treatment, steroid treatment, osteoporosis, and head/neck radiation. This Dental Practice-Based Research Network study estimated ONJ incidence and odds ratios from bisphosphonate exposure and other risk factors using a key word search and manual chart reviews of electronic records for adults aged ≥ 35 yrs enrolled during 1995-2006 in two large health-care organizations. We found 16 ONJ cases among 572,606 cohort members; seven additional cases were identified through dental plan resources. Among 23 cases (0.63 per 100,000 patient years), 20 (87%) had at least one risk factor, and six (26%) had received oral bisphosphonates. Patients with oral bisphosphonates were 15.5 (CI, 6.0-38.7) more likely to have ONJ than non-exposed patients; however, the sparse number of ONJ cases limits firm conclusions and suggests that the absolute risks for ONJ from oral bisphosphonates is low.

Development of effectiveness of care and use of services measures for dental care plans.

OBJECTIVES: Standardized measures to assess clinical aspects of the performance of managed dental care plans are not available. This project sought to develop and evaluate measures for effectiveness of care and use of services that could be calculated using a plan's administrative data. METHODS: Two panels of stake holders representing dental plans, purchasers, and dental providers participated in a modified Delphi process to refine initial sets of effectiveness of care and use of services measures modeled after HEDIS measures for medical care. The refined measures were then pilot tested in two dental health maintenance organizations. RESULTS: The development process resulted in specification of seven effectiveness of care measures assessing disease activity classification, and prevention and outcomes for caries, periodontal disease, and tooth loss. Six use of services measures focusing on prophylaxes, third molar surgery, preventive, restorative, prosthetic, surgical, and endodontic care also were specified. Pilot testing of the measures indicated reasonable reliability and sensitivity, but also demonstrated the need for supervision or auditing of the process. CONCLUSIONS: These standardized measures for dental care plan performance are available for immediate use. However, because the measures depend on diagnostic information (periodontal probing data and diagnoses associated with restorative treatments) in the administrative data set, their adoption will require changes in most plans' data systems and data collection policies.

Evaluation of audit-based performance measures for dental care plans.

OBJECTIVES: Although a set of clinical performance measures, i.e., a report card for dental plans, has been designed for use with administrative data, most plans do not have administrative data systems containing the data needed to calculate the measures. Therefore, we evaluated the use of a set of proxy clinical performance measures calculated from data obtained through chart audits. METHODS: Chart audits were conducted in seven dental programs--three public health clinics, two dental health maintenance organizations (DHMO), and two preferred provider organizations (PPO). In all instances audits were completed by clinical staff who had been trained using telephone consultation and a self-instructional audit manual. The performance measures were calculated for the seven programs, audit reliability was assessed in four programs, and for one program the audit-based proxy measures were compared to the measures calculated using administrative data. RESULTS: The audit-based measures were sensitive to known differences in program performance. The chart audit procedures yielded reasonably reliable data. However, missing data in patient charts rendered the calculation of some measures problematic--namely, caries and periodontal disease assessment and experience. Agreement between administrative and audit-based measures was good for most, but not all, measures in one program. CONCLUSIONS: The audit-based proxy measures represent a complex but feasible approach to the calculation of performance measures for those programs lacking robust administrative data systems. However, until charts contain more complete diagnostic information (i.e., periodontal charting and diagnostic codes or reason-for-treatment codes), accurate determination of these aspects of clinical performance will be difficult.