Assessing the completeness of periodontal disease documentation in the EHR: a first step in measuring the quality of care.

BACKGROUND: Our objective was to measure the proportion of patients for which comprehensive periodontal charting, periodontal disease risk factors (diabetes status, tobacco use, and oral home care compliance), and periodontal diagnoses were documented in the electronic health record (EHR). We developed an EHR-based quality measure to assess how well four dental institutions documented periodontal disease-related information. An automated database script was developed and implemented in the EHR at each institution. The measure was validated by comparing the findings from the measure with a manual review of charts. RESULTS: The overall measure scores varied significantly across the four institutions (institution 1 = 20.47%, institution 2 = 0.97%, institution 3 = 22.27% institution 4 = 99.49%, p-value < 0.0001). The largest gaps in documentation were related to periodontal diagnoses and capturing oral homecare compliance. A random sample of 1224 charts were manually reviewed and showed excellent validity when compared with the data generated from the EHR-based measure (Sensitivity, Specificity, PPV, and NPV > 80%). CONCLUSION: Our results demonstrate the feasibility of developing automated data extraction scripts using structured data from EHRs, and successfully implementing these to identify and measure the periodontal documentation completeness within and across different dental institutions.

Developing and Testing Electronic Health Record-Derived Caries Indices.

Caries indices, the basis of epidemiologic caries measures, are not easily obtained in clinical settings. This study's objective was to design, test, and validate an automated program (Valid Electronic Health Record Dental Caries Indices Calculator Tool [VERDICT]) to calculate caries indices from an electronic health record (EHR). Synthetic use case scenarios and actual patient cases of primary, mixed, and permanent dentition, including decayed, missing, and filled teeth (DMFT/dmft) and tooth surfaces (DMFS/dmfs) were entered into the EHR. VERDICT measures were compared to a previously validated clinical electronic data capture (EDC) system and statistical program to calculate caries indices. Four university clinician-researchers abstracted EHR caries exam data for 45 synthetic use cases into the EDC and post-processed with SAS software creating a gold standard to compare the -VERDICT-derived caries indices. Then, 2 senior researchers abstracted EHR caries exam data and calculated caries indices for 24 patients, allowing further comparisons to VERDICT indices. Agreement statistics were computed among abstractors, and discrepancies were resolved by consensus. Agreement statistics between the 2 final-phase abstractors and the VERDICT measures showed extremely high concordance: Lin's concordance coefficients (LCCs) >0.99 for dmfs, dmft, DS, ds, DT, dt, ms, mt, FS, fs, FT, and ft; LCCs >0.95 for DMFS and DMFT; and LCCs of 0.92-0.93 for MS and MT. Caries indices, essential to developing primary health outcome measures for research, can be reliably derived from an EHR using VERDICT. Using these indices will enable population oral health management approaches and inform quality improvement efforts.

Periodontal Management by Risk Assessment: A Pragmatic Approach.

UNLABELLED: An evidence-based periodontal disease risk assessment and diagnosis system has been developed and combined with a clinical decision support and management program to improve treatment and measure patient outcomes. BACKGROUND: There is little agreement on a universally accepted periodontal risk assessment, periodontal diagnosis, and treatment management tool and their incorporation into dental practice to improve patient care. This article highlights the development and use of a practical periodontal management and risk assessment program that can be implemented in dental settings. METHODS: The approach taken by Willamette Dental Group to develop a periodontal disease risk assessment, periodontal diagnosis, and treatment management tool is described using evidence-based best practices. With goals of standardized treatment interventions while maintaining personalized care and improved communication, this process is described to facilitate its incorporation into other dental settings. CONCLUSIONS: Current electronic health records can be leveraged to enhance patient-centered care through the use of risk assessments and standardized guidelines to more effectively assess, diagnose, and treat patients to improve outcomes. Dental hygienists, and other committed providers, with their emphasis on prevention of periodontal disease can be principal drivers in creation and implementation of periodontal risk assessments and personalized treatment planning. Willamette Dental Group believes that such evidence-based tools can advance dentistry to new diagnostic and treatment standards.

Improvements in appropriate placement of dental sealants after implementation of a clinical decision support system.

BACKGROUND: Dental sealants are effective for the prevention of caries in children at elevated risk levels, and increasing the proportion of children and adolescents who have dental sealants on 1 or more molars is a Healthy People 2030 objective. Electronic health record (EHR)-based clinical decision support systems (CDSSs) have the ability to improve patient care. A dental quality measure related to dental sealant placement for children at elevated risk of caries was targeted for improvement using a CDSS. METHODS: A validated dental quality measure was adapted to assess a patient's need for dental sealant placement. A CDSS was implemented to advise care team members whether a child was at elevated risk of developing caries and had sealant-eligible first or second molars. Data on dental sealant placement at examination visits during a 5-year period were analyzed, including 32 months before CDSS implementation and 28 months after CDSS implementation. RESULTS: From January 1, 2018, through December 31, 2022, the authors assessed 59,047 examination visits for children at elevated risk of developing caries and with sealant-eligible teeth. With the implementation of a CDSS and training to support the clinical care team members in September 2020, the appropriate placement of dental sealants at examination visits increased from 27% through 60% (P < .00001). CONCLUSIONS: Integration of a CDSS into the EHR as part of a quality improvement program was effective in increasing the delivery of sealants in eligible first and second molars of children aged 5 through 15 years and considered at high risk of developing caries. PRACTICAL IMPLICATIONS: An EHR-based CDSS can be implemented to improve standardization and provide timely and appropriate patient care in dental practices.

Lost in the Shuffle: Low Health Literacy in Geriatric Fracture Patients and Families Regarding Post-Acute Care-A Prospective Study.

INTRODUCTION: This study aims to evaluate health literacy (HL) in geriatric orthopaedic trauma patients and their families as it relates to their post-acute care (PAC) in skilled nursing facilities (SNFs) and inpatient rehabilitation facilities (IRFs). METHODS: This nonrandomized controlled clinical trial included patients aged 65 years and older treated for acute fracture at a Level 1 trauma center and discharged to either IRF or SNF. First 106 patients enrolled served as the control group and received standard discharge instructions. The second 101 patients were given a set of oral and written instructions regarding PAC detailing important questions to ask upon arrival to their facility. RESULTS: The mean HL score for all patients/families was 2.4 out of 5. No significant difference was noted in HL scores (2.4 versus 2.3) or median LOS (22 versus 28 days) between the control and intervention groups. Family involvement (68%) slightly improved HL scores (2.6 versus 1.9, P < 0.001). Patients discharged to IRF had better HL scores (3.4 versus 2.3, P < 0.001), shorter LOS (median 15 vs 30 days, P < 0.001), and trended toward improved knowledge of discharge goals (48.1% versus 35.6%) than those in SNF. CONCLUSION: System-wide solutions are necessary to improve geriatric HL and optimize outcomes in orthopaedic trauma.

Systematically assessing the quality of dental electronic health record data for an investigation into oral health care disparities.

OBJECTIVES: This work describes the process by which the quality of electronic health care data for a public health study was determined. The objectives were to adapt, develop, and implement data quality assessments (DQAs) based on the National Institutes of Health Pragmatic Trials Collaboratory (NIHPTC) data quality framework within the three domains of completeness, accuracy, and consistency, for an investigation into oral health care disparities of a preventive care program. METHODS: Electronic health record data for eligible children in a dental accountable care organization of 30 offices, in Oregon, were extracted iteratively from January 1, 2014, through March 31, 2022. Baseline eligibility criteria included: children ages 0-18 with a baseline examination, Oregon home address, and either Medicaid or commercial dental benefits at least once between 2014 and 2108. Using the NIHPTC framework as a guide, DQAs were conducted throughout data element identification, extraction, staging, profiling, review, and documentation. RESULTS: The data set included 91,487 subjects, 11 data tables comprising 75 data variables (columns), with a total of 6,861,525 data elements. Data completeness was 97.2%, the accuracy of EHR data elements in extracts was 100%, and consistency between offices was strong; 29 of 30 offices within 2 standard deviations of the mean (s = 94%). CONCLUSIONS: The NIHPTC framework proved to be a useful approach, to identify, document, and characterize the dataset. The concepts of completeness, accuracy, and consistency were adapted by the multidisciplinary research team and the overall quality of the data are demonstrated to be of high quality.

Evaluating and improving the usability of a mHealth platform to assess postoperative dental pain.

Objectives: The use of interactive mobile health (mHealth) applications to monitor patient-reported postoperative pain outcomes is an emerging area in dentistry that requires further exploration. This study aimed to evaluate and improve the usability of an existing mHealth application. Materials and methods: The usability of the application was assessed iteratively using a 3-phase approach, including a rapid cognitive walkthrough (Phase I), lab-based usability testing (Phase II), and in situ pilot testing (Phase III). The study team conducted Phase I, while providers and patients participated in Phase II and III. Results: The rapid cognitive walkthrough identified 23 potential issues that could negatively impact user experience, with the majority classified as system issues. The lab-based usability testing yielded 141 usability issues.; 43% encountered by patients and 57% by dentists. Usability problems encountered during pilot testing included undelivered messages due to mobile phone carrier and service-related issues, errors in patients' phone number data entry, and problems in provider training. Discussion: Through collaborative and iterative work with the vendor, usability issues were addressed before launching a trial to assess its efficacy. Conclusion: The usability of the mHealth application for postoperative dental pain was remarkably improved by the iterative analysis and interdisciplinary collaboration.

Development of quality measures to assess tooth decay outcomes from electronic health record data.

OBJECTIVES: To develop outcomes of care quality measures derived from the dental electronic health record (EHR) to assess the occurrence and timely treatment of tooth decay. METHODS: Quality measures were developed to assess whether decay was treated within 6 months and if new decay occurred in patients seen. Using EHR-derived data of the state of each tooth surface, algorithms compared the patient's teeth at different dates to determine if decay was treated or new decay had occurred. Manual chart reviews were conducted at three sites to validate the measures. The measures were implemented and scores were calculated for three sites over four calendar years, 2016 through 2019. RESULTS: About 954 charts were manually reviewed for the timely treatment of tooth decay measure, with measure performance of sensitivity 97%, specificity 85%, positive predictive value (PPV) 91%, negative predictive value (NPV) 95%. About 739 charts were reviewed for new decay measure, with sensitivity 94%, specificity 99%, PPV 99%, and NPV 94%. Across all sites and years, 52.8% of patients with decay were fully treated within 6 months of diagnosis (n = 247,959). A total of 23.8% of patients experienced new decay, measured at an annual exam (n = 640,004). CONCLUSION: Methods were developed and validated for assessing timely treatment of decay and occurrence of new decay derived from EHR data, creating effective outcome measures. These EHR-based quality measures produce accurate and reliable results that support efforts and advancement in quality assessment, quality improvement, patient care and research.

Evaluating the Impact of an mHealth Platform for Managing Acute Postoperative Dental Pain: Randomized Controlled Trial.

Background: Postoperative dental pain is pervasive and can affect a patient's quality of life. Adopting a patient-centric approach to pain management involves having contemporaneous information about the patient's experience of pain and using it to personalize care. Objective: In this study, we evaluated the use of a mobile health (mHealth) platform to collect pain-related patient-reported outcomes over 7 days after the patients underwent pain-inducing dental procedures; we then relayed the information to the dentist and determined its impact on the patient's pain experience. Methods: The study used a cluster-randomized experimental study design with an intervention arm where patients were prompted to complete a series of questions relating to their pain experience after receiving automated text notifications on their smartphone on days 1, 3, 5, and 7, with the resulting information fed back to dentists, and a control arm where patients received usual care. Providers were randomized, and patients subsequently assumed the enrollment status of their providers. Providers or their staff identified eligible patients and invited them to participate in the study. Provider interviews and surveys were conducted to evaluate acceptance of the mHealth platform. Results: A total of 42 providers and 1525 patients participated. For the primary outcome (pain intensity on a 1 to 10 scale, with 10 being the most painful), intervention group patients reported an average pain intensity of 4.8 (SD 2.6), while those in the control group reported an average pain intensity of 4.7 (SD 2.8). These differences were not significant. There were also no significant differences in secondary outcomes, including pain interference with activity or sleep, patient satisfaction with pain management, or opioid prescribing. Patient surveys revealed reluctance to use the app was mostly due to technological challenges, data privacy concerns, and a preference for phone calls over texting. Providers had high satisfaction with the app and suggested integrating additional features, such as an in-system camera for patients to upload pictures and videos of the procedural site, and integration with the electronic health record system. Conclusions: While the mHealth platform did not have a significant impact on acute postoperative pain experience, patients and providers indicated improvement in patient-provider communication, patient-provider relationship, postoperative complication management, and ability to manage pain medication prescribing. Expanded collaboration between mHealth developers and frontline health care providers can facilitate the applicability of these platforms, further help improve its integration with the normal clinic workflow, and assist in moving toward a more patient-centric approach to pain management.

Translating periodontal data to knowledge in a learning health system.

BACKGROUND: A learning health system (LHS) is a health system in which patients and clinicians work together to choose care on the basis of best evidence and to drive discovery as a natural outgrowth of every clinical encounter to ensure the right care at the right time. An LHS for dentistry is now feasible, as an increased number of oral health care encounters are captured in electronic health records (EHRs). METHODS: The authors used EHRs data to track periodontal health outcomes at 3 large dental institutions. The 2 outcomes of interest were a new periodontitis case (for patients who had not received a diagnosis of periodontitis previously) and tooth loss due to progression of periodontal disease. RESULTS: The authors assessed a total of 494,272 examinations (new periodontitis outcome: n = 168,442; new tooth loss outcome: n = 325,830), representing a total of 194,984 patients. Dynamic dashboards displaying performance on both measures over time allow users to compare demographic and risk factors for patients. The incidence of new periodontitis and tooth loss was 4.3% and 1.2%, respectively. CONCLUSIONS: Periodontal disease, diagnosis, prevention, and treatment are particularly well suited for an LHS model. The results showed the feasibility of automated extraction and interpretation of critical data elements from the EHRs. The 2 outcome measures are being implemented as part of a dental LHS. The authors are using this knowledge to target the main drivers of poorer periodontal outcomes in a specific patient population, and they continue to use clinical health data for the purpose of learning and improvement. PRACTICAL IMPLICATIONS: Dental institutions of any size can conduct contemporaneous self-evaluation and immediately implement targeted strategies to improve oral health outcomes.

Caries Risk Documentation And Prevention: eMeasures For Dental Electronic Health Records.

BACKGROUND: Longitudinal patient level data available in the electronic health record (EHR) allows for the development, implementation, and validations of dental quality measures (eMeasures). OBJECTIVE: We report the feasibility and validity of implementing two eMeasures. The eMeasures determined the proportion of patients receiving a caries risk assessment (eCRA) and corresponding appropriate risk-based preventative treatments for patients at elevated risk of caries (appropriateness of care [eAoC]) in two academic institutions and one accountable care organization, in the 2019 reporting year. METHODS: Both eMeasures define the numerator and denominator beginning at the patient level, populations' specifications, and validated the automated queries. For eCRA, patients who completed a comprehensive or periodic oral evaluation formed the denominator, and patients of any age who received a CRA formed the numerator. The eAoC evaluated the proportion of patients at elevated caries risk who received the corresponding appropriate risk-based preventative treatments. RESULTS: EHR automated queries identified in three sites 269,536 patients who met the inclusion criteria for receiving a CRA. The overall proportion of patients who received a CRA was 94.4% (eCRA). In eAoC, patients at elevated caries risk levels (moderate, high, or extreme) received fluoride preventive treatment ranging from 56 to 93.8%. For patients at high and extreme risk, antimicrobials were prescribed more frequently site 3 (80.6%) than sites 2 (16.7%) and 1 (2.9%). CONCLUSION: Patient-level data available in the EHRs can be used to implement process-of-care dental eCRA and AoC, eAoC measures identify gaps in clinical practice. EHR-based measures can be useful in improving delivery of evidence-based preventative treatments to reduce risk, prevent tooth decay, and improve oral health.

How do you implement value-based care methodologies in dentistry with existing dental organizational paradigms?

The U.S. healthcare sector is a paradox - achieving comparatively poor population health outcomes despite outspending the world - and the current paradigm is a dichotomy - pursuing value definition consisting of quality, outcome, and cost, but failing to act in aligned and informed manner. In 2018, U.S. dental spending was $136 billion, accounting for 3.7 percent of total healthcare spending, a relatively nominal amount when considering oral diseases are among the most prevalent and have serious health and economic burdens, greatly reducing quality of life for those affected. Consistent and growing evidence shows that primary care-oriented systems achieve better health outcomes, more health equity, and lower costs; however, to date, there is little means to structuralize the role of oral health and quantify the value provided. To understand the reasons behind the abstract nature of value-based care requires an in-depth understanding of the drivers impeding the transition to a value based oral health system of care. One large clinically integrated network will provide detail of their experience.

Tracking oral health in a standardized, evidence-based, prevention-focused dental care system.

OBJECTIVES: Learning health-care systems are foundational for measuring and achieving value in oral health care. This article describes the components of a preventive dental care program and the quality of care in a large dental accountable care organization. METHODS: A retrospective study design describes and evaluates the cross-sectional measures of process of care (PoC), appropriateness of care (AoC), and outcomes of care (OoC) extracted from the electronic health record (EHR), between 2014 and 2019. Annual and composite measures are derived from EHR-based clinical decision support for risk determination, diagnostic and treatment terminology, and decayed-missing-filled-teeth (DMFT) measures. RESULTS: Annually, 253,515 ± 27,850 patients were cared for with 618,084 ± 80,559 visits, 209,366 ± 22,300 exams, and 2,072,844 ± 300,363 clinical procedures. PoC metrics included provider adherence (98.3 percent) in completing caries risk assessments and patient receipt (96.9 percent) of a proactive dental care plan. AoC metrics included patients receiving prevention according to the risk-based protocol. The percent of patients at risk for caries receiving fluoride varnish was 95.4 ± 0.4 percent. OoC metrics included untreated decay and new decay. The 6-year average prevalence of untreated decay was 11.3 ± 0.3 percent, and average incidence of new decay was 13.6 ± 0.5 percent, increasing with risk level: low = 7.5 percent, medium = 18.8 percent, high = 29.4 percent, and extreme = 28.1 percent. CONCLUSIONS: The preventive dental care system demonstrates excellent provider adherence to the evidence-based prevention protocol, with measurably better dental outcomes by patient risk compared to national estimates. These achievements are enabled by a value-centric, accountable model of care and incentivized by a compensation model aligned with performance measures.

Measuring sealant placement in children at the dental practice level.

BACKGROUND: Although sealants are an established and recommended caries-preventive treatment, many children still fail to receive them. In addition, research has shown that existing measures underestimate care by overlooking the sealable potential of teeth before evaluating care. To address this, the authors designed and evaluated 3 novel dental electronic health record-based clinical quality measures that evaluate sealant care only after assessing the sealable potential of teeth. METHODS: Measure I recorded the proportion of patients with sealable teeth who received sealants. Measure II recorded the proportion of patients who had at least 1 of their sealable teeth sealed. Measure III recorded the proportion of patients who received sealant on all of their sealable teeth. RESULTS: On average, 48.1% of 6- through 9-year-old children received 1 or more sealants compared with 32.4% of 10- through 14-year-olds (measure I). The average measure score decreased for patients who received sealants for at least 1 of their sealable teeth (measure II) (43.2% for 6- through 9-year-olds and 28.4% for 10- through 14-year-olds). Fewer children received sealants on all eligible teeth (measure III) (35.5% of 6- through 9-year-olds and 21% of 10- through 14-year-olds received sealant on all eligible teeth). Among the 48.5% who were at elevated caries risk, the sealant rates were higher across all 3 measures. CONCLUSIONS: A valid and actionable practice-based sealant electronic measure that evaluates sealant treatment among the eligible population, both at the patient level and the tooth level, has been developed. PRACTICAL IMPLICATIONS: The measure developed in this work provides practices with patient-centered and actionable sealant quality measures that aim to improve oral health outcomes.

Number of Pregnant Women at Four Dental Clinics and the Care They Received: A Dental Quality eMeasure Evaluation.

Process-of-care quality measure research can be used to identify gaps in the delivery of dental services to pregnant patients. The aim of this study was to evaluate the types of dental services that pregnant patients received in four dental clinics over five years as documented in the electronic health record (EHR). To accomplish this objective, the authors modified and validated a previously published claims-based dental quality measure for EHR use. After the electronic dental quality measure specifications were defined, the number of pregnant patients was calculated at three academic dental institutions and one large accountable care organization, and the types of dental care services they received over a five-year period (2013-17) were determined. Calibrated reviewers at each institution independently reviewed a sub-sample of patient charts to validate the information obtained from EHR queries, and the concordance between manual chart reviews and EHR query reports was analyzed. Of the 335,078 women aged 15-44 years who received care at the four clinics for the five reporting years, 3.9% (n=13,026) were pregnant. Among these pregnant patients, 48.9% (n=6,366) received a periodic dental examination; 30.0% (n=3,909) received a comprehensive dental exam; and 21.5% (n=2,799) received additional dental services, irrespective of comprehensive or periodic oral evaluations. Overall, the mean proportion of pregnant patients seeking care in these academic dental and group practice clinics was low, but 78.9% of them received either a periodic or comprehensive oral evaluation. Given the importance of oral health care during pregnancy, these findings suggest a need for curriculum development to incorporate prenatal oral health education in the training of dental students.

Tobacco screening and cessation efforts by dental providers: A quality measure evaluation.

OBJECTIVES: The purpose of this study was to adapt, test, and evaluate the implementation of a primary care "Preventive care and Screening" meaningful use quality measure for tobacco use, in dental institutions. We determined the percentage of dental patients screened for tobacco use, and the percentage of tobacco users who received cessation counseling. METHODS: We implemented the dental quality measure (DQM), in three dental schools and a large dental accountable care organization. An automated electronic health record (EHR) query identified patients 18 years and older who were screened for tobacco use one or more times within 24 months, and who received cessation counseling intervention if identified as a tobacco user. We evaluated EHR query performance with a manual review of a subsample of charts. RESULTS: Across all four sites, in the reporting calendar year of 2015, a total of 143,675 patients met the inclusion criteria for the study. Within 24 months, including 2014 and 2015 calendar years, percentages of tobacco screening ranged from 79.7 to 99.9 percent, while cessation intervention percentages varied from 1 to 81 percent among sites. By employing DQM research methodology, we identified intervention gaps in clinical practice. CONCLUSIONS: We demonstrated the successful implementation of a DQM to evaluate screening rates for tobacco use and cessation intervention. There is substantial variation in the cessation intervention rates across sites, and these results are a call for action for the dental profession to employ tobacco evidence-based cessation strategies to improve oral health and general health outcomes.

Assessing the validity of existing dental sealant quality measures.

BACKGROUND: Although sealants are highly effective in preventing caries in children, placement rates continue to be low. The authors' goals were to implement and assess the performance of 2 existing sealant quality measures against a manual audit of charts at 4 dental institutions and to identify measurement gaps that may be filled by using data from electronic health records. METHODS: The authors evaluated the performance of 2 quality measures designed for claims-based data: the Dental Quality Alliance (DQA) sealant measure, which includes patients at risk of developing elevated caries, and the Oregon Health Authority (OHA) sealant measure (irrespective of caries risk). The authors adapted and validated these measures at 4 sites: 3 dental schools and 1 large dental accountable care organization. RESULTS: The overall modified DQA and modified OHA measure scores in the 6- through 9-year-old age group were 37.0% and 31.6% and in the 10- through 14-year-old age group were 15.8% and 6.6%, respectively. Results from the manual review of charts showed that 67.6% of children who did not receive sealants did not have any teeth to seal because their molars had not yet erupted, had been extracted, had been sealed previously, or had existing caries or restorations. CONCLUSIONS: Both the DQA and OHA measures, which rely mainly on Current Dental Terminology procedure codes, led to underestimation of the care delivered from a practice perspective. Future sealant quality measures should exclude patients whose teeth cannot be sealed. PRACTICAL IMPLICATIONS: This study's results support the suitability of using electronic health record data for assessing the quality of oral health care, particularly for measuring sealant placement in children.

Evaluating quality of dental care among patients with diabetes: Adaptation and testing of a dental quality measure in electronic health records.

BACKGROUND: Patients with diabetes are at increased risk of developing oral complications, and annual dental examinations are an endorsed preventive strategy. The authors evaluated the feasibility and validity of implementing an automated electronic health record (EHR)-based dental quality measure to determine whether patients with diabetes received such evaluations. METHODS: The authors selected a Dental Quality Alliance measure developed for claims data and adapted the specifications for EHRs. Automated queries identified patients with diabetes across 4 dental institutions, and the authors manually reviewed a subsample of charts to evaluate query performance. After assessing the initial EHR measure, the authors defined and tested a revised EHR measure to capture better the oral care received by patients with diabetes. RESULTS: In the initial and revised measures, the authors used EHR automated queries to identify 12,960 and 13,221 patients with diabetes, respectively, in the reporting year. Variations in the measure scores across sites were greater with the initial measure (range, 36.4-71.3%) than with the revised measure (range, 78.8-88.1%). The automated query performed well (93% or higher) for sensitivity, specificity, and positive and negative predictive values for both measures. CONCLUSIONS: The results suggest that an automated EHR-based query can be used successfully to measure the quality of oral health care delivered to patients with diabetes. The authors also found that using the rich data available in EHRs may help estimate the quality of care better than can relying on claims data. PRACTICAL IMPLICATIONS: Detailed clinical patient-level data in dental EHRs may be useful to dentists in evaluating the quality of dental care provided to patients with diabetes.