A validation study of the Australian Maternity Care Classification System.

BACKGROUND: The Maternity Care Classification System is a novel system developed in Australia to classify models of maternity care based on their characteristics. It will enable large-scale evaluations of maternal and perinatal outcomes under different models of care independently of the model's name. AIM: To assess the accuracy, repeatability and reproducibility of the Maternity Care Classification System. METHOD: All 70 public maternity services in New South Wales, Australia, were invited to classify three randomly allocated model case-studies using a web-based survey tool and repeat their classifications 4-6 weeks later. Accuracy of classifications was assessed against the correct values for the case-studies; repeatability (intra-rater reliability) was analysed by percent agreement and McNemar's test between the same participants in both surveys; and reproducibility (inter-rater reliability) was assessed by percent agreement amongst raters of the same case-study combined with Krippendorff's alpha coefficient for a subset of characteristics. RESULTS: The accuracy of the Maternity Care Classification System was high with 90.8% of responses correctly classified; was repeatable, with no statistically significant change in the responses between the two survey instances (mean agreement 91.5%, p>0.05 for all but one variable); and was reproducible with a mean percent agreement across 9 characteristics of 83.6% and moderate to substantial agreement as assessed by a Krippendorff's alpha coefficient of 0.4-0.8. CONCLUSION: The results indicate the Maternity Care Classification System is a valid system for classifying models of care in Australia, and will enable the legitimate evaluation of outcomes by different models of care.

More than a name: Heterogeneity in characteristics of models of maternity care reported from the Australian Maternity Care Classification System validation study.

BACKGROUND: Without a standard terminology to classify models of maternity care, it is problematic to compare and evaluate clinical outcomes across different models. The Maternity Care Classification System is a novel system developed in Australia to classify models of maternity care based on their characteristics and an overarching broad model descriptor (Major Model Category). AIM: This study aimed to assess the extent of variability in the defining characteristics of models of care grouped to the same Major Model Category, using the Maternity Care Classification System. METHOD: All public hospital maternity services in New South Wales, Australia, were invited to complete a web-based survey classifying two local models of care using the Maternity Care Classification System. A descriptive analysis of the variation in 15 attributes of models of care was conducted to evaluate the level of heterogeneity within and across Major Model Categories. RESULTS: Sixty-nine out of seventy hospitals responded, classifying 129 models of care. There was wide variation in a number of important attributes of models classified to the same Major Model Category. The category of 'Public hospital maternity care' contained the most variation across all characteristics. CONCLUSION: This study demonstrated that although models of care can be grouped into a distinct set of Major Model Categories, there are significant variations in models of the same type. This could result in seemingly 'like' models of care being incorrectly compared if grouped only by the Major Model Category.