A new item response theory model for rater centrality using a hierarchical rater model approach.

Rater centrality, in which raters overuse middle scores for rating, is a common rater error which can affect test scores and subsequent decisions. Past studies on rater errors have focused on rater severity and inconsistency, neglecting rater centrality. This study proposes a new model within the hierarchical rater model framework to explicitly specify and directly estimate rater centrality in addition to rater severity and inconsistency. Simulations were conducted using the freeware JAGS to evaluate the parameter recovery of the new model and the consequences of ignoring rater centrality. The results revealed that the model had good parameter recovery with small bias, low root mean square errors, and high test score reliability, especially when a fully crossed linking design was used. Ignoring centrality yielded poor item difficulty estimates, person ability estimates, rater errors estimates, and underestimated reliability. We also showcase how the new model can be used, using an empirical example involving English essays in the Advanced Placement exam.

Assessing Differential Statement Functioning in Polytomous Multidimensional Pairwise Comparison Items.

Multidimensional pairwise comparison (MPC) items have been widely used to assess career interest, value and personality to avoid response bias in educational sectors. In reality, a statement in an MPC item may have different utilities for different groups, which is referred to as differential statement functioning (DSF). Few studies have been investigated DSF assessment. Based on a Rasch model for MPC items, this study adapts three methods to detect DSF for polytomous MPC items: the equal-mean-utility (EMU) method, the all-other-statement (AOS) method and the constant-statement (CS) method. Simulation study was conducted to evaluate the recovery of parameters as well as the performance of the proposed methods. Results showed that when the test contains DSF statement(s), the CS method where one or more DSF-free statements are chosen as an anchor will yield accurate estimates and perform well for DSF assessment. An empirical example of career interest assessment was provided. .

An Empirical Q-Matrix Validation Method for the Polytomous G-DINA Model.

A number of empirically based Q-matrix validation methods are available in the literature, all of which were developed for cognitive diagnosis models (CDMs) involving dichotomous attributes. However, in many applications, it is more instructionally relevant to classify students into more than two categories (e.g., no mastery, basic mastery, and advanced mastery). To extend the practical utility of CDMs, methods for validating the Q-matrix for CDMs that measure polytomous attributes are needed. This study focuses on validating the Q-matrix of the generalized deterministic input, noisy, "and" gate model for polytomous attributes (pG-DINA). The pGDI, an extension of the G-DINA model discrimination index, is proposed for polytomous attributes. The pGDI serves as the basis of a validation method that can be used not only to identify potential misspecified q-entries, but also to suggest more appropriate attribute-level specifications. The theoretical properties of the pGDI are underpinned by several mathematical proofs, whereas its practical viability is examined using simulation studies covering various conditions. The results show that the method can accurately identify misspecified q-entries and suggest the correct attribute-level specifications, particularly when high-quality items are involved. The pGDI is applied to a proportional reasoning test that measures several polytomous attributes.

Computerized Adaptive Testing for Ipsative Tests with Multidimensional Pairwise-Comparison Items: Algorithm Development and Applications.

A computerized adaptive testing (CAT) solution for tests with multidimensional pairwise-comparison (MPC) items, aiming to measure career interest, value, and personality, is rare. This paper proposes new item selection and exposure control methods for CAT with dichotomous and polytomous MPC items and present simulation study results. The results show that the procedures are effective in selecting items and controlling within-person statement exposure with no loss of efficiency. Implications are discussed in two applications of the proposed CAT procedures: a work attitude test with dichotomous MPC items and a career interest assessment with polytomous MPC items.

Assessment of Differential Statement Functioning in Ipsative Tests With Multidimensional Forced-Choice Items.

Ipsative tests with multidimensional forced-choice (MFC) items have been widely used to assess career interest, values, and personality to prevent response biases. Recently, there has been a surge of interest in developing item response theory models for MFC items. In reality, a statement in an MFC item may have different utilities for different groups, which is referred to as differential statement functioning (DSF). However, few studies have been investigated methods for detecting DSF owing to the challenges related to the features of ipsative tests. In this study, three methods were adapted for DSF assessment in MFC items: equal-mean-utility (EMU), all-other-statement (AOS), and constant-statement (CS). Simulation studies were conducted to evaluate the recovery of parameters and the performance of the proposed methods. Results showed that statement parameters and DSF parameters were well recovered for all the three methods when the test did not contain any DSF statement. When the test contained one or more DSF statements, only the CS method yielded accurate estimates. With respect to DSF assessment, both the EMU method using the bootstrap standard error and the AOS method performed appropriately so long as the test did not contain any DSF statement. The CS method performed well in cases where one or more DSF-free statements were chosen as an anchor. The longer the anchor statements, the higher the power of DSF detection.

Measuring dynamic goals for marriage: Development and validation of the Marital Goal Scale using Rasch modeling.

Both the dynamic goal theory of marital satisfaction and the suffocation model of marriage argue that whether people are satisfied with their marriage largely depends on their marital goals. However, the lack of a validated measure has greatly limited empirical investigations about marital goals. The current study developed the Marital Goal Scale (MGS) using Rasch modeling. We provided evidence for the validity of the scale scores and confirmed its factorial structure using confirmatory factor analysis. The MGS contains 3 subscales assessing personal growth, instrumental, and companionship goals, respectively. The functioning of each subscale with a 4-point rating scale was supported by Rasch modeling in a married sample (from Hong Kong and the United States) and an unmarried sample (from Hong Kong). The discriminant and convergent validity of the subscale scores were supported in both samples. Major assumptions of the dynamic goal theory were also examined and partially supported. The MGS provides a useful tool to support empirical research about marital goals. Future studies are encouraged to utilize this tool to further investigate the important role of marital goals in marital dynamics. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Multilevel Modeling of Cognitive Diagnostic Assessment: The Multilevel DINA Example.

Many multilevel linear and item response theory models have been developed to account for multilevel data structures. However, most existing cognitive diagnostic models (CDMs) are unilevel in nature and become inapplicable when data have a multilevel structure. In this study, using the log-linear CDM as the item-level model, multilevel CDMs were developed based on the latent continuous variable approach and the multivariate Bernoulli distribution approach. In a series of simulations, the newly developed multilevel deterministic input, noisy, and gate (DINA) model was used as an example to evaluate the parameter recovery and consequences of ignoring the multilevel structures. The results indicated that all parameters in the new multilevel DINA were recovered fairly well by using the freeware Just Another Gibbs Sampler (JAGS) and that ignoring multilevel structures by fitting the standard unilevel DINA model resulted in poor estimates for the student-level covariates and underestimated standard errors, as well as led to poor recovery for the latent attribute profiles for individuals. An empirical example using the 2003 Trends in International Mathematics and Science Study eighth-grade mathematical test was provided.

Item Response Theory Modeling for Examinee-selected Items with Rater Effect.

Some large-scale testing requires examinees to select and answer a fixed number of items from given items (e.g., select one out of the three items). Usually, they are constructed-response items that are marked by human raters. In this examinee-selected item (ESI) design, some examinees may benefit more than others from choosing easier items to answer, and so the missing data induced by the design become missing not at random (MNAR). Although item response theory (IRT) models have recently been developed to account for MNAR data in the ESI design, they do not consider the rater effect; thus, their utility is seriously restricted. In this study, two methods are developed: the first one is a new IRT model to account for both MNAR data and rater severity simultaneously, and the second one adapts conditional maximum likelihood estimation and pairwise estimation methods to the ESI design with the rater effect. A series of simulations was then conducted to compare their performance with those of conventional IRT models that ignored MNAR data or rater severity. The results indicated a good parameter recovery for the new model. The conditional maximum likelihood estimation and pairwise estimation methods were applicable when the Rasch models fit the data, but the conventional IRT models yielded biased parameter estimates. An empirical example was given to illustrate these new initiatives.

[Colonic dripping with Taihuang liquid for treatment of neonatal hyperbilirubinemia].

OBJECTIVE: To explore the clinical effects of colonic dripping with Taihuang liquid (THL) in treating neonatal hyperbilirubinemia (HBE). METHODS: One hundred and thirty-eight neonates with HBE were randomly assigned to two groups. Conventional treatment and nursing were given to both groups, and THL was given additionally to the observation group by colonic dripping. RESULTS: Significant differences between the observation group and the control group were shown in frequency of defecation (4.6 +/- 1.3 times/d vs 2.0 +/- 1.1 times/d), daily serum bilirubin reduction (31.5 +/- 10.1 micromol/L vs 23.3 +/- 8.3 micromol/L), and days for normalizing serum bilirubin level (5.6 +/- 3.5 d vs 7.8 +/- 4.1 d, all P < 0.01). CONCLUSION: Colonic dripping of THL could promote the excretion of bilirubin, so as to decrease the level of serum bilirubin in neonates with HBE.

[In vivo/in vitro evaluation of Kangfuxin colon targeting capsules].

OBJECTIVE: To evaluate the release in fixed position of pH-dependent and enzyme-dependent Kangfuxin colon targeting capsules in vivo and in vitro. METHOD: The dissolution was tested in vitro and X-ray radiography was used for the evaluation in vivo. RESULT: After two hours pH-dependent colon targeting in man-made colon fluid, medicine release in fixed position on the whole, colon loc-release. Add enzyme into man-made colon, when enzyme-dependent colon targeting in it, then medicine release quickly, mainly release in fixed position; The conveying time in vivo of pH-dependent and enzyme-dependent capsules have big individuality difference. In the experiment, disintegration is stabilize among individuales, between 2.0-3.5 hours. CONCLUSION: Kangfuxin colon targeting capsules of two principles all release in fixed position to achieve the goal.

[Preparation and in vivo evaluation of pH and time dependent Yuchangning tablets for colon-specific delivery].

OBJECTIVE: Taking Chinese compound medicine Yuchangning as a research model, prepared the pH and time dependent Yuchangning tablets for colon-specific delivery (PT-YT-CSD), and evaluated the releasing property in vitro. METHOD: The coating prescription is filtered by the release extent of matrine and oxymatrine in vitro and the wicking rate of the tablet, which including the category and proportion of film forming agent and porogen, the sort and dosage of fluidizing agent, the increment of weight after coating and so on. The releasing property of the preparation is evaluated by the dissolution tests in vitro through measuring the content of matrine and oxymatrine content. RESULT: The preparation method of the PYTCSD: After prepared plain tablets, the 95% alcoholic solution of EC and Eudragit II are mixed in a 7:3 EC: Eudragit II ratio and then added in DEP up to 10% of the coating amount, reduced the alcohol concentration to 4% by diluting with ethonal. Tablet was coated by the alcohol solution and the weight of the plain tablet was increased by 3%. The dissolution tests in vitro indicated that matrine and oxymatrine were not dissolved in the simulated gastric juice after 2 h. The accumulative quantities of matrine and oxymatrine were less than 10% in the simulated intestinal juice after 4 h. The quantities of matrine and oxymatrine are 75.7% and 76.8% in the simulated colon juice after 1 h. CONCLUSION: The PYTCSD was prepared and the preparation could fulfil the aim of delivering in the specific colon in vitro.

[Preparation of kangfuxin colon targeting micro-pellets].

OBJECTIVE: To prepare coated micro-pellets of pH-dependent and enzyme-dependent kangfuxin colon targeting delivery system, to make them go to colon, then release, educe partial effect. METHOD: We eploy pan-pill to prepare simple pellets, and prepare tunicatus pellets with fluidized bed coating. We investigated the preparation and parameter of pellets, so, we bolting the best shaping and tunicatus artwork. RESULT: The ingredients for preparing the micro-pellets are 125% starch +2% CMC-Na, and add 30% ethanol to be binder, pellets were coated with Eudragit S100 to prepare ph-dependent and pectin-HPMC to prepare enzyme-dependent colon targeting micro-pellets. CONCLUSION: We get two micro-pellets of pH-dependent and enzyme-dependent kangfuxin colon targeting.

Item Response Theory Models for Ipsative Tests With Multidimensional Pairwise Comparison Items.

There is re-emerging interest in adopting forced-choice items to address the issue of response bias in Likert-type items for noncognitive latent traits. Multidimensional pairwise comparison (MPC) items are commonly used forced-choice items. However, few studies have been aimed at developing item response theory models for MPC items owing to the challenges associated with ipsativity. Acknowledging that the absolute scales of latent traits are not identifiable in ipsative tests, this study developed a Rasch ipsative model for MPC items that has desirable measurement properties, yields a single utility value for each statement, and allows for comparing psychological differentiation between and within individuals. The simulation results showed a good parameter recovery for the new model with existing computer programs. This article provides an empirical example of an ipsative test on work style and behaviors.

A Multidimensional and Multilevel Extension of a Random-Effect Approach to Subjective Judgment in Rating Scales.

In responding to rating scale items, respondents may hold different perspectives on the given categories. The random-effect rating scale model (RERSM), developed to account for variations in the category thresholds across respondents, is unidimensional and unilevel. It becomes statistically inefficient when multiple unidimensional tests have to be analyzed and inapplicable when data have a multilevel structure (e.g., respondents nested within organizations, students nested within schools). To resolve these problems, this study develops a multidimensional and multilevel version of the RERSM. The parameters can be estimated with existing computer software. Thus, there is no need to develop estimation procedures or corresponding computer programs. Simulation studies were conducted to evaluate the parameter recovery of the multidimensional RERSM, the multilevel RERSM, and the multidimensional and multilevel RERSM using WinBUGS. The results showed that the parameter recovery was generally satisfactory. An empirical example of the application of the multidimensional and multilevel RERSM to 2006 Program for International Student Assessment inventories about attitudes toward learning sciences is provided.