Combining Item Purification and Multiple Comparison Adjustment Methods in Detection of Differential Item Functioning.

Many of the differential item functioning (DIF) detection methods rely on a principle of testing for DIF item by item, while considering the rest of the items or at least some of them being DIF-free. Computational algorithms of these DIF detection methods involve the selection of DIF-free items in an iterative procedure called item purification. Another aspect is the need to correct for multiple comparisons, which can be done with a number of existing multiple comparison adjustment methods. In this article, we demonstrate that implementation of these two controlling procedures together may have an impact on which items are detected as DIF items. We propose an iterative algorithm combining item purification and adjustment for multiple comparisons. Pleasant properties of the newly proposed algorithm are shown with a simulation study. The method is demonstrated on a real data example.

On the Developmental Trajectories of Relational Concepts Among Children and Adolescents With Intellectual Disability of Undifferentiated Etiology.

The aim of this study was to examine the developmental trajectories of comprehension of relational concepts among 557 participants with intellectual disability (ID) of undifferentiated etiology (M age  =  12.20 years, SD  =  3.18) and 557 typically developing (TD) participants (M age  =  4.57 years, SD  =  0.80). Logistic regression analyses, with nonverbal cognitive level entered first in the equations, showed only negligible differences with regard to the discriminative power of each of the 72 concepts used as outcome variables, and moderate differences in difficulty for only three items. A moderate mixed effect (i.e., combining a group difference in difficulty and discriminative power) was observed for a fourth item. It is concluded that the developmental trajectories of relational concepts are similar for participants with or without ID. The implications and limitations of the study are discussed.

Efficient Standard Errors in Item Response Theory Models for Short Tests.

In dichotomous item response theory (IRT) framework, the asymptotic standard error (ASE) is the most common statistic to evaluate the precision of various ability estimators. Easy-to-use ASE formulas are readily available; however, the accuracy of some of these formulas was recently questioned and new ASE formulas were derived from a general asymptotic theory framework. Furthermore, exact standard errors were suggested to better evaluate the precision of ability estimators, especially with short tests for which the asymptotic framework is invalid. Unfortunately, the accuracy of exact standard errors was assessed so far only in a very limiting setting. The purpose of this article is to perform a global comparison of exact versus (classical and new formulations of) asymptotic standard errors, for a wide range of usual IRT ability estimators, IRT models, and with short tests. Results indicate that exact standard errors globally outperform the ASE versions in terms of reduced bias and root mean square error, while the new ASE formulas are also globally less biased than their classical counterparts. Further discussion about the usefulness and practical computation of exact standard errors are outlined.

Does the Development of Syntax Comprehension Show a Premature Asymptote Among Persons With Down Syndrome? A Cross-Sectional Analysis.

Uncertainty persists regarding the post-childhood trajectory of syntactic acquisition of persons with Down syndrome (DS). In some studies, asymptote is reached in the early teens, whereas others find syntax continuing to develop at least into early adulthood. This study addressed the issue using a cross-sectional approach. Receptive syntax and vocabulary were tested in 62 children, adolescents and young adults with DS matched on chronological age and cognitive level with 62 participants with intellectual disability (ID) of undifferentiated etiology. On both tests there were significant effects of chronological age and diagnosis, but the chronological age × diagnosis interactions were nonsignificant. We concluded that comprehension of vocabulary and syntax does not asymptote prematurely in individuals with DS relative to those with other forms of ID.

Basic visual perceptual processes in children with typical development and cerebral palsy: The processing of surface, length, orientation, and position.

The present study aims to assess how the processing of basic visual perceptual (VP) components (length, surface, orientation, and position) develops in typically developing (TD) children (n = 215, 4-14 years old) and adults (n = 20, 20-25 years old), and in children with cerebral palsy (CP) (n = 86, 5-14 years old) using the first four subtests of the Battery for the Evaluation of Visual Perceptual and Spatial processing in children. Experiment 1 showed that these four basic VP processes follow distinct developmental trajectories in typical development. Experiment 2 revealed that children with CP present global and persistent deficits for the processing of basic VP components when compared with TD children matched on chronological age and nonverbal reasoning abilities.

Rectal cancer treatment in a teaching hospital.

BACKGROUND: Rectal adenocarcinomas surgery morbidity and mortality might be impaired by neoadjuvant therapy. We performed this retropsective study to be compared with the PROCARE study running afterwards. METHODS: We performed a retrospective study of 95 patients operated on for rectal adenocarcinoma in a single institution during the period of 2007-2009. We used logistic regression to estimate the relationship between possible predictive parameters of anastomotic leakage (AL). RESULTS: The laparoscopic approach is favored in 63.1% of the cases with a conversion rate of 11.6%, mainly in man (6 out of 7). For low rectal cancer though, laparotomy was the first choice (92.3%). From a carcinological point of view, laparoscopy allowed a complete tumor resection according to the PME (n = 27) and TME (n = 26) standards. Multivariate analysis revealed that women, lower BMI, lower rectum tumor, laparoscopic surgery, neoadjuvant treatment and anal suture were associated with higher risk of AL. The mean hospital stay was 15.4 days (3-46 days) with an in-hospital mortality rate of 3.1%. Adjuvant chemotherapy was completed in 42.1% of the patients. Despite these treatments, we registered a recurrence rate of 26.6%. Of these, 72% were distally localized and 12% exclusively locally. Among the patients operated on by laparoscopy, there was one local recurrence and one local with distant metastases (3.7%). The one- and three-year survival rates were 91.5% and 80.4%, respectively. CONCLUSIONS: Our study showed a higher rate of AL than expected (18%). In our series recorded in PROCARE-Home, our leak rate has dropped to 10%. It may be indicating a positive effect of PROCARE.

On the Finiteness of the Weighted Likelihood Estimator of Ability.

The purpose of this note is to focus on the finiteness of the weighted likelihood estimator (WLE) of ability in the context of dichotomous and polytomous item response theory (IRT) models. It is established that the WLE always returns finite ability estimates. This general result is valid for dichotomous (one-, two-, three- and four-parameter logistic) IRT models, the class of polytomous difference models and divide-by-total models, independently of the number of items, the item parameters and the response patterns. Further implications of this result are outlined.

An Item Analysis of the French Version of the Test for Reception of Grammar Among Children and Adolescents With Down Syndrome or Intellectual Disability of Undifferentiated Etiology.

Purpose: An item analysis of Bishop's (1983) Test for Reception of Grammar (TROG) in its French version (F-TROG; Lecocq, 1996) was conducted to determine whether the difficulty of items is similar for participants with or without intellectual disability (ID). Method: In Study 1, responses to the 92 F-TROG items by 55 participants with Down syndrome (DS), 55 with ID of undifferentiated etiology (UND), and 55 typical children (TYP) matched on their F-TROG total score were compared using the transformed item difficulties method, a statistical approach designed to detect differential item functioning (DIF) between groups. In Study 2, an additional comparison involving 526 TYP participants and 526 participants with UND was conducted to increase the statistical power of the analysis. Results: The difficulty of items was highly similar whatever the sample size or clinical status of participants. Fewer than 3.5% of the items were flagged as showing DIF. Conclusions: Tests such as the TROG can be used with confidence in clinical practice as well as in research studies comparing participants with or without ID. Methods designed for investigating potential internal test bias-such as done here-should be more regularly employed in the developmental disability field to affirm the absence of DIF.

Efficient Standard Error Formulas of Ability Estimators with Dichotomous Item Response Models.

This paper focuses on the computation of asymptotic standard errors (ASE) of ability estimators with dichotomous item response models. A general framework is considered, and ability estimators are defined from a very restricted set of assumptions and formulas. This approach encompasses most standard methods such as maximum likelihood, weighted likelihood, maximum a posteriori, and robust estimators. A general formula for the ASE is derived from the theory of M-estimation. Well-known results are found back as particular cases for the maximum and robust estimators, while new ASE proposals for the weighted likelihood and maximum a posteriori estimators are presented. These new formulas are compared to traditional ones by means of a simulation study under Rasch modeling.

Layman versus Professional Musician: Who Makes the Better Judge?

The increasing number of casting shows and talent contests in the media over the past years suggests a public interest in rating the quality of vocal performances. In many of these formats, laymen alongside music experts act as judges. Whereas experts' judgments are considered objective and reliable when it comes to evaluating singing voice, little is known about laymen's ability to evaluate peers. On the one hand, layman listeners-who by definition did not have any formal training or regular musical practice-are known to have internalized the musical rules on which singing accuracy is based. On the other hand, layman listeners' judgment of their own vocal skills is highly inaccurate. Also, when compared with that of music experts, their level of competence in pitch perception has proven limited. The present study investigates laypersons' ability to objectively evaluate melodies performed by untrained singers. For this purpose, laymen listeners were asked to judge sung melodies. The results were compared with those of music experts who had performed the same task in a previous study. Interestingly, the findings show a high objectivity and reliability in layman listeners. Whereas both the laymen's and experts' definition of pitch accuracy overlap, differences regarding the musical criteria employed in the rating task were evident. The findings suggest that the effect of expertise is circumscribed and limited and supports the view that laypersons make trustworthy judges when evaluating the pitch accuracy of untrained singers.

Audiometric Results after Stapedotomy Operations in Patients with Otosclerosis and Preoperative Small Air-Bone Gaps.

OBJECTIVES: The efficacy of stapedotomies performed on patients with small air-bone gaps (<25 dB) was compared with the efficacy of the operation in patients who had otosclerosis with high air-bone gaps (≥25 dB). METHODS: This retrospective study evaluates the short-term postoperative air and bone conduction thresholds and air-bone gaps after 182 CO2 laser stapedotomies. RESULTS: A significantly smaller air-bone gap and lower air conduction thresholds after surgery were observed in the group of patients who underwent surgery with preoperative air-bone gaps of less than 25 dB. Bone conduction thresholds improve in the group with small air-bone gaps after surgery. CONCLUSIONS: The results after stapedotomies are good even if the preoperative air-bone gap is small and the overall risk of hearing deterioration due to stapes surgery remains low.

A note on weighted likelihood and Jeffreys modal estimation of proficiency levels in polytomous item response models.

Warm (in Psychometrika, 54, 427-450, 1989) established the equivalence between the so-called Jeffreys modal and the weighted likelihood estimators of proficiency level with some dichotomous item response models. The purpose of this note is to extend this result to polytomous item response models. First, a general condition is derived to ensure the perfect equivalence between these two estimators. Second, it is shown that this condition is fulfilled by two broad classes of polytomous models including, among others, the partial credit, rating scale, graded response, and nominal response models.

The sentence repetition task: a powerful diagnostic tool for French children with specific language impairment.

This study assesses the diagnostic accuracy and construct validity of a sentence repetition task that is commonly used for the identification of French children with specific language impairment (SLI). Thirty-four school-aged children with a confirmed, diagnostically based diagnosis of SLI, and 34 control children matched on age and nonverbal abilities performed the sentence repetition task. Two general scoring measures took into account the verbatim repetition of the sentence and the number of words accurately repeated. Moreover, five other scoring measures were applied to their answers in order to separately take into account their respect of lexical items, functional items, syntax, verb morphology, and the general meaning of the sentence. Results show good to high levels of sensitivity and specificity at the three cut-off points for all scoring measures. A principal component analysis revealed two factors. Scoring measures for the respect of functional words, syntax and verb morphology provided the largest loadings to the first factor, while scoring measures for the respect of lexical words and general semantics provided the largest loadings to the second factor. Sentence repetition appears to be a valuable tool to identify SLI in French children, and the ability to repeat sentences correctly is supported by two factors: a morphosyntactic factor and a lexical factor.

Snijders's correction of Infit and Outfit indexes with estimated ability level: an analysis with the Rasch model.

The Infit mean square W and the Outfit mean square U are commonly used person fit indexes under Rasch measurement. However, they suffer from two major weaknesses. First, their asymptotic distribution is usually derived by assuming that the true ability levels are known. Second, such distributions are even not clearly stated for indexes U and W. Both issues can seriously affect the selection of an appropriate cut-score for person fit identification. Snijders (2001) proposed a general approach to correct some person fit indexes when specific ability estimators are used. The purpose of this paper is to adapt this approach to U and W indexes. First, a brief sketch of the methodology and its application to U and W is proposed. Then, the corrected indexes are compared to their classical versions through a simulation study. The suggested correction yields controlled Type I errors against both conservatism and inflation, while the power to detect specific misfitting response patterns gets significantly increased.

Effects of melody and technique on acoustical and musical features of western operatic singing voices.

OBJECTIVE: The operatic singing technique is frequently used in classical music. Several acoustical parameters of this specific technique have been studied but how these parameters combine remains unclear. This study aims to further characterize the Western operatic singing technique by observing the effects of melody and technique on acoustical and musical parameters of the singing voice. METHODS: Fifty professional singers performed two contrasting melodies (popular song and romantic melody) with two vocal techniques (with and without operatic singing technique). The common quality parameters (energy distribution, vibrato rate, and extent), perturbation parameters (standard deviation of the fundamental frequency, signal-to-noise ratio, jitter, and shimmer), and musical features (fundamental frequency of the starting note, average tempo, and sound pressure level) of the 200 sung performances were analyzed. RESULTS: The results regarding the effect of melody and technique on the acoustical and musical parameters show that the choice of melody had a limited impact on the parameters observed, whereas a particular vocal profile appeared depending on the vocal technique used. CONCLUSIONS: This study confirms that vocal technique affects most of the parameters examined. In addition, the observation of quality, perturbation, and musical parameters contributes to a better understanding of the Western operatic singing technique.

The effect of melody and technique on the singing voice accuracy of trained singers.

A previous study highlighted the effect of vocal technique on the singing voice accuracy of trained singers. The intervals' precision between the notes of the tune was altered when the singers used Western operatic singing technique. In order better to understand these results, we have recorded two different melodies sung with two different vocal techniques. A large panel of trained singers (n = 50) participated in the study. The analytical method described in the reference paper has been applied. The results confirm the effect of vocal technique on the vocal accuracy of trained singers. In addition, these results provide an answer about the melodic effect and guide future work on the perception process of operatic voices.

On the asymptotic standard error of a class of robust estimators of ability in dichotomous item response models.

In item response theory, the classical estimators of ability are highly sensitive to response disturbances and can return strongly biased estimates of the true underlying ability level. Robust methods were introduced to lessen the impact of such aberrant responses on the estimation process. The computation of asymptotic (i.e., large-sample) standard errors (ASE) for these robust estimators, however, has not yet been fully considered. This paper focuses on a broad class of robust ability estimators, defined by an appropriate selection of the weight function and the residual measure, for which the ASE is derived from the theory of estimating equations. The maximum likelihood (ML) and the robust estimators, together with their estimated ASEs, are then compared in a simulation study by generating random guessing disturbances. It is concluded that both the estimators and their ASE perform similarly in the absence of random guessing, while the robust estimator and its estimated ASE are less biased and outperform their ML counterparts in the presence of random guessing with large impact on the item response process.

Angoff's delta method revisited: improving DIF detection under small samples.

Most methods for detecting differential item functioning (DIF) are suitable when the sample sizes are sufficiently large to validate the null statistical distributions. There is no guarantee, however, that they will still perform adequately when there are few respondents in the focal group or in both the reference and the focal group. Angoff's delta plot is a potentially useful alternative for small-sample DIF investigation, but it suffers from an improper DIF flagging criterion. The purpose of this paper is to improve this classification rule under mild statistical assumptions. This improvement yields a modified delta plot with an adjusted DIF flagging criterion for small samples. A simulation study was conducted to compare the modified delta plot with both the classical delta plot approach and the Mantel-Haenszel method. It is concluded that the modified delta plot is consistently less conservative and more powerful than the usual delta plot, and is also less conservative and more powerful than the Mantel-Haenszel method as long as at least one group of respondents is small.

On the difficulty of relational concepts among participants with Down syndrome.

The aim of the study was to compare the difficulty of relational concepts among participants with and without intellectual disability. The French versions of the Boehm Tests of Basic Concepts Third Edition (Preschool and Kindergarten to 2nd grade) were administered to three groups of 47 participants individually matched on their total raw score on the tests. The first group comprised participants with intellectual disability of undifferentiated etiology, the second, participants with Down syndrome and the third, typical children. Item analyses using the transformed item difficulties method to detect differential item functioning across groups showed that the groups' rank-orders of item difficulty were highly similar. It is concluded that, all things being equal, relational concepts are of comparable difficulty and follow a similar sequence of development whatever the cognitive and etiological status of participants. Methodological and theoretical implications of these findings are discussed.

Beyond matching on the mean in developmental disabilities research.

The matching of groups is a traditional way to control for confounding variables in developmental disabilities research. The equivalency of means across groups is routinely checked for these variables, but not the homogeneity of their variances or the shapes of their distributions. In the present paper, it is argued that group matching can go seriously wrong unless it directly confronts the distributional concerns by the use of well-known statistical indices and very simple graphical displays of the distributions. The question of the equivalency of item response profiles is also addressed since two participants or two groups of participants can obtain the same overall score on the matching variable by passing different items. In this case, the matching cannot be considered satisfactory because of poor concordance between the molar (overall score) and molecular (item scores) levels of matching. Angoff's Delta plot method, a statistical approach for detecting differential item functioning across small groups is described. It is promising as a simple way to prove whole test/individual item correspondence and, in addition, a useful tool for making post hoc statistical analyses at the item level on the dependent variables.