Assessment of English language performance scores and academic performance in an English-based curriculum for pharmacy students with English as a second language.

BACKGROUND: The primary objective was to determine if there is a relationship between English language performance and graduating grade point average (GPA) in pharmacy students with English as a second language (ESL). METHODS: Students graduating from a four-year pharmacy program in 2016-2018 were invited to participate in the study. We compared pharmacy students' pre-admission ESL scores to their cumulative GPA at graduation in each of the three graduating cohorts and also determined if these results held true for both genders. Correlation of GPA to individual mathematics, chemistry, and Chinese language scores were used as points of reference to compare the degree of correlation. RESULTS: There were 148 students screened for the study with 31 students not meeting the inclusion criteria and four students declining to participate. Statistical analyses show an overall weak correlation. There was a statistically significant stronger correlation between pre-admission ESL scores and cumulative graduating GPA (r = 0.273) as compared to the correlation of GPA with mathematics (r = 0.187), chemistry (r = 0.181), or Chinese language scores (r = 0.059). The results did not change when the study population was separated by gender as English score still had the strongest correlation as compared to the other subjects. CONCLUSION: This study provides evidence that English language scores correlate more strongly with academic performance than mathematics, chemistry, or Chinese language scores in ESL pharmacy students. Also, this English language correlation is stronger for females than males.

Verb and sentence processing patterns in healthy Italian participants: Insight from the Northwestern Assessment of Verbs and Sentences (NAVS).

We developed an Italian version of the Northwestern Assessment of Verbs and Sentences (NAVS, Thompson, 2011), a test assessing verb and sentence deficits typically found in aphasia, by focusing on verb-argument structure and syntactic complexity effects, rarely captured by standard language tests. Twenty-one young healthy individuals underwent a computerized experimental version of the NAVS, including three subtests assessing production/comprehension of verbs with different number (one, two, three) and type (obligatory or optional) of arguments, and two investigating production/comprehension of sentences with canonical/non-canonical word order. The number of verb arguments affected participants' reaction times (RTs) in verb naming and comprehension. Furthermore, verbs with optional arguments were processed faster than verbs with only obligatory arguments. Comprehension accuracy was lower for object-cleft vs. subject-cleft sentences. Object clefts and object relatives also elicited longer RTs than subject clefts and subject relatives, respectively. The study shows that the NAVS is sensitive to linguistic aspects of verb/sentence processing in Italian as in the English language. The study also highlights some differences between languages in the verb/sentence processing patterns of healthy individuals. Finally, the study contributes to the understanding of how information about verb-argument structure is represented and processed in healthy individuals, with reference to current models of verb processing.

Approaches to communication assessment with children and adults with profound intellectual and multiple disabilities.

Communication assessment of people with profound intellectual and multiple disabilities (PIMD) has seldom been investigated. Here, we explore approaches and decision making in undertaking communication assessments in this group of people. A questionnaire was sent to UK practitioners. The questionnaire elicited information about assessment approaches used and rationales for assessment choices. Fifty-five speech and language therapists (SLTs) responded. Findings revealed that the Preverbal Communication Schedule, the Affective Communication Assessment and the Checklist of Communication Competence were the most frequently used published assessments. Both published and unpublished assessments were often used. Rationales for assessment choice related to assessment utility, sensitivity to detail and change and their applicability to people with PIMD. Underpinning evidence for assessments was seldom mentioned demonstrating the need for more empirical support for assessments used. Variability in practice and the eclectic use of a range of assessments was evident, underpinned by practice-focused evidence based on tacit knowledge.

Investigating Arabic Academic Vocabulary Knowledge Among Middle School Pupils: Receptive Versus Productive Knowledge.

The current study attempted to investigate the development of Arabic academic vocabulary knowledge among middle-school Arabic native speakers, taking into account the socioeconomic status of the Arab population in Israel. For this purpose, Arabic academic word list was developed, mapping the required academic words that are needed for adequate coping with informational texts as appearing in the different content areas text-books. Six-hundred Arabic speaking middle school pupils from the different areas in Israel, representing the different Arab subgroups: general Arab community, Druze and Bedouins, have participated in the current study. Two academic vocabulary tests, including receptive and productive academic vocabulary evaluation tests, were administrated to the students across the different age groups (7th, 8th and 9th). The results pointed to no significant difference between 7th and 9th grade in academic vocabulary knowledge. In contrast, significant difference was encountered between the different Arab sub-groups where the lowest scores were noted among the Bedouin sub-group, characterized by the lowest SES. When comparing receptive and productive academic vocabulary knowledge between 7th and 9th grade, the results pointed to improvement in receptive academic knowledge towards the end of middle school but not on the productive knowledge level. In addition, within participants' comparison indicated a gap between the pupils' receptive and productive vocabulary. The results are discussed in relation to the existing scientific literature and to its implication of both research and practice in the domain of Arabic literacy development.

Predictors of processing-based task performance in bilingual and monolingual children.

In the present study we examined performance of bilingual Spanish-English-speaking and monolingual English-speaking school-age children on a range of processing-based measures within the framework of Baddeley's working memory model. The processing-based measures included measures of short-term memory, measures of working memory, and a novel word-learning task. Results revealed that monolinguals outperformed bilinguals on the short-term memory tasks but not the working memory and novel word-learning tasks. Further, children's vocabulary skills and socioeconomic status (SES) were more predictive of processing-based task performance in the bilingual group than the monolingual group. Together, these findings indicate that processing-based tasks that engage verbal working memory rather than short-term memory may be better-suited for diagnostic purposes with bilingual children. However, even verbal working memory measures are sensitive to bilingual children's language-specific knowledge and demographic characteristics, and therefore may have limited clinical utility.

Assessment of language impairment in bilingual children using semantic tasks: two languages classify better than one.

BACKGROUND: Significant progress has been made in the identification of language impairment in children are bilingual. Bilingual children's vocabulary knowledge may be distributed across languages. Thus, when testing bilingual children it is difficult to know how to weigh each language for diagnostic purposes. Even when conceptual scoring is used in vocabulary testing, bilingual children may score below that of their typical monolingual peers. AIMS: The primary aim was to evaluate the classification accuracy of two approaches (total semantics score and two-dimensional bilingual coordinate score) that combined lexical-semantic knowledge across two languages. We investigated the classification accuracy of the English and Spanish semantics subtest using the experimental version of the Bilingual English Spanish Assessment (BESA) with bilingual children with and without language impairment. METHODS: A total of 78 bilinguals with balanced exposure to English and Spanish (15 with language impairment, 63 with typical development) participated. Children were between 4;0 and 6;11 years old. Discriminant function analysis explored the extent to which these children were accurately classified when combining Spanish and English subtests. OUTCOMES & RESULTS: Discriminant analysis yielded above 85% correct classification for balanced bilingual children for both approaches. CONCLUSIONS & IMPLICATIONS: For the most accurate assessment and diagnostic decision-making for bilinguals, approaches that consider both languages together are recommended.

Socio-economic status and language acquisition: children's performance on the new Reynell Developmental Language Scales.

BACKGROUND: Several studies in recent years have indicated a link between socio-economic status (SES) of families and children's language development, including studies that have measured children's language through formal standardized test procedures. High numbers of children with low performance have been found in lower socio-economic groups in some studies. This has proved a cause for concern for both clinicians and educationalists. AIMS: To investigate the relationship between maternal education and postcode-related indicators of SES, and children's performance on the New Reynell Developmental Scales (NRDLS). METHODS & PROCEDURES: Participants were 1266 children aged between 2;00 and 7;06 years who were recruited for the standardization of a new assessment procedure (NRDLS). Children were divided into four groups reflecting years of maternal education, and five groups reflecting SES Index of Multiple Deprivation (IMD) quintiles for the location of participating schools and nurseries. Groups were compared using analysis of covariance (ANCOVA), with age as a covariate, in order to identify which might be affected by the two SES variables. Where relationships were found between SES and performance on the scales, individual children's standard scores were looked at to determine numbers potentially at risk for language delay. OUTCOMES & RESULTS: An effect of years of maternal education on performance was found such that children whose mothers had minimum years performed less well than other children in the study, this effect being stronger for younger children. Children attending schools or nurseries in IMD quintile 1 areas performed less well in language production. Higher than expected numbers with language delay were found for younger children whose mothers had minimum years of education, and for children in quintile 1 schools and nurseries; however, numbers were not as high as noted in some other studies. CONCLUSIONS & IMPLICATIONS: Characteristics of the participant sample and measures used for language and SES may explain these results and are important considerations when interpreting results of studies or developing policies for intervention. The usefulness of commonly used categories of language delay is questioned.

Creating a brief rating scale for the assessment of learning disabilities using reliability and true score estimates of the scale's items based on the Rasch model.

The purpose of the present studies was to provide the means to create brief versions of instruments that can aid the diagnosis and classification of students with learning disabilities and comorbid disorders (e.g., attention-deficit/hyperactivity disorder). A sample of 1,108 students with and without a diagnosis of learning disabilities took part in study 1. Using information from modern theory methods (i.e., the Rasch model), a scale was created that included fewer than one third of the original battery items designed to assess reading skills. This best item synthesis was then evaluated for its predictive and criterion validity with a valid external reading battery (study 2). Using a sample of 232 students with and without learning disabilities, results indicated that the brief version of the scale was equally effective as the original scale in predicting reading achievement. Analysis of the content of the brief scale indicated that the best item synthesis involved items from cognition, motivation, strategy use, and advanced reading skills. It is suggested that multiple psychometric criteria be employed in evaluating the psychometric adequacy of scales used for the assessment and identification of learning disabilities and comorbid disorders.

[Evaluation of current assessment tools in early detection of developmental deviations in speech and language in the German preventive paediatric examination (Kindervorsorgeuntersuchung U8)]. / Analyse aktueller Untersuchungsinstrumente zur Früherkennung von Auffälligkeiten in Sprechen und Sprache in der pädiatrischen Vorsorgeuntersuchung U8.

OBJECTIVE: The current analysis is a contribution to application information and quality assurance. It is intended to evaluate and optimise the use of German developmental screening instruments to identify deficits in speech, speech fluency and language during the early paediatric toddler check-up Kindervorsorgeuntersuchung U8 in the age of 43-50 months. METHODS: A systematic literature search was conducted seeking current specific, standardised, norm-referenced assessment tools, particularly those relevant to the early detection of developmental speech and language retardation. They were subsequently evaluated quantitatively and qualitatively with specific regard to 15 psychometric criteria and construction features. RESULTS: 4 assessment tools (ETS 4-8; KiSS; SSV; TSVK-Screen) resulted from literature search. They were subjected to a detailed and rigorous comparative analysis. Quantitatively they met 7-12 of the 15 psychometric criteria whose quality was partly low or demonstrated survey standard to a lesser degree. CONCLUSION: These developmental screening instruments utilised in the paediatric toddler check-up U8 cannot be recommended without reservation with regard to a dichotomous decision (suspected disorder versus no suspected disorder). More qualificatory research focusing specifically on the existing screenings and the construction of new screening tools is required in order to gain vital developmental psychological information of the speech/language status of a child during the preventive paediatric examination U8. Alternatively, it should be evaded to the approach of taking diagnostic language developmental tests.

Assessment package for language development in Japanese hearing-impaired children (ALADJIN) as a test battery for the development of practical communication.

OBJECTIVES: The measurement of language development in hearing-impaired children is an important step in assessing the appropriateness of an intervention. We proposed a set of language tests (the Assessment Package for Language Development in Japanese Hearing-Impaired Children [ALADJIN]) to evaluate the development of practical communication skills. This package consisted of communication skills (TQAID), comprehensive (PVT-R and SCTAW) and productive vocabulary (WFT), comprehensive and productive syntax (STA), and the STRAW. METHODS: A total of 638 children with greater than 70-dB hearing impairment were subjected to this set of language tests. Additional tests, including the PARS, the RCPM, and parental questionnaires, were administered to assess the backgrounds of the children. RESULTS: A trimodal distribution was observed among hearing-impaired children by the histogram-based analysis of each test. CONCLUSIONS: The ALADJIN is a useful Japanese-language evaluation kit for hearing-impaired children.

[Performance assessment using the Many-Facet Rasch Measurement]. / Evaluación de la ejecución mediante el modelo Many-Facet Rasch Measurement.

This paper describes how the Many-Facet Rasch Measurement (MFRM) can be applied to constructed-response items and rater analysis. The article provides an introduction to MFRM, a description of facet analysis procedures, and an illustrative example to examine the effects of various sources of variability on students' performance on a DELE (Diplomas in Spanish as a Foreign Language) test by means of the FACETS program. Results highlight the usefulness of the MFRM to detect raters that have extreme values on the continuum of severity. MFRM facilitates comprehension of the assessment process as well as providing objective measurement of facet elements.

The effects of race and maternal education level on children's retells of the Renfrew Bus Story--North American Edition.

PURPOSE: The Renfrew Bus Story--North American Edition (RBS-NA; C. Glasgow & J. Cowley, 1994) is widely used in clinical and research settings to determine children's language abilities, although possible influences of race and maternal education on RBS-NA performance are unknown. The current study compared RBS-NA retells of 4 groups of children: African American (AA) children and European American (EA) children whose mothers had an education level of high school or less (≤ HS) and those whose mothers had an education level higher than high school (> HS). METHOD: Statistical tests were used to examine 172 kindergartners' story retells using raw scores for all 4 RBS-NA measures: (a) Information, (b) Sentence Length, (c) Complexity, and (d) Independence. RESULTS: A 2 × 2 analysis of variance (ANOVA) revealed main effects of maternal education and race for the Information score, with ≤ HS and AA children scoring lower. For measures not meeting ANOVA assumptions, 2 × 2 ANOVAs using ranked data indicated significant main effects of maternal education for Sentence Length, Complexity, and Independence measure, with ≤ HS children scoring lower within the AA group. CONCLUSION: There are systematic effects of maternal education and race on children's RBS-NA performance, which is important for both researchers and clinicians to take into account when using this instrument.

[Evaluation of current assessment tools in the early detection of language retardation in the German preventive paediatric examinations (Kindervorsorgeuntersuchung U7/U7A)]. / Vergleichende Analyse aktueller Untersuchungsinstrumente zur Früherkennung von Sprachentwicklungsretardationen in den pädiatrischen Vorsorgeuntersuchungen U7/U7A.

OBJECTIVE: The current analysis is a contribution to user orientation and quality assurance that seeks to evaluate and optimise the use of German language development assessment tools during early paediatric toddler check-ups ( KINDERVORSORGEUNTERSUCHUNG U7 OR U7A). METHODS: All current, standardised assessment tools, particularly those relevant to early detection of developmental language retardation - normed on German speaking children - were evaluated quantitatively and qualitatively with particular regard to their psychometric criteria (13 criteria) and design features. RESULTS: 8 assessment tools (ELAN; ELFRA-2; Short Form ELFRA-2; FRAKIS; FRAKIS-K; SBE-2-KT; SBE-3-KT; SETK-2) were located in the literature and subjected to a detailed and rigorous comparative analysis. Quantitatively they met 9 to 11 of the 13 psychometric criteria. CONCLUSION: In Germany, there are several assessment tools for dichotomous identification of language retardations on high levels of psychometric criteria that can be used in the above-mentioned preventive paediatric examinations. Nevertheless, the collecting of actual norm scores of representative samples should be kept in mind.

MTLD, vocd-D, and HD-D: a validation study of sophisticated approaches to lexical diversity assessment.

The main purpose of this study was to examine the validity of the approach to lexical diversity assessment known as the measure of textual lexical diversity (MTLD). The index for this approach is calculated as the mean length of word strings that maintain a criterion level of lexical variation. To validate the MTLD approach, we compared it against the performances of the primary competing indices in the field, which include vocd-D, TTR, Maas, Yule's K, and an HD-D index derived directly from the hypergeometric distribution function. The comparisons involved assessments of convergent validity, divergent validity, internal validity, and incremental validity. The results of our assessments of these indices across two separate corpora suggest three major findings. First, MTLD performs well with respect to all four types of validity and is, in fact, the only index not found to vary as a function of text length. Second, HD-D is a viable alternative to the vocd-D standard. And third, three of the indices--MTLD, vocd-D (or HD-D), and Maas--appear to capture unique lexical information. We conclude by advising researchers to consider using MTLD, vocd-D (or HD-D), and Maas in their studies, rather than any single index, noting that lexical diversity can be assessed in many ways and each approach may be informative as to the construct under investigation.

Internet-based telehealth assessment of language using the CELF-4.

PURPOSE: Telehealth has the potential to improve children's access to speech-language pathology services. Validation of telehealth applications, including the assessment of childhood language disorders, is necessary for telehealth to become an accepted alternative mode of service provision. The aim of this study was to validate an Internet-based telehealth system for assessing childhood language disorders. METHOD: Twenty-five children ages 5 to 9 years were assessed using the core language subtests of the Clinical Evaluation of Language Fundamentals--4th Edition (CELF-4; Semel, Wiig, & Secord, 2003). Each participant was simultaneously assessed online and face-to-face (FTF). Assessments were administered by either an online or an FTF speech-language pathologist (SLP), but were simultaneously rated by both SLPs. RESULTS: No significant difference was found between the online and FTF total raw scores and scaled scores for each subtest. Weighted kappas revealed very good agreement on the individual items, total raw scores, scaled scores, core language score, and severity level. Intra- and interrater reliability were determined for a sample of online ratings, with intraclass correlation analysis revealing very good agreement on all measures. CONCLUSION: The results of this study support the validity and reliability of scoring the core language subtests of the CELF-4 via telehealth.

Kindergarten literacy assessment of English Only and English language learner students: An examination of the predictive validity of three phonemic awareness measures.

The study assessed the ability of English phonemic awareness measures to predict kindergarten reading performance and determine factors that contributed to growth trajectories on those measures for English Only (EO) and English language learner (ELL) students. Using initial sound fluency (ISF), phoneme segmentation fluency (PSF), and a combined phoneme segmentation task (CPST), students' beginning of kindergarten scores were used to predict end-of-kindergarten Nonsense Word Fluency (NWF) and reading (WRMT-R/NU). Regression analyses revealed that ISF and CPST early in kindergarten predicted variance in NWF and WRMT-R/NU. PSF did not predict reading performance over ISF or CPST. While gender was a significant factor in the growth curves across the measures, results revealed no significant difference for EO and ELL students.

Multitask electrical stimulation for cortical language mapping: hints for necessity and economic mode of application.

PURPOSE: Electrical stimulation mapping (ESM) is the gold standard for identifying language-relevant cortex prior to neurosurgical resections near the eloquent cortex. However, its application mode is not standardized, as some procedures rely on a single task, whereas others depend on task batteries. In this study, we examine whether multitask ESM is necessary, quantify the information loss that occurs from restricting the number of applied tasks, and search for a procedure that allows for time-efficient, multitask ESM. METHODS: Thirty-eight epilepsy and 11 brain tumor patients with subdural grid electrodes receive extraoperative ESM for language cortex at 1,890 stimulation sites. The applied test battery includes counting, naming, repeating, reading, Token Test, and body commands. Correlation analysis and principal component analysis are used to identify the functional overlap between tasks. Sensitivity analysis is the basis for determining the optimal task order, which requires a minimum number of stimulations for identifying language loci. RESULTS: Correlation coefficients between tasks are -0.17 to 0.63; frontal and temporoparietal language cortex are organized differently. Naming is the most sensitive task, but 31% (temporoparietal) to 43% (frontal) of language sites remained undetected after naming alone. The optimal procedure starts with naming and the Token Test and differs thereafter between frontal and temporoparietal cortex. Omitting the Token Test and body commands from the battery results in up to 26% information loss. DISCUSSION: Despite considerable overlap between different tasks, multitask ESM appears necessary to avoid missing language relevant cortex. Applying the tasks in an optimal order allows economizing the procedure.

Literacy-based normative data for low socioeconomic status African Americans.

Clinical neuropsychology relies on the use of appropriate test norms. Normative studies frequently stratify based on age, education, sex, and race. None to date has reported norms based on literacy, despite the substantial evidence that literacy impacts cognitive functioning. Some researchers have suggested that literacy is a more accurate reflection of academic achievement and quality of education than years of education, particularly for African Americans. The current study provides literacy-based normative data for multiple neuropsychological measures based on a sample of predominantly low socioeconomic status African Americans. These normative data should improve the diagnostic accuracy of performances by African-American clients with similar demographic backgrounds.

The cost of question concealment: eye-tracking and MEG evidence.

Although natural language appears to be largely compositional, the meanings of certain expressions cannot be straightforwardly recovered from the meanings of their parts. This study examined the online processing of one such class of expressions: concealed questions, in which the meaning of a complex noun phrase (the proof of the theorem) shifts to a covert question (what the proof of the theorem is) when mandated by a sub-class of question-selecting verbs (e.g., guess). Previous behavioral and magnetoencephalographic (MEG) studies have reported a cost associated with converting an entity denotation to an event. Our study tested whether both types of meaning-shift affect the same computational resources by examining the effects elicited by concealed questions in eye-tracking and MEG. Experiment 1 found evidence from eye-movements that verbs requiring the concealed question interpretation require more processing time than verbs that do not support a shift in meaning. Experiment 2 localized the cost of the concealed question interpretation in the left posterior temporal region, an area distinct from that affected by complement coercion. Experiment 3 presented the critical verbs in isolation and found no posterior temporal effect, confirming that the effect of Experiment 2 reflected sentential, and not lexical-level, processing.

The state of school-based bilingual assessment: actual practice versus recommended guidelines.

PURPOSE: This study was designed to investigate the frequency with which school-based speech-language pathologists (SLPs) used recommended practices when assessing the language skills of bilingual students. The study also investigated the frequency with which SLPs used formal, standardized tests versus informal, alternative procedures with this population. METHOD: A total of 596 surveys were mailed out to school-based SLPs in the state of Michigan who were members of the Michigan Speech, Language, and Hearing Association (MSHA) during the 2003-2004 academic year. Of the 409 usable surveys that were returned, 130 respondents indicated being involved in assessing bilingual children and comprised the sample used in this study. RESULTS: Results indicated that SLPs used formal, standardized English tests more frequently than informal assessment procedures when assessing bilingual students. Further in-depth analyses of SLPs' responses indicated that neither factors related to their years of experience or factors related to their academic preparation were significantly related to their use of recommended assessment practices. However, significant differences in use were noted based on respondents' employment settings. CLINICAL IMPLICATIONS: This study underscores the need for academic training programs and professional organizations to intentionally disseminate information regarding the expediency of alternative testing procedures. Implications for the adequate nonbiased assessment of bilingual children are discussed.