Impact factor: Universalism and reliability of assessment.

In 1955, Eugene Garfield (1925-1917) published a paper in Science where for the first time he advocated the necessity of introducing parameters to assess the quality of scientific journals. Underlying this necessity was an observation of a trend where the whole area of influence in academic publishing was dominated by a narrow group of large interdisciplinary research journals. For this reason, along with Irving H. Sher, they created the impact factor (IF), also called the Garfield impact factor, journal citation rate, journal influence, and journal impact factor. The concept of IF concerns a research discipline called bibliometrics, which uses mathematical and statistical methods to analyze scientific publications. Established by Garfield in 1963, the Science Citation Index, a record of scientific publications and citations therein, contributed directly to the increased importance of this method. Since the 1960s, the register of scientific publications has expanded and their evaluation by the IF has become a fundamental and universal measure of the journal's value. Contrary to the authors' intentions in the creation of the index (IF), it is often used to assess the quality of contributions, simultaneously assessing the authors' achievements or academic career and academic institutions' funding possibilities.

Automatic information timeliness assessment of diabetes web sites by evidence based medicine.

Studies on health domain have shown that health websites provide imperfect information and give recommendations which are not up to date with the recent literature even when their last modified dates are quite recent. In this paper, we propose a framework which assesses the timeliness of the content of health websites automatically by evidence based medicine. Our aim is to assess the accordance of website contents with the current literature and information timeliness disregarding the update time stated on the websites. The proposed method is based on automatic term recognition, relevance feedback and information retrieval techniques in order to generate time-aware structured queries. We tested the framework on diabetes health web sites which were archived between 2006 and 2013 by Archive-it using American Diabetes Association's (ADA) guidelines. The results showed that the proposed framework achieves 65% and 77% accuracy in detecting the timeliness of the web content according to years and pre-determined time intervals respectively. Information seekers and web site owners may benefit from the proposed framework in finding relevant and up-to-date diabetes web sites.

A bibliometric analysis of research productivity of Malaysian publications in leading toxicology journals during a 10-year period (2003-2012).

BACKGROUND: Toxicology in Malaysia has experienced rapid development and made great progress in education and research in conjunction with economic development in Malaysia over the past two decades. OBJECTIVES: The main objectives of this study were to analyse the research originating from Malaysia and published in toxicology journals and to examine the authorship pattern and the citations retrieved from the Scopus database. METHODS: Data from 1 January 2003 till 31 December 2012 were searched for documents with specific words in the toxicology field as a 'source title' and Malaysia as an affiliation country. Research productivity was evaluated based on a methodology we developed and used in other bibliometric studies by analysing: (a) total and trends of contributions in toxicology fields between 2003 and 2012; (b) Malaysian authorship pattern and productivity; (c) collaboration patterns; (d) journals in which Malaysian researchers publish; (e) the classification of journals to Institute for Scientific Information (ISI) or non-ISI; (f) impact factors (IFs) of all publications; and (g) citations received by the publications. RESULTS: In total, 290 documents were retrieved from 55 international peer-reviewed toxicology journals. The quantity of publication increased by around 10-fold from 2003 to 2012. The h-index of the retrieved documents was 20. Of the 55 journal titles, 42 (76.4%) have their IF listed in the journal citation reports 2012. Forty-two documents (14.5%) were published in journals that had no official IF. The total number of citations, at the time of manuscript writing (5 August 2013), was 1707, with a median (interquartile range) of 3 (0-7). Malaysia collaborated mostly with countries in the Asia-Pacific regions (18.3%), especially India and Japan, followed by the Middle East and Africa (10.0%), especially Palestine and Yemen. CONCLUSION: The present data show a promising rise and a good start for toxicology research activity in Malaysia. The sharing of relevant research questions by developed and developing countries can lead to research opportunities in the field of toxicology.

What's in a title? An assessment of whether randomized controlled trial in a title means that it is one.

INTRODUCTION: In this study, we aimed to investigate whether studies published in orthodontic journals and titled as randomized clinical trials are truly randomized clinical trials. A second objective was to explore the association of journal type and other publication characteristics on correct classification. METHODS: American Journal of Orthodontics and Dentofacial Orthopedics, European Journal of Orthodontics, Angle Orthodontist, Journal of Orthodontics, Orthodontics and Craniofacial Research, World Journal of Orthodontics, Australian Orthodontic Journal, and Journal of Orofacial Orthopedics were hand searched for clinical trials labeled in the title as randomized from 1979 to July 2011. The data were analyzed by using descriptive statistics, and univariable and multivariable examinations of statistical associations via ordinal logistic regression modeling (proportional odds model). RESULTS: One hundred twelve trials were identified. Of the included trials, 33 (29.5%) were randomized clinical trials, 52 (46.4%) had an unclear status, and 27 (24.1%) were not randomized clinical trials. In the multivariable analysis among the included journal types, year of publication, number of authors, multicenter trial, and involvement of statistician were significant predictors of correctly classifying a study as a randomized clinical trial vs unclear and not a randomized clinical trial. CONCLUSIONS: From 112 clinical trials in the orthodontic literature labeled as randomized clinical trials, only 29.5% were identified as randomized clinical trials based on clear descriptions of appropriate random number generation and allocation concealment. The type of journal, involvement of a statistician, multicenter trials, greater numbers of authors, and publication year were associated with correct clinical trial classification. This study indicates the need of clear and accurate reporting of clinical trials and the need for educating investigators on randomized clinical trial methodology.

Variations in food and drink advertising in UK monthly women's magazines according to season, magazine type and socio-economic profile of readers: a descriptive study of publications over 12 months.

BACKGROUND: Overweight and obesity are recognised nationally and internationally as key public health challenges. Food and drink advertising is one of the array of factors that influence both diet and physical activity choices and, hence, body weight and obesity. Little previous work has focused on food and drink advertising in magazines. We studied food and drink advertising in a wide range of popular UK monthly women's magazines published over a full year. We explored differences in the prevalence of food and drink advertising and the type of food and drinks advertised according to season, magazine type and socio-economic profile of readers. METHODS: All advertisements in all issues of 18 popular UK monthly women's magazines published over 12 months were identified. For each food or drink advertisement, branded food and drinks were noted and categorised into one of seven food groups. All analyses were at the level of the individual advertisement. RESULTS: A total of 35 053 advertisements were identified; 1380 (3.9%) of these were for food or drink. The most common food group represented was 'food and drinks high in fat and/or sugar' (28.0% of food advertisements), the least common group was 'fruits & vegetables' (2.0% of food advertisements). Advertisements for alcohol accounted for 10.1% of all food advertisements. Food and drink advertisements were most common in summer, general interest magazines, and those with the most affluent readerships. There were some differences in the type of food and drink advertised across season, magazine type and socio-economic profile of readers. CONCLUSIONS: Food and drink advertisements represented only a small proportion of advertisements in UK women's monthly magazines. Food and drink advertisements in these magazines feature a high proportion of 'less healthy' foods. There were a number of differences across season, magazine type and according to the socio-economic profile of readers in the prevalence of food and drink advertisements. Fewer differences were seen in the type of food and drinks advertised.

The science of ecological economics: a content analysis of Ecological Economics, 1989-2004.

The Ecological Economics journal is a primary source for inquiry on ecological economics and sustainability. To explore the scholarly pursuit of ecological economics, we conducted a content analysis of 200 randomly sampled research, survey, and methodological articles published in Ecological Economics during the 15-year period of 1989-2004. Results of the analysis were used to investigate facets of transdisciplinarity within the journal. A robust qualitative approach was used to gather and examine data to identify themes representing substantive content found within the span of sampled journal papers. The extent to which each theme was represented was counted as well as additional data, such as author discipline, year published, etc. Four main categories were revealed: (1) foundations (self-reflexive themes stemming from direct discussions about ecological economics); (2) human systems, represented by the themes of values, social indicators of well-being, intergenerational distribution, and equity; (3) biophysical systems, including themes, such as carrying capacity and scarcity, energy, and resource use, relating directly to the biophysical aspects of systems; and (4) policy and management encompassing themes of development, growth, trade, accounting, and valuation, as well as institutional structures and management. The results provide empirical evidence for discussing the future direction of ecological economic efforts.

[Factors of evaluation and interaction of scientific journals--impact factor and interjournal impact factor]. / Wskazniki oceny i wzajemnego oddzialywania czasopism naukowych - impact factor oraz interjournal impact factor.

The aim of the study was to analyse the extent of influence ofjournals with high Impact Factor (IF) into the world's science development. The survey was performed using Journal Citation Reports/Science Edition 1998-2001 database. One hundred journals with the highest IF were extracted and Interjournal Impact Factor (IIF) was made for each of them. It was proved that--regardless of the field the journals belong to--their influence into the filed and other periodicals should not be evaluated according to their IF value. It has been established to evaluate the journals, not particular articles. That's why we should not change its application and use it to express an opinion on the publications and scientific workers.

Peer assessment of journal quality in clinical neurology.

OBJECTIVE: To explore journal quality as perceived by clinicians and researchers in clinical neurology. METHODS: A survey was conducted from August 2003 to January 2004. Ratings for 41 selected clinical neurology journals were obtained from 254 members of the World Federation of Neurology (1,500 solicited; response rate 17%). Participants provided demographic information and rated each journal on a 5-point Likert scale. Average ratings for all journals were compared with the ISI's journal impact factors. Ratings for each journal were also compared across geographic regions and respondent publication productivity. RESULTS: The top 5 journals were rated much more highly than the others, with mean ratings greater than 4. Mean journal ratings were highly correlated with journal impact factors (r = 0.67). Most of the top 10 journal ratings were consistent across the subgroups of geographic regions and journal paper productivity. However, significant differences among the different geographical regions and respondent productivity groups were also found for a few journals. CONCLUSIONS: The results provide valuable insight on how neurological experts perceive journals in clinical neurology. These results will likely aid researchers and clinicians in identifying potentially desirable research outlets and indicate journal status for editors. Likewise, biomedical librarians may use these results for serials collection development.

Estimating research productivity and quality in assistive technology: a bibliometric analysis spanning four decades.

OBJECTIVE: Conduct a quantitative assessment of the number of papers contained in MEDLINE related to selected types of assistive technology (AT), and to identify journals publishing significant numbers of papers related to AT, and evaluate them with quantitative productivity and quality measures. DESIGN: Consecutive sample of all papers in MEDLINE identified by standard medical subject headings for selected types of AT from 1963-2003. MAIN OUTCOME MEASURES: Number of journals carrying AT papers, papers per journal (both total number and those specific to AT), journal impact factor, circulation, and number of AT citations per year over time for each area of AT. RESULTS: We present search terms, estimates of the numbers of AT citations in MEDLINE, the journals most likely to contain articles related to AT, journal impact factors, and journal circulations (when available). We also present the number of citations in various areas of AT over time from 1963-2003. Suggestions are presented for possible future modifications of the MEDLINE controlled vocabulary, based on terminology used in existing AT classifications schemes, such as ISO 9999. CONCLUSION: Research papers in the areas of AT examined showed publication across a wide variety of journals. There are a number of journals publishing articles in AT that have impact factors above the median. Some areas of AT have shown an increase in publications per year over time, while others have shown a more constant level of productivity.

An assessment system for rating scientific journals in the field of ergonomics and human factors.

A method for selecting and rating scientific and professional journals representing the discipline of ergonomics and human factors is proposed. The method is based upon the journal list, impact factors and citations provided by the Institute of Scientific Information (ISI), and the journal list published in the Ergonomics Abstracts. Three groups of journals were distinguished. The 'ergonomics journals' focus exclusively on ergonomics and human factors. The 'related journals' focus on other disciplines than ergonomics and human factors, but regularly publish ergonomics/human factors papers. The 'basic journals' focus on other technical, medical or social sciences than ergonomics, but are important for the development of ergonomics/human factors. Journal quality was rated using a maximum of four categories: top quality (A-level), high quality (B-level), good quality (C-level)) and professional (P-level). The above methods were applied to develop the Ergonomics Journal List 2004. A total of 25 'ergonomics journals', 58 'related journals' and 142 'basic journals' were classified.

Rating outlets for health care management research: an update and extension.

The ongoing discussion of our intellectual community requires that occasionally an effort be made to value the outlets for our research and erect guideposts for our colleagues to signal important contributions to our discipline. This study extends previous work through a survey sent to 1,254 academics involved in health care management research that asked them to rate 54 potential outlets for their research. Ratings were made on journal knowledge, quality, and relevance. Two survey waves resulted in 389 responses (adjusted response rate 37.8 percent). For quality and relevance, journal rankings were separated into A, B, and C categories. The results correlated strongly with the two previous studies in this area. This study extends previous research and provides a categorization of journals on knowledge, quality, and relevance that may assist in faculty performance evaluation and identification of appropriate outlets for manuscripts.

Tools for evaluating research output. Are citation-based rankings of economics journals stable?

Journal rankings are important for evaluating research output, for academic promotions, and for allocating funds. Examining the assignment of economics journals to different quartiles of citation-based rankings, the authors found that about 60% of journals remain in the same quartile and about 95% of journals remain in the same or move in a neighborhood quartile within 5- to 10-year intervals. Top journal rankings exhibit even more inertia, which is a desirable property for decisions on promotion, tenure, or institutional evaluation. A reexamination of journal assignment to different quality categories every 5 or 10 years, therefore, suffices for practical evaluation purposes.

Where do UK health services researchers publish their findings?

Health services research has emerged as the third vital requirement for understanding and improving health care, alongside basic science and clinical research. This has coincided with more stringent management of research, in particular by funding bodies. The latter are seeking to use bibliographic databases to aid the monitoring of the output of their investments. The principal source of data in the UK is the Research Outputs Database (ROD) set up by the Wellcome Trust primarily to monitor basic and clinical research. Health services researchers' output is difficult to monitor in view of the large number and wide variety of journals in which they publish. In addition, nearly half the journals (representing 35% of the articles) are not currently covered by the ROD. Funding bodies will underestimate the quantity of health services researchers' output unless they take these findings into account.