RESUMEN
PURPOSE: The adaptation into Portuguese and evaluation of the Index of Scientific Quality (ISQ) questionnaire applicability's in texts presented by Brazilian magazines on woman's health. METHODS: A transversal cohort study. Texts published from August 2005 to July 2007, in the main weekly magazines Veja, Epoca and Istoé, were collected. The questionnaire used is composed of eight items, with five alternatives each, measuring the applicability, opinion degree, validity and implications of the finding, precision, coherence and relevance of the data, besides a global item summarizing all the other items. ISQ was translated, retro-translated and submitted to a pilot test till the final version, which was used by two medical doctors and two journalists. After the texts analysis', the internal consistency of the questionnaire items was checked through Cronbach's alpha coefficient, and the inter and intra-observer agreement, for each item, by Kappa's index. RESULTS: The sample was composed by 80 articles. The internal consistency of items has varied from 0.81 to 0.96. The inter-evaluators' agreement ranged from -0.03 to 0.48, and the intra-observer varied from 0.27 to 0.34 (CI 95%). CONCLUSION: The questionnaire items have adequately measured the scientific quality of the texts, but the low agreement inter and intra-observers points to the need for further studies to assess the Brazilian version of ISQ.