RESUMO
Background: Blueprint provides a base for assessment by assigning proportionate weightage to various content areas and helps the paper setter to construct a uniform and valid assessment. This study aimed to design and validate a blueprint for theory in Community Medicine as per the new curriculum for Medical Undergraduates in India. Methods: Blueprint in community medicine was designed by assigning impact score (I) and frequency score (F) for the competencies. Blueprint was validated using the Content Validity Index (CVI), and inter-rater agreement for subject experts using Fleiss' kappa statistics was calculated. Feedback from faculty and students was obtained afterward to assess the postimplementation response. Results: Blueprint was designed by an expert group where impact score and frequency score were assigned to 146 competencies in the theory of Community Medicine. In Delphi survey I, 63.2% of subject experts responded, while in Delphi survey II, a response rate of 58.3% was achieved. Value of the Fleiss' Kappa test for an inter-rater agreement was 0.68, i.e. "substantial agreement," while CVI among the raters came out to be 0.86, i.e. overall valid assessment. Feedback of faculty (n = 11) suggested that the blueprint was helpful and standardized the paper setting, whereas feedback from students (n = 138) depicted that it helped in preparing for exams, and they would recommend it to other students. Conclusion: Validated blueprint by consensus of subject experts has impact score and frequency score along with topic-wise distribution of marks for the convenience of faculty and its utility is well proven among learners too.
RESUMO
BACKGROUND: In this era of evidence-based medicine, only systematic research can help in providing judicious and precise healthcare to individual patients based on updated knowledge and skills. However, many medical professionals do not feel competent and confident enough to conduct research. One of the reasons could be the lack of a research-based curriculum in undergraduate courses. The National Medical Council has also stressed the need for formal training in research methodology for healthcare professionals. The research methodology workshops help to familiarize the participants with basic, clinical, and translational research required to impart optimum patient care. The objective of our study was to evaluate a research methodology workshop conducted for postgraduate students by assessing the participant's knowledge, feedback, and expected impact using Kirkpatrick's evaluation model. MATERIALS AND METHODS: A quasi-experimental, single-group study was conducted among 132 first-year postgraduate students. The four levels of Kirkpatrick's model were applied for evaluation. Feedback forms, scores of the pretest and posttest, quality of the research proposal drafted by the postgraduates for their thesis, and finally successful submission of the research proposal were the components used to evaluate the four levels of outcome of Kirkpatrick's model. STATISTICAL ANALYSIS: Data collected were compiled and tabulated into MS Excel. Proportions were calculated for categorical variables and mean and standard deviation (SD) for scores. A comparison of means between pre- and postworkshop scores was made with paired t-test. A value of P < 0.05 was considered statistically significant. Statistical analysis was done using IBM SPSS Statistics version 20.0 software. RESULTS: Out of 132 participants, 29% (38) were males and 71% (94) were females. The mean ± SD pretest and posttest scores at a 95% confidence interval were 10.55 ± 2.537 and 12.43 ± 2.484, respectively. The difference was found to be statistically significant by paired sample t-test (P < 0.001). CONCLUSION: Participant feedback is vital for improving research methodology workshops. The workshop met the overall requirements of the participants. There was a significant improvement in the knowledge of participants after the workshop completion.