Group Level Assessment Methodology as a Liberating Structure Within Qualitative and Participatory Research.

Group level assessment (GLA) is a qualitative and participatory research-to-action methodology designed to engage a large group of relevant participants throughout the research process. As originally conceived, a single GLA session is led by a trained facilitator who guides the participants through seven structured steps: climate setting, generating, appreciating, reflecting, understanding, selecting, and action. The purpose of this manuscript is to describe the 25-year trajectory and uses, contributions as a liberating structure, and adaptations of GLA.

Similar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial.

BACKGROUND: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. OBJECTIVE: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. METHODS: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning "Interpreting the findings" module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. RESULTS: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students' recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. CONCLUSIONS: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. TRIAL REGISTRATION: Open Science Framework akpq7; https://osf.io/akpq7/.

Researcher-initiated role play, stimulated recall interview, storycrafting, painting and drawing as research methods to reach children's perspectives in health sciences.

AIM: To describe the application of selected creative and participatory research methods in nursing science. DESIGN: Research methodology paper. METHODS: Researcher-initiated role play, stimulated recall interviews, the Storycrafting method, painting and drawing. Altogether, 11 children (5-7 years old) and 12 parents participated in the research. RESULTS: Each small group (n = 3) acted differently during the data collection. Not every child wanted to play, draw or tell stories, but they all expressed their views through some method. Although the same themes emerged from children's narratives, they could not have been verified by just one method. CONCLUSIONS: Using creative and participatory methods and the principles of studies of child perspectives are applicable ways of conducting research in nursing science. Children must be treated as individuals during the research process, and they must have opportunities to use several communication methods to express their views. IMPLICATIONS FOR THE PROFESSION AND PATIENT CARE: Understanding different ways to interact with children and hear children's views will help nurses to encounter children. IMPACT: In this article, we present a valid way of conducting research with children. By following our protocol, nursing research from a child perspective can be implemented. REPORTING METHOD: Consolidated criteria for reporting qualitative research (COREQ). PATIENT CONTRIBUTION: The child participants were involved in choosing physical places for data collection and the usage and order of the selected methods. Both the children and the adult participants took part in interpreting the research data.

Creating web applications for online psychological experiments: A hands-on technical guide including a template.

The present tutorial provides a technical overview of how to create web applications for online psychological experiments from scratch via the HTML/CSS/JavaScript framework. This approach allows virtually unlimited flexibility in accomplishing anything in an online experiment that a regular computer (or smartphone, etc.) is capable of. Apart from offering a fast introduction for complete beginners, this tutorial may also serve as a helpful guideline for more experienced programmers and researchers. Connected to the tutorial, a specific implementation is also given via the free and open-source template project at https://github.com/gasparl/expapp , intended to be improved by the community to always follow the latest technological advancements and general good practices.

[A Brief Introduction to Mixed Methods Systematic Review (MMSR)].

Systematic reviews provide important empirical evidence for healthcare providers to make the best clinical decisions. While qualitative research provides subjective information on the human experience, quantitative research may be used to provide quantified evaluations of interventions. To overcome the lack of objectivity in qualitative research and of context considerations in quantitative research, recent efforts have focused on developing mixed-method approaches that combine meta-analysis (quantitative systematic reviews) and meta-synthesis (qualitative systematic reviews). This new idea may help conceptualize studied phenomena more thoroughly. However, the typology remains inconsistent and the currently proposed approaches lack unified guidance and principles. In this paper, "mixed methods systematic review", a term promoted by the Joanna Briggs Institute, is used to indicate the newly developed systematic review. The use of systematic review in quantitative research and in qualitative research and the use of mixed methods systematic review are introduced chronologically, with an emphasis on procedures, examples, and quality appraisal tools. The concepts and concrete procedures for integrating results from different research method are presented for researchers and healthcare providers to allow them to better understand this approach and explore related phenomena more thoroughly.

Visual arts and drawings to communicate and explore authentic life situations, a data collection method in caring science - a hermeneutic perspective.

This methodological article aims to describe three methodological strategies for using drawings as a part of qualitative data collection methods in caring research based on hermeneutics. In some research interview situations, participants may have difficulties to express their experiences and feelings in words. The consequences may be that the descriptions in research reports will become superficial and not authentic, meaning, "telling it as it is". Drawn pictures may facilitate and support reflection related to the deepening of experiences and thoughts, and communicate and express more than words can do. It may also reveal thoughts and feelings the person drawing the picture was not aware of. Three methodological strategies are described: (1) Drawing a picture as an introduction or starting point for an interview, (2) During an ongoing interview, encouraging the participant to draw a picture when further explanation or description is needed for deepening the communication and (3) Drawing something in a pre-existing picture. The theoretical foundation of Gadamer's hermeneutic philosophy is discussed in relation to what a drawing is representing and presents. The interpretation of the drawn picture depends primarily on the creator of the picture, but at the same time the interpretation and understanding is a movement between the interviewer's and the participant's horizons, and thus is open for preunderstanding and new understanding. In contrast to an ordinary interview between two parties, an interview involving a drawing adds something specific to the conversation as it becomes a "trialogue" and not only a dialog. The drawn picture stands on its own. Using the participant's drawing can, therefore, be understood as an ongoing process with three parties involved: (1) the participant, (2) the researcher and (3) the drawing.

[Overview of research and development of polypeptide drugs and traditional Chinese medicine-peptides].

Peptide is a compound consisting of 2-50 amino acids, which is intermediate between small molecule and protein. It is characterized by a variety of biological activities, easy absorption, strong specific targeting, and few side effects and has become one of the hotspots in biomedical research in recent years. Chinese medicine contains a large number of peptides. The traditional processing methods such as decocting and boiling can effectively boost peptides to exert their due biological activities. At present, however, the research on Chinese medicinal components in laboratory generally employs high-concentration alcohol extraction method, which may cause the peptides to be ignored in many natural Chinese medicines. Substantial studies have revealed that the peptides in Chinese medicine are important material basis responsible for the traditional efficacy. Based on years of research and literature retrieval, this study put forward the concept of "traditional Chinese medicine(TCM)-peptides", referring to the components consisting of two or more amino acids with molecular weight between small molecules and proteins that can express the efficacy of Chinese medicine. Furthermore, this study also summarized the extraction and separation of TCM-peptides, and structure determination methods and routes, predicted the research prospect of modern research methods of TCM-peptides based on "holistic view" and big data. The artificial intelligence prediction was combined with high-throughput screening technology to improve the discovery efficiency and accuracy of TCM-peptides, and holographic images between TCM-peptides and biological targets were established to provide references for the innovative drug design and related health product development of TCM-peptides based on TCM theories.

Reliability and validity of an FFQ for South American children and adolescents from the SAYCARE study.

OBJECTIVE: The purpose of this study was to analyse the reliability and validity of a semi-quantitative FFQ to assess food group consumption in South American children and adolescents. DESIGN: The SAYCARE (South American Youth/Child cARdiovascular and Environmental) study is an observational, multicentre, feasibility study performed in a sample of 3- to 18-year-old children and adolescents attending private and public schools from six South American countries. Participants answered the FFQ twice with a two-week interval and three 24-h dietary recalls. Intraclass and Spearman's correlations, weighted Cohen's kappa (κw), percentage of agreement and energy-adjusted Pearson's correlation coefficients were calculated. SETTING: Seven cities in South America (Buenos Aires, Lima, Medelin, Montevideo, Santiago, Sao Paulo and Teresina). SUBJECTS: A sample of 200 children and 244 adolescents for reliability analyses and 252 children and 244 adolescents for validity analyses were included. RESULTS: Depending on the food group, for children and adolescents, reliability analyses resulted in Spearman's coefficients from 0·47 to 0·73, intraclass correlation coefficients from 0·66 to 0·99, κw coefficients from 0·35 to 0·63, and percentage of agreement between 72·75 and 83·52 %. In the same way, validity analyses resulted in Spearman's coefficients from 0·17 to 0·37, energy-adjusted Pearson's coefficients from 0·17 to 0·61, κw coefficients from 0·09 to 0·24, and percentages of agreement between 45·79 and 67·06 %. CONCLUSION: The SAYCARE FFQ achieved reasonable reliability and slight-moderate validity for almost all food groups intakes. Accordingly, it can be used for the purpose of ranking the intake of individuals within a population.

Physiotherapists' and midwives' views of increased inter recti abdominis distance and its management in women after childbirth.

BACKGROUND: Physiotherapists and midwives in primary healthcare often encounter women with an increased separation between the two rectus abdominis muscle bellies after pregnancy, a so-called increased inter recti distance (IRD). There are few studies on the contribution of increased IRD to the explanation of post-partum health complaints, and very little guidance in the literature for health professionals on the management of increased IRD. The aim of this study was to describe how physiotherapists and midwives in primary healthcare perceive the phenomenon of increased IRD and its management in women after childbirth. METHODS: A purposeful sampling approach was used to select physiotherapists and midwives working in primary healthcare in three large county council healthcare organisations in Sweden having experience of encountering women with increased IRD after pregnancy. Sixteen physiotherapists and midwives participated in focus group discussions. Four focus groups with four participants in each were undertaken. A semi-structured topic guide was used to explore responses to the research questions and the discussions were analysed using qualitative content analysis. RESULTS: We identified an overarching theme: Ambivalence towards the phenomenon increased IRD and frustration over insufficient professional knowledge. The theme included three categories: Uncertainty concerning the significance of increased IRD as a causal factor for functional problems; perceived insufficient professional knowledge base for the management of increased IRD; and lack of inter-professional collaboration and teamwork in the management of patients with increased IRD. Due to sparse and somewhat contradictory research findings and absence of clinical guidelines, the health professionals lacked basic preconditions for applying an evidence-based practice concerning increased IRD. They obtained their information about increased IRD from the media and fitness coaches, and hence were somewhat unsure about what to believe regarding the phenomenon. CONCLUSIONS: There was no consensus among the health professionals on how to best approach increased IRD in the clinical setting. Our findings stress the importance of more research to increase the professional knowledge base among physiotherapists and midwives. The findings highlight the urgent need for policies and clinical guidelines advising health professionals in the management of increased IRD and for facilitating inter-professional collaboration and teamwork.

How to choose your study design.

Research designs are broadly divided into observational studies (i.e. cross-sectional; case-control and cohort studies) and experimental studies (randomised control trials, RCTs). Each design has a specific role, and each has both advantages and disadvantages. Moreover, while the typical RCT is a parallel group design, there are now many variants to consider. It is important that both researchers and paediatricians are aware of the role of each study design, their respective pros and cons, and the inherent risk of bias with each design. While there are numerous quantitative study designs available to researchers, the final choice is dictated by two key factors. First, by the specific research question. That is, if the question is one of 'prevalence' (disease burden) then the ideal is a cross-sectional study; if it is a question of 'harm' - a case-control study; prognosis - a cohort and therapy - a RCT. Second, by what resources are available to you. This includes budget, time, feasibility re-patient numbers and research expertise. All these factors will severely limit the choice. While paediatricians would like to see more RCTs, these require a huge amount of resources, and in many situations will be unethical (e.g. potentially harmful intervention) or impractical (e.g. rare diseases). This paper gives a brief overview of the common study types, and for those embarking on such studies you will need far more comprehensive, detailed sources of information.

Fake news and fake research: Why meta-research matters more than ever.

Research is in a crisis of credibility, and this is to the peril of all paediatricians. Billions of dollars are being wasted each year because research is not planned, badly conducted or poorly reported, and this is on a background of rapidly reducing research budgets. How can paediatricians, families and patients make informed treatment choices if the evidence base is absent or not trustworthy? This article discusses why meta-research now matters more than ever, how it can help solve this crisis of credibility and how this should lead to more efficient and effective clinical care. The field of meta-research or research-on-research is the ultimate big picture approach to identifying and solving issues of bias, error, misconduct and waste in research. Meta-researchers value authenticity over aesthetics and quality over quantity. The utility of meta-research does not rely on accusations or critical assessments of individual research, but through highlighting where and how the scientific method and research standards across all fields can be improved. Meta-researchers study, analyse and critique the research pathway, focusing on elements such as methods (how to conduct), evaluation (how to test), reporting (how to communicate), reproducibility (how to verify) and incentives (how to reward). In the current climate it is now more critical than ever that we make use of meta-research and prioritise high-quality high-impact research, ultimately leading to improved patient outcomes.

When Public Health Research Meets Social Media: Knowledge Mapping From 2000 to 2018.

BACKGROUND: Social media has substantially changed how people confront health issues. However, a comprehensive understanding of how social media has altered the foci and methods in public health research remains lacking. OBJECTIVE: This study aims to examine research themes, the role of social media, and research methods in social media-based public health research published from 2000 to 2018. METHODS: A dataset of 3419 valid studies was developed by searching a list of relevant keywords in the Web of Science and PubMed databases. In addition, this study employs an unsupervised text-mining technique and topic modeling to extract research themes of the published studies. Moreover, the role of social media and research methods adopted in those studies were analyzed. RESULTS: This study identifies 25 research themes, covering different diseases, various population groups, physical and mental health, and other significant issues. Social media assumes two major roles in public health research: produce substantial research interest for public health research and furnish a research context for public health research. Social media provides substantial research interest for public health research when used for health intervention, human-computer interaction, as a platform of social influence, and for disease surveillance, risk assessment, or prevention. Social media acts as a research context for public health research when it is mere reference, used as a platform to recruit participants, and as a platform for data collection. While both qualitative and quantitative methods are frequently used in this emerging area, cutting edge computational methods play a marginal role. CONCLUSIONS: Social media enables scholars to study new phenomena and propose new research questions in public health research. Meanwhile, the methodological potential of social media in public health research needs to be further explored.

Early Maternal Caregiving: A Conceptualization of Maternal Compassion Preoccupation.

The literature refers extensively to the ramifications of the mother's care on her infant. However, little attention has been paid to the effects of maternal caregiving on the emotional experience of the mother herself. Using grounded theory methodology, we sought to contribute to fill this gap, and conducted open indepth interviews with 20 Israeli mothers of infants up to 3 months of age. Three core categories emerged from the interviews: Difficulty, Pleasure and Satisfaction, and Concern for Personal Needs. We found these categories to parallel three theoretical concepts relating to caregivers in general: compassion fatigue, compassion satisfaction, and self-compassion. Consequently, we propose a new inclusive theoretical concept termed Maternal Compassion Preoccupation. The findings and conceptualization can contribute to the theoretical knowledge associated with early maternal caregiving, and to a new perspective on interventions aimed at helping women to cope with the high care demands of early motherhood.

Barriers and recruitment strategies for precarious status migrants in Montreal, Canada.

BACKGROUND: Precarious status migrants are a group of persons who are vulnerable, heterogeneous, and often suspicious of research teams. They are underrepresented in population-based research projects, and strategies to recruit them are described exclusively in terms of a single cultural group. We analyzed the recruitment strategies implemented during a research project aimed at understanding precarious status migrants' health status and healthcare access in Montreal, Canada. The research sample consisted of 854 persons recruited from a variety of ethnocultural communities between June 2016 and September 2017. This article analyzes the strategies implemented by the research team to respond to the challenges of that recruitment, and assess the effectiveness of those strategies. Based on the results, we share the lessons learned with a view to increasing precarious status migrants' representation in research. METHOD: A mixed sequential design was used to combine qualitative data gathered from members of the research team at a reflexive workshop (n = 16) and in individual interviews (n = 15) with qualitative and quantitative data collected using the conceptual mapping method (n = 10). RESULTS: The research team encountered challenges in implementing the strategies, related to the identification of the target population, the establishment of community partnerships, and suspicion on the part of the individuals approached. The combination of a venue-based sampling method, a communications strategy, and the snowball sampling method was key to the recruitment. Linking people with resources that could help them was useful in obtaining their effective and non-instrumental participation in the study. Creating a diverse and multicultural team helped build trust with participants. However, the strategy of matching the ethnocultural identity of the interviewer with that of the respondent was not systematically effective. CONCLUSION: The interviewers' experience and their understanding of the issue are important factors to take into consideration in future research. More over, the development of a community resource guide tailored to the needs of participants should be major components of any research project targeting migrants. Finally, strategies should be implemented as the result of a continuous reflexive process among all members of the research team.

Wrongdoing and whistleblowing in health care.

AIM(S): To describe healthcare professionals' experiences of observed wrongdoing and potential whistleblowing acts regarding it. The main goal is to strengthen the whistleblowing process described based on the existing literature and to make it more visible for future research. DESIGN: A descriptive cross-sectional survey. METHODS: Data were collected between 26 June 2015-17 July 2015 from the Finnish trade union's membership register, electronically using one open question. A total of 226 healthcare professionals participated providing written narratives, which were analysed using inductive content analysis. FINDINGS: The whistleblowing process in health care was strengthened, identifying the content of observed wrongdoings and whistleblowing acts regarding them. Three themes were identified: wrongdoing related to patients, healthcare professionals, and healthcare managers. Whistleblowing acts were performed internally, externally, or left undone. Three main paths: internal, external, and no whistleblowing, between an observation of wrongdoing and whistleblowing act were identified. CONCLUSION: The whistleblowing process should be further developed and ethically effective programmes and interventions should be developed for increasing whistleblowing and preventing wrongdoing in health care.

What is required to facilitate implementation of Swedish physical activity on prescription? - interview study with primary healthcare staff and management.

BACKGROUND: The method, Swedish Physical Activity on Prescription (SPAP), has been launched in Swedish healthcare to promote physical activity for prevention and treatment of lifestyle related health disorders. Despite scientific support for the method, and education campaigns, it is used to a limited extent by health professionals. The aim of the study was to describe the views of health professionals on perceived facilitators, barriers and requirements for successful implementation of SPAP in primary healthcare. METHODS: Eighteen semi-structured interviews with stakeholders in SPAP, i.e. ten people working in local or central management and eight primary healthcare professionals in two regional healthcare organisations, were analysed using qualitative content analysis. RESULTS: We identified an overarching theme regarding requirements for successful implementation of SPAP: Need for knowledge and organisational support, comprising four main categories: Need for increased knowledge and affirmative attitude among health professionals; Need for clear and supportive management; Need for central supporting structures; Need for local supporting structures. Knowledge of the SPAP method content and core components was limited. Confidence in the method varied among health professionals. There was a discrepancy between the central organisation policy documents declaring that disease preventive methods were prioritised and a mandatory assignment, while the health professionals asked for increased interest, support and resources from management, primarily time and supporting structures. There were somewhat conflicting views between primary healthcare professionals and managers concerning perceived barriers and requirements. In contrast to some of the management's beliefs, all primary healthcare professionals undisputedly acknowledged the importance of promoting physical activity, but they lacked time, written routines and in some cases competence for SPAP counselling. CONCLUSION: The study provides knowledge regarding requirements to facilitate the implementation of SPAP in healthcare. There was limited knowledge among health professionals regarding core components of SPAP and how to practise the method, which speaks for in-depth training in the SPAP method. The findings highlight the importance of forming policies and guidelines and establishing organisational supporting structures, and ensuring that these are well known and approved in all parts of the healthcare organisation.

Social network analysis: Presenting an underused method for nursing research.

AIM: This paper introduces social network analysis as a versatile method with many applications in nursing research. BACKGROUND: Social networks have been studied for years in many social science fields. The methods continue to advance but remain unknown to most nursing scholars. DESIGN: Discussion paper. DATA SOURCES: English language and interpreted literature was searched from Ovid Healthstar, CINAHL, PubMed Central, Scopus and hard copy texts from 1965 - 2017. DISCUSSION: Social network analysis first emerged in nursing literature in 1995 and appears minimally through present day. To convey the versatility and applicability of social network analysis in nursing, hypothetical scenarios are presented. The scenarios are illustrative of three approaches to social network analysis and include key elements of social network research design. IMPLICATIONS FOR NURSING: The methods of social network analysis are underused in nursing research, primarily because they are unknown to most scholars. However, there is methodological flexibility and epistemological versatility capable of supporting quantitative and qualitative research. The analytic techniques of social network analysis can add new insight into many areas of nursing inquiry, especially those influenced by cultural norms. Furthermore, visualization techniques associated with social network analysis can be used to generate new hypotheses. CONCLUSION: Social network analysis can potentially uncover findings not accessible through methods commonly used in nursing research. Social networks can be analysed based on individual-level attributes, whole networks and subgroups within networks. Computations derived from social network analysis may stand alone to answer a research question or incorporated as variables into robust statistical models.

The search for understanding: the role of paradigms.

BACKGROUND: Kuhn's ( 1962 ) acknowledgement of a paradigm as a way that scientists make sense of their world and its reality gave recognition to the idea of 'paradigm shift'. This shift exposes the transience of paradigm development shaped by societal and scientific evolution. This ongoing evolutionary development provides the researcher with many paradigms to consider regarding how research is undertaken and the search for understanding achieved. AIM: An understanding of paradigm development is necessary when planning a study and can shape the search for understanding. It is hoped that the discussion presented here will assist novice and experienced researchers in articulating the rationales for their paradigm choices. DISCUSSION: An overview of the dominant paradigms is presented, reflecting ongoing paradigm development shaped by ontological, epistemological and methodological perspectives. Potential paradigm choices that shape research aims, objectives and focus in the search for understanding are considered. CONCLUSION: The inherent debates about paradigm shift, division, war and synthesis leave the researcher many perspectives to consider. Articulating the world views underpinning constructivism, interpretivism and pragmatism is particularly challenging because of the blurring of boundaries between them. IMPLICATIONS FOR PRACTICE: The evolutionary nature of paradigmatic development has provided nurse researchers with the opportunity for methodological openness to the myriad research approaches, methods and designs that they may choose to answer their research question. However, it is imperative that researchers consider their ontological stances and the nature of their research questions. This is challenging in constructivism, interpretivism and pragmatism, where there is often an overlap of paradigm world views.

Quantification and comparison of neurosurgical approaches in the preclinical setting: literature review.

There is a growing awareness of the need for evidence-based surgery and of the issues that are specific to research in surgery. Well-conducted anatomical studies can represent the first, preclinical step for evidence-based surgical innovation and evaluation. In the last two decades, various reports have quantified and compared neurosurgical approaches in the anatomy laboratory using different methods and technology. The aim of this study was to critically review these papers. A PubMed and Scopus search was performed to select articles that quantified and compared different neurosurgical approaches in the preclinical setting. The basic characteristics that anatomically define a surgical approach were defined. Each study was analyzed for measured features and quantification method and technique. Ninety-nine papers, published from 1990 to 2013, were included in this review. A heterogeneous use of terms to define the features of a surgical approach was evident. Different methods to study these features have been reported; they are generally based on quantification of distances, angles, and areas. Measuring tools have evolved from the simple ruler to frameless stereotactic devices. The reported methods have each specific advantages and limits; a common limitation is the lack of 3D visualization and surgical volume quantification. There is a need for a uniform nomenclature in anatomical studies. Frameless stereotactic devices provide a powerful tool for anatomical studies. Volume quantification and 3D visualization of the surgical approach is not provided with most available methods.

Testing an Adapted Modified Delphi Method: Synthesizing Multiple Stakeholder Ratings of Health Care Service Effectiveness.

BACKGROUND: The Affordable Care Act incentivizes health systems for better meeting patient needs, but often guidance about patient preferences for particular health services is limited. All too often vulnerable patient populations are excluded from these decision-making settings. A community-based participatory approach harnesses the in-depth knowledge of those experiencing barriers to health care. METHOD: We made three modifications to the RAND-UCLA appropriateness method, a modified Delphi approach, involving patients, adding an advisory council group to characterize existing knowledge in this little studied area, and using effectiveness rather than "appropriateness" as the basis for rating. As a proof of concept, we tested this method by examining the broadly delivered but understudied nonmedical services that community health centers provide. RESULTS: This method created discrete, new knowledge about these services by defining 6 categories and 112 unique services and by prioritizing among these services based on effectiveness using a 9-point scale. Consistent with the appropriateness method, we found statistical convergence of ratings among the panelists. DISCUSSION: Challenges include time commitment and adherence to a clear definition of effectiveness of services. This diverse stakeholder engagement method efficiently addresses gaps in knowledge about the effectiveness of health care services to inform population health management.