Integrating the gender dimension in teaching, research content & knowledge and technology transfer: Validating the EFFORTI evaluation framework through three case studies in Europe.

Gender equality and gender mainstreaming in research is one of the six European Research Area (ERA) priorities. Integrating the gender dimension in research content and teaching is one of its three objectives. It is arguably the objective where least progress has been made. In this article we contribute to the evidence base by applying the EFFORTI evaluation framework to three empirical case study interventions that aim to integrate the gender dimension in tertiary education and research content. Comparison is based on an evaluation of the design of the intervention, those factors that have enabled/ hindered its implementation as well as an assessment of outcomes and impacts. The findings of the case studies highlight the importance of design, specifically regarding resources, legal status and the definition and operationalisation of the gender concept. Implementation hinges on top-level institutional commitment and mainstreaming gender studies with support of a central unit and crucially gender competence. A lack of recognition and status of gender studies and subsequent innovations was seen to hamper implementation. Outcomes and impacts included an increased awareness and interest in gender, increased gender competence, a push towards gender equality regarding representation and organisational change as well as an improved accreditation process and more and better research.

Women Underrepresentation in R&I: A Sector Program Assessment of the Contribution of Gender Equality Policies in Research and Innovation.

Despite decades of efforts to achieve gender equality in research and innovation (R&I), all EU member states still face remarkable difficulties in driving forward the development of their innovation system while at the same time improving gender equality by using all the available research potential. In this paper we focus on the development of the share of women researchers in four national innovation systems, i.e. in Austria, Denmark, Hungary and Spain in the time period 2005-2015. The four selected cases represent countries with significant differences in their innovation capacity, gender regimes and progress of gender equality in R&I. A qualitative comparative analysis (QCA) is carried out to conduct a sector program evaluation based on statistical data and qualitative studies to understand the dynamic development of the proportion of women researchers. The study aims to provide insights into the aggregated gender equality interventions and policies implemented in the four countries studied and their contributions to the development of the proportion of women scientists at the structural level. The analysis reveals that the development of the share of women researchers during the studied period has been particularly influenced by contextual factors, namely the relative size of the business enterprise sector and the share of women among holders of tertiary education. While this is the case, it is found that gender equality interventions need to be more widespread and more effectively designed to be a strong contributing factor to an increasing representation of women in R&I.

Analysing facilitating and hindering factors for implementing gender equality interventions in R&I: Structures and processes.

This article analyses the facilitating and hindering factors that have affected the implementation of gender equality interventions in research and innovation in Europe. It applies the evaluation framework developed in the EFFORTI project that recognizes the complexity of evaluating gender equality interventions in R&I, the importance of factoring in context to any sound evaluation as well as the need to distinguish between the design and implementation of interventions in evaluations. It is based on the analysis of 19 empirical case studies carried out throughout Europe and focuses on those structural and procedural factors that have either facilitated or hindered the implementation process of these interventions. Findings include how the governance framework; top-management commitment; bottom-up participation; framing synergies with other initiatives, strategies for tackling resistance; resources; sustainability of actions; gender competence, experience and knowledge and transparency, targets, standards and monitoring; and accessible data and information all contributed to the successful implementation of the interventions.

Pragmatic ex-ante evaluation using an innovative conceptual framework: The case of a high-tech entrepreneurship program for women.

Program designers at local project level usually design interventions under conditions of scarce resources and bounded rationality lacking sufficient information about the process and impact mechanisms of the complex social programs they design and implement. This paper proposes a model for pragmatic ex ante evaluation using an innovative conceptual framework for practitioners working in the field to improve gender equality in research and innovation. The presented and applied model is pertinent to the theory-oriented evaluation tradition using a logic frame and a theory of change approach adapted to the special requirements of ex-ante evaluation. The model is illustrated by the case study of a program for the promotion of women entrepreneurship in the STEM fields. It is concluded that in a setting with limited resources and information, ex-ante evaluations should aim at defining clear conditions of proportionality and need to take into account the extent to which contextual factors hinder or facilitate the implementation of a program, and the specific institutional and system mechanisms at play, in order to enable proactive risk management from the beginning.