Streamlined research funding using short proposals and accelerated peer review: an observational study.

BACKGROUND: Despite the widely recognised importance of sustainable health care systems, health services research remains generally underfunded in Australia. The Australian Centre for Health Services Innovation (AusHSI) is funding health services research in the state of Queensland. AusHSI has developed a streamlined protocol for applying and awarding funding using a short proposal and accelerated peer review. METHOD: An observational study of proposals for four health services research funding rounds from May 2012 to November 2013. A short proposal of less than 1,200 words was submitted using a secure web-based portal. The primary outcome measures are: time spent preparing proposals; a simplified scoring of grant proposals (reject, revise or accept for interview) by a scientific review committee; and progressing from submission to funding outcomes within eight weeks. Proposals outside of health services research were deemed ineligible. RESULTS: There were 228 eligible proposals across 4 funding rounds: from 29% to 79% were shortlisted and 9% to 32% were accepted for interview. Success rates increased from 6% (in 2012) to 16% (in 2013) of eligible proposals. Applicants were notified of the outcomes within two weeks from the interview; which was a maximum of eight weeks after the submission deadline. Applicants spent 7 days on average preparing their proposal. Applicants with a ranking of reject or revise received written feedback and suggested improvements for their proposals, and resubmissions composed one third of the 2013 rounds. CONCLUSIONS: The AusHSI funding scheme is a streamlined application process that has simplified the process of allocating health services research funding for both applicants and peer reviewers. The AusHSI process has minimised the time from submission to notification of funding outcomes.

'As many options as there are, there are just not enough for me': contraceptive use and barriers to access among Australian women.

OBJECTIVE: A comprehensive life course perspective of women's experiences in obtaining and using contraception in Australia is lacking. This paper explores free-text comments about contraception provided by women born between 1973 and 1978 who participated in the Australian Longitudinal Study on Women's Health (ALSWH). METHODS: The ALSWH is a national population-based cohort study involving over 40,000 women from three age groups, who are surveyed every three years. An initial search identified 1600 comments from 690 women across five surveys from 1996 (when they were aged 18-23 years) to 2009 (31-36 years). The analysis included 305 comments from 289 participants. Factors relating to experiences of barriers to access and optimal contraceptive use were identified and explored using thematic analysis. RESULTS: Five themes recurred across the five surveys as women aged: (i) side effects affecting physical and mental health; (ii) lack of information about contraception; (iii) negative experiences with health services; (iv) contraceptive failure; and (v) difficulty with accessing contraception. CONCLUSION: Side effects of hormonal contraception and concerns about contraceptive failure influence women's mental and physical health. Many barriers to effective contraception persist throughout women's reproductive lives. Further research is needed into reducing barriers and minimising negative experiences, to ensure optimal contraceptive access for Australian women.

Predictors of sexually transmitted infection in Australian women: evidence from the Australian Longitudinal Study on Women's Health.

This longitudinal study examined characteristics of women diagnosed with sexually transmitted infections (STI) for the first time in their later 20s and early 30s. Participants were 6,840 women (born 1973-1978) from the Australian Longitudinal Study on Women's Health. Women aged 18-23 years were surveyed in 1996 (S1), 2000 (S2), 2003 (S3), and 2006 (S4). There were 269 women reporting an STI for the first time at S3 or S4. Using two multivariable logistic regression analyses (examining 18 predictor variables), these 269 women were compared (1) with 306 women who reported an STI at S2 and (2) with 5,214 women who never reported an STI across the four surveys. Women who reported an STI for the first time at S3 or S4 were less likely to have been pregnant or had a recent Pap smear compared to women reporting an STI at S2. Women reporting a first STI at S3 or S4 were less likely to have been pregnant or had a recent Pap smear compared to women reporting an STI at S2. Women were more likely to report an STI for the first time at S3 or S4 compared to women not reporting an STI at any survey if they were younger, unpartnered, had a higher number of sexual partners, had never been pregnant, were recently divorced or separated, and reported poorer access to Women's Health or Family Planning Centres at S2. These findings demonstrate the value of longitudinal studies of sexual health over the life course beyond adolescence.

Challenges for researchers investigating contraceptive use and pregnancy intentions of young women living in urban and rural areas of Australia: face-to-face discussions to increase participation in a web-based survey.

BACKGROUND: It is imperative to understand how to engage young women in research about issues that are important to them. There is limited reliable data on how young women access contraception in Australia especially in rural areas where services may be less available. OBJECTIVE: This paper identifies the challenges involved in engaging young Australian women aged 18-23 years to participate in a web-based survey on contraception and pregnancy and ensure their ongoing commitment to follow-up web-based surveys. METHODS: A group of young women, aged 18-23 years and living in urban and rural New South Wales, Australia, were recruited to participate in face-to-face discussions using several methods of recruitment: direct contact (face-to-face, telephone or email) and snowball sampling by potential participants inviting their friends. All discussions were transcribed verbatim and analyzed using thematic analysis. RESULTS: Twenty young women participated (urban, n=10: mean age 21.6 years; rural, n=10: 20.0 years) and all used computers or smart phones to access the internet on a daily basis. All participants were concerned about the cost of internet access and utilized free access to social media on their mobile phones. Their willingness to participate in a web-based survey was dependent on incentives with a preference for small financial rewards. Most participants were concerned about their personal details and survey responses remaining confidential and secure. The most appropriate survey would take up to 15 minutes to complete, be a mix of short and long questions and eye-catching with bright colours. Questions on the sensitive topics of sexual activity, contraception and pregnancy were acceptable if they could respond with "I prefer not to answer". CONCLUSIONS: There are demographic, participation and survey design challenges in engaging young women in a web-based survey. Based on our findings, future research efforts are needed to understand the full extent of the role social media and incentives play in the decision of young women to participate in web-based research.

'Are you siding with a personality or the grant proposal?': observations on how peer review panels function.

BACKGROUND: In Australia, the peer review process for competitive funding is usually conducted by a peer review group in conjunction with prior assessment from external assessors. This process is quite mysterious to those outside it. The purpose of this research was to throw light on grant review panels (sometimes called the 'black box') through an examination of the impact of panel procedures, panel composition and panel dynamics on the decision-making in the grant review process. A further purpose was to compare experience of a simplified review process with more conventional processes used in assessing grant proposals in Australia. METHODS: This project was one aspect of a larger study into the costs and benefits of a simplified peer review process. The Queensland University of Technology (QUT)-simplified process was compared with the National Health and Medical Research Council's (NHMRC) more complex process. Grant review panellists involved in both processes were interviewed about their experience of the decision-making process that assesses the excellence of an application. All interviews were recorded and transcribed. Each transcription was de-identified and returned to the respondent for review. Final transcripts were read repeatedly and coded, and similar codes were amalgamated into categories that were used to build themes. Final themes were shared with the research team for feedback. RESULTS: Two major themes arose from the research: (1) assessing grant proposals and (2) factors influencing the fairness, integrity and objectivity of review. Issues such as the quality of writing in a grant proposal, comparison of the two review methods, the purpose and use of the rebuttal, assessing the financial value of funded projects, the importance of the experience of the panel membership and the role of track record and the impact of group dynamics on the review process were all discussed. The research also examined the influence of research culture on decision-making in grant review panels. One of the aims of this study was to compare a simplified review process with more conventional processes. Generally, participants were supportive of the simplified process. CONCLUSIONS: Transparency in the grant review process will result in better appreciation of the outcome. Despite the provision of clear guidelines for peer review, reviewing processes are likely to be subjective to the extent that different reviewers apply different rules. The peer review process will come under more scrutiny as funding for research becomes even more competitive. There is justification for further research on the process, especially of a kind that taps more deeply into the 'black box' of peer review.

Using simplified peer review processes to fund research: a prospective study.

OBJECTIVE: To prospectively test two simplified peer review processes, estimate the agreement between the simplified and official processes, and compare the costs of peer review. DESIGN, PARTICIPANTS AND SETTING: A prospective parallel study of Project Grant proposals submitted in 2013 to the National Health and Medical Research Council (NHMRC) of Australia. The official funding outcomes were compared with two simplified processes using proposals in Public Health and Basic Science. The two simplified processes were: panels of 7 reviewers who met face-to-face and reviewed only the nine-page research proposal and track record (simplified panel); and 2 reviewers who independently reviewed only the nine-page research proposal (journal panel). The official process used panels of 12 reviewers who met face-to-face and reviewed longer proposals of around 100 pages. We compared the funding outcomes of 72 proposals that were peer reviewed by the simplified and official processes. MAIN OUTCOME MEASURES: Agreement in funding outcomes; costs of peer review based on reviewers' time and travel costs. RESULTS: The agreement between the simplified and official panels (72%, 95% CI 61% to 82%), and the journal and official panels (74%, 62% to 83%), was just below the acceptable threshold of 75%. Using the simplified processes would save $A2.1-$A4.9 million per year in peer review costs. CONCLUSIONS: Using shorter applications and simpler peer review processes gave reasonable agreement with the more complex official process. Simplified processes save time and money that could be reallocated to actual research. Funding agencies should consider streamlining their application processes.

Higher uptake of long-acting reversible and permanent methods of contraception by Australian women living in rural and remote areas.

OBJECTIVES: To examine factors associated with the uptake of i) long-acting reversible, ii) permanent and iii) traditional contraceptive methods among Australian women. METHODS: Participants in the Australian Longitudinal Study on Women's Health born in 1973-78 reported on their contraceptive use at three surveys: 2003, 2006 and 2009. The participants were 5,849 women aged 25-30 in 2003 randomly sampled from Medicare. The main outcome measure was current contraceptive method at age 28-33 years categorised as long-acting reversible methods (implant, IUD, injection), permanent (tubal ligation, vasectomy), and traditional methods (oral contraceptive pills, condoms, withdrawal, safe period). RESULTS: Compared to women living in major cities, women in inner regional areas were more likely to use long-acting (OR=1.26, 95%CI 1.03-1.55) or permanent methods (OR=1.43, 95%CI 1.17-1.76). Women living in outer regional/remote areas were more likely than women living in cities to use long-acting (OR=1.65, 95%CI 1.31-2.08) or permanent methods (OR=1.69, 95%CI 1.43-2.14). CONCLUSIONS: Location of residence is an important factor in women's choices about long-acting and permanent contraception in addition to the number and age of their children. IMPLICATIONS: Further research is needed to understand the role of geographical location in women's access to contraceptive options in Australia.

The impact of funding deadlines on personal workloads, stress and family relationships: a qualitative study of Australian researchers.

OBJECTIVE: To examine the impact of applying for funding on personal workloads, stress and family relationships. DESIGN: Qualitative study of researchers preparing grant proposals. SETTING: Web-based survey on applying for the annual National Health and Medical Research Council (NHMRC) Project Grant scheme. PARTICIPANTS: Australian researchers (n=215). RESULTS: Almost all agreed that preparing their proposals always took top priority over other work (97%) and personal (87%) commitments. Almost all researchers agreed that they became stressed by the workload (93%) and restricted their holidays during the grant writing season (88%). Most researchers agreed that they submitted proposals because chance is involved in being successful (75%), due to performance requirements at their institution (60%) and pressure from their colleagues to submit proposals (53%). Almost all researchers supported changes to the current processes to submit proposals (95%) and peer review (90%). Most researchers (59%) provided extensive comments on the impact of writing proposals on their work life and home life. Six major work life themes were: (1) top priority; (2) career development; (3) stress at work; (4) benefits at work; (5) time spent at work and (6) pressure from colleagues. Six major home life themes were: (1) restricting family holidays; (2) time spent on work at home; (3) impact on children; (4) stress at home; (5) impact on family and friends and (6) impact on partner. Additional impacts on the mental health and well-being of researchers were identified. CONCLUSIONS: The process of preparing grant proposals for a single annual deadline is stressful, time consuming and conflicts with family responsibilities. The timing of the funding cycle could be shifted to minimise applicant burden, give Australian researchers more time to work on actual research and to be with their families.

On the time spent preparing grant proposals: an observational study of Australian researchers.

OBJECTIVE: To estimate the time spent by the researchers for preparing grant proposals, and to examine whether spending more time increase the chances of success. DESIGN: Observational study. SETTING: The National Health and Medical Research Council (NHMRC) of Australia. PARTICIPANTS: Researchers who submitted one or more NHMRC Project Grant proposals in March 2012. MAIN OUTCOME MEASURES: Total researcher time spent preparing proposals; funding success as predicted by the time spent. RESULTS: The NHMRC received 3727 proposals of which 3570 were reviewed and 731 (21%) were funded. Among our 285 participants who submitted 632 proposals, 21% were successful. Preparing a new proposal took an average of 38 working days of researcher time and a resubmitted proposal took 28 working days, an overall average of 34 days per proposal. An estimated 550 working years of researchers' time (95% CI 513 to 589) was spent preparing the 3727 proposals, which translates into annual salary costs of AU$66 million. More time spent preparing a proposal did not increase the chances of success for the lead researcher (prevalence ratio (PR) of success for 10 day increase=0.91, 95% credible interval 0.78 to 1.04) or other researchers (PR=0.89, 95% CI 0.67 to 1.17). CONCLUSIONS: Considerable time is spent preparing NHMRC Project Grant proposals. As success rates are historically 20-25%, much of this time has no immediate benefit to either the researcher or society, and there are large opportunity costs in lost research output. The application process could be shortened so that only information relevant for peer review, not administration, is collected. This would have little impact on the quality of peer review and the time saved could be reinvested into research.

Birth outcomes after spontaneous or assisted conception among infertile Australian women aged 28 to 36 years: a prospective, population-based study.

OBJECTIVE: To examine the extent to which the odds of birth, pregnancy, or adverse birth outcomes are higher among women aged 28 to 36 years who use fertility treatment compared with untreated women. DESIGN: Prospective, population-based. SETTING: Not applicable. PATIENT(S): Participants in the ALSWH born in 1973 to 1978 who reported on their infertility and use of in vitro fertilization (IVF) or ovulation induction (OI). INTERVENTION(S): Postal survey questionnaires administered as part of ALSWH. MAIN OUTCOME MEASURE(S): Among women treated with IVF or OI and untreated women, the odds of birth outcomes estimated by use of adjusted logistic regression modeling. RESULT(S): Among 7,280 women, 18.6% (n = 1,376) reported infertility. Half (53.0%) of the treated women gave birth compared with 43.8% of untreated women. Women with prior parity were less likely to use IVF compared with nulliparous women. Women using IVF or OI, respectively, were more likely to have given birth after treatment or be pregnant compared with untreated women. Women using IVF or OI were as likely to have ectopic pregnancies, stillbirths, or premature or low birthweight babies as untreated women. CONCLUSION(S): More than 40% of women aged 28-36 years reporting a history of infertility can achieve births without using treatment, indicating they are subfertile rather than infertile.

Miscarriage, preterm delivery, and stillbirth: large variations in rates within a cohort of Australian women.

OBJECTIVES: We aimed to use simple clinical questions to group women and provide their specific rates of miscarriage, preterm delivery, and stillbirth for reference. Further, our purpose was to describe who has experienced particularly low or high rates of each event. METHODS: Data were collected as part of the Australian Longitudinal Study on Women's Health, a national prospective cohort. Reproductive histories were obtained from 5806 women aged 31-36 years in 2009, who had self-reported an outcome for one or more pregnancy. Age at first birth, number of live births, smoking status, fertility problems, use of in vitro fertilisation (IVF), education and physical activity were the variables that best separated women into groups for calculating the rates of miscarriage, preterm delivery, and stillbirth. RESULTS: Women reported 10,247 live births, 2544 miscarriages, 1113 preterm deliveries, and 113 stillbirths. Miscarriage was correlated with stillbirth (r = 0.09, P<0.001). The calculable rate of miscarriage ranged from 11.3 to 86.5 miscarriages per 100 live births. Women who had high rates of miscarriage typically had fewer live births, were more likely to smoke and were more likely to have tried unsuccessfully to conceive for ≥12 months. The highest proportion of live preterm delivery (32.2%) occurred in women who had one live birth, had tried unsuccessfully to conceive for ≥12 months, had used IVF, and had 12 years education or equivalent. Women aged 14-19.99 years at their first birth and reported low physical activity had 38.9 stillbirths per 1000 live births, compared to the lowest rate at 5.5 per 1000 live births. CONCLUSION: Different groups of women experience vastly different rates of each adverse pregnancy event. We have used simple questions and established reference data that will stratify women into low- and high-rate groups, which may be useful in counselling those who have experienced miscarriage, preterm delivery, or stillbirth, plus women with fertility intent.

Depression: an emotional obstacle to seeking medical advice for infertility.

OBJECTIVE: To investigate the mental and general health of infertile women who had not sought medical advice for their recognized infertility and were therefore not represented in clinical populations. DESIGN: Longitudinal cohort study. SETTING: Population based. PATIENT(S): Participants in the Australian Longitudinal Study on Women's Health aged 28-33 years in 2006 who had ever tried to conceive or had been pregnant (n = 5,936). INTERVENTION(S): None. MAIN OUTCOME MEASURE(S): Infertility, not seeking medical advice. RESULT(S): Compared with fertile women (n = 4,905), infertile women (n = 1,031) had higher odds of self-reported depression (odds ratio [OR] 1.20, 95% confidence interval [CI] 1.01-1.43), endometriosis (5.43, 4.01-7.36), polycystic ovary syndrome (9.52, 7.30-12.41), irregular periods (1.99, 1.68-2.36), type II diabetes (4.70, 1.79-12.37), or gestational diabetes (1.66, 1.12-2.46). Compared with infertile women who sought medical advice (n = 728), those who had not sought medical advice (n = 303) had higher odds of self-reported depression (1.67, 1.18-2.37), other mental health problems (3.14, 1.14-8.64), urinary tract infections (1.67, 1.12-2.49), heavy periods (1.63, 1.16-2.29), or a cancer diagnosis (11.33, 2.57-49.89). Infertile women who had or had not sought medical advice had similar odds of reporting an anxiety disorder or anxiety-related symptoms. CONCLUSION(S): Women with self-reported depression were unlikely to have sought medical advice for infertility. Depression and depressive symptoms may be barriers to seeking medical advice for infertility.

Early users of fertility treatment with hormones and IVF: women who live in major cities and have private health insurance.

OBJECTIVE: To identify early users (women aged <34 years) of fertility treatment with hormones and in vitro fertilisation (IVF). METHODS: A cross-sectional survey of infertile women from fertility clinics (n=59) and from the community (Australian Longitudinal Study on Women's Health participants) who had (n=121) or had not (n=110) used hormones/IVF as treatment for infertility. Associations between socio-demographic, reproductive and lifestyle factors, medical conditions and recurrent symptoms and using treatment (or not) were analysed using multivariable logistic regression. RESULTS: Among infertile women who had used treatment (community vs clinic), women from clinics had lower odds of living outside major cities, using hormones only, i.e., not IVF, or recurrent headaches/migraines, severe tiredness, or stiff/painful joints; and higher odds of recent diagnoses of urinary tract infection or anxiety disorder. Compared to infertile women who had not used treatment, women from clinics had lower odds of living outside major cities, recurrent allergies or severe tiredness; and higher odds of having private health insurance for hospital or ancillary services, recent diagnosis of polycystic ovary syndrome or recurrent constipation. CONCLUSIONS: Compared to infertile women in the community, living in major cities and having private health insurance are associated with early use of treatment for infertility at specialist clinics by women aged <34 years. IMPLICATIONS: These results provided evidence of inequity of services for infertile women.

Infertility, medical advice and treatment with fertility hormones and/or in vitro fertilisation: a population perspective from the Australian Longitudinal Study on Women's Health.

OBJECTIVE: To identify the factors associated with infertility, seeking advice and treatment with fertility hormones and/or in vitro fertilisation (IVF) among a general population of women. METHODS: Participants in the Australian Longitudinal Study on Women's Health aged 28-33 years in 2006 had completed up to four mailed surveys over 10 years (n=9,145). Parsimonious multivariate logistic regression was used to identify the socio-demographic, biological (including reproductive histories), and behavioural factors associated with infertility, advice and hormonal/IVF treatment. RESULTS: For women who had tried to conceive or had been pregnant (n=5,936), 17% reported infertility. Among women with infertility (n=1031), 72% (n=728) sought advice but only 50% (n=356) used hormonal/IVF treatment. Women had higher odds of infertility when: they had never been pregnant (OR=7.2, 95% CI 5.6-9.1) or had a history of miscarriage (OR range=1.5-4.0) than those who had given birth (and never had a miscarriage or termination). CONCLUSION: Only one-third of women with infertility used hormonal and/or IVF treatment. Women with PCOS or endometriosis were the most proactive in having sought advice and used hormonal/IVF treatment. IMPLICATIONS: Raised awareness of age-related declining fertility is important for partnered women aged approximately 30 years to encourage pregnancy during their prime reproductive years and reduce the risk of infertility.

Infertility in Australia circa 1980: an historical population perspective on the uptake of fertility treatment by Australian women born in 1946-51.

OBJECTIVE: To estimate the prevalence of lifetime infertility in Australian women born in 1946-51 and examine their uptake of treatment. METHODS: Participants in the Australian Longitudinal Study on Women's Health born in 1946-51 (n=13,715) completed up to four mailed surveys from 1996 to 2004. The odds of infertility were estimated using logistic regression with adjustment for socio-demographic and reproductive factors. RESULTS: Among participants, 92.1% had been pregnant. For women who had been pregnant (n=12738): 56.5% had at least one birth but no pregnancy loss (miscarriage and/or termination); 39.9% experienced both birth and loss; and 3.6% had a loss only. The lifetime prevalence of infertility was 11.0%. Among women who reported infertility (n=1511), 41.7% used treatment. Women had higher odds of infertility when they had reproductive histories of losses only (OR range 9.0-43.5) or had never been pregnant (OR=15.7, 95%CI 11.8-20.8); and higher odds for treatment: losses only (OR range 2.5-9.8); or never pregnant (1.96, 1.28-3.00). Women who delayed their first birth until aged 30+ years had higher odds of treatment (OR range 3.2-4.3). CONCLUSIONS: About one in ten women experienced infertility and almost half used some form of treatment, especially those attempting pregnancy after 1980. Older first time mothers had an increased uptake of treatment as assisted reproductive technologies (ART) developed. IMPLICATIONS: This study provided evidence of the early uptake of treatment prior to 1979 when the national register of invasive ART was developed and later uptake prior to 1998 when data on non-invasive ART were first collected.