Factors associated with undertriage and overtriage in telephone triage in Danish out-of-hours primary care: a natural quasi-experimental cross-sectional study of randomly selected and high-risk calls.

OBJECTIVES: We aim to explore undertriage and overtriage in a high-risk patient population and explore patient characteristics and call characteristics associated with undertriage and overtriage in both randomly selected and in high-risk telephone calls to out-of-hours primary care (OOH-PC). DESIGN: Natural quasi-experimental cross-sectional study. SETTING: Two Danish OOH-PC services using different telephone triage models: a general practitioner cooperative with GP-led triage and the medical helpline 1813 with computerised decision support system-guided nurse-led triage. PARTICIPANTS: We included audio-recorded telephone triage calls from 2016: 806 random calls and 405 high-risk calls (defined as patients ≥30 years calling with abdominal pain). MAIN OUTCOME MEASURES: Twenty-four experienced physicians used a validated assessment tool to assess the accuracy of triage. We calculated the relative risk (RR) for clinically relevant undertriage and overtriage for a range of patient characteristics and call characteristics. RESULTS: We included 806 randomly selected calls (44 clinically relevant undertriaged and 54 clinically relevant overtriaged) and 405 high-risk calls (32 undertriaged and 24 overtriaged). In high-risk calls, nurse-led triage was associated with significantly less undertriage (RR: 0.47, 95% CI 0.23 to 0.97) and more overtriage (RR: 3.93, 95% CI 1.50 to 10.33) compared with GP-led triage. In high-risk calls, the risk of undertriage was significantly higher for calls during nighttime (RR: 2.1, 95% CI 1.05 to 4.07). Undertriage tended to be more likely for calls concerning patients ≥60 years compared with 30-59 years (11.3% vs 6.3%) in high-risk calls. However, this result was not significant. CONCLUSION: Nurse-led triage was associated with less undertriage and more overtriage compared with GP-led triage in high-risk calls. This study may suggest that to minimise undertriage, the triage professionals should pay extra attention when a call occurs during nighttime or concerns elderly. However, this needs confirmation in future studies.

Does an emergency access button increase the patients' satisfaction and feeling of safety with the out-of-hours health services? A randomised controlled trial in Denmark.

OBJECTIVE: To investigate if the option to bypass the telephone queue can increase satisfaction and feeling of safety in callers. DESIGN: Randomised controlled parallel superiority trial. Data from questionnaire survey. SETTING: Two out-of-hours (OOH) services in Denmark. PARTICIPANTS: 217 510 citizens who called the OOH services between 4 September 2017 and 30 November 2017. RANDOMISATION: Two-faze study period: First half with randomisation of participants based on their date of birth; even date randomised to intervention, uneven date randomised to control group. Second half with all participants included in intervention group. INTERVENTION: Providing randomised callers (intervention group n=146 355) with the option to bypass the telephone waiting line through an emergency access button (EAB), while the rest got the normal service (control group n=71 155). All EAB users were invited to a questionnaire survey as well as random participants who did not use the EAB (of whom approximately 50% did not have the EAB option). MAIN OUTCOME MEASURES: Satisfaction and feeling of safety in callers. RESULTS: 2208 of 6704 (32.9%) invited callers answered the questionnaire (intervention group n=1415 (users n=621, non-users n=794); control group n=793). The OR for answering in the two categories with highest satisfaction when provided with the EAB option was 1.34 (95% CI 1.07 to 1.68) for satisfaction with the waiting time, 1.21 (95% CI 0.91 to 1.60) for overall satisfaction and 1.46 (95% CI 1.12 to 1.89) for feeling of safety. Approximately 72% (441/621) of EAB users reported that the EAB option increased their feeling of safety with the OOH services 'to a high degree' compared with 25% (197/794) of callers who had the EAB option without using it. CONCLUSIONS: The EAB can provide fast access to OOH telephone advice in case of severe illness. It favours citizens perceived in most need of urgent healthcare and significantly increases both feeling of safety and patient satisfaction. TRIAL REGISTRATION DETAILS: NCT02572115 (5 October 2015).

Safety, efficiency and health-related quality of telephone triage conducted by general practitioners, nurses, or physicians in out-of-hours primary care: a quasi-experimental study using the Assessment of Quality in Telephone Triage (AQTT) to assess audio-recorded telephone calls.

BACKGROUND: To explore and compare safety, efficiency, and health-related quality of telephone triage in out-of-hours primary care (OOH-PC) services performed by general practitioners (GPs), nurses using a computerised decision support system (CDSS), or physicians with different medical specialities. METHODS: Natural quasi-experimental cross-sectional study conducted in November and December 2016. We randomly selected 1294 audio-recorded telephone triage calls from two Danish OOH-PC services triaged by GPs (n = 423), nurses using CDSS (n = 430), or physicians with different medical specialities (n = 441). An assessment panel of 24 physicians used a validated assessment tool (Assessment of Quality in Telephone Triage - AQTT) to assess all telephone triage calls and measured health-related quality, safety, and efficiency of triage. RESULTS: The relative risk (RR) of poor quality was significantly lower for nurses compared to GPs in four out of ten items regarding identifying and uncovering of problems. For most items, the quality tended to be lowest for physicians with different medical specialities. Compared to calls triaged by GPs (reference), the risk of clinically relevant undertriage was significantly lower for nurses, while physicians with different medical specialties had a similar risk (GP: 7.3%, nurse: 3.7%, physician: 6.1%). The risk of clinically relevant overtriage was significantly higher for nurses (9.1%) and physicians with different medical specialities (8.2%) compared to GPs (4.3%). GPs had significantly shorter calls (mean: 2 min 57 s, SD: 105 s) than nurses (mean: 4 min 44 s, SD: 168 s). CONCLUSIONS: Our explorative study indicated that nurses using CDSS performed better than GPs in telephone triage on a large number of health-related items, had a lower level of clinically relevant undertriage, but were perceived less efficient. Calls triaged by physicians with different medical specialities were perceived less safe and less efficient compared to GPs. Differences in the organisation of telephone triage may influence the distribution of workload in primary and secondary OOH services. Future research could compare the long-term outcomes following a telephone call to OOH-PC related to safety and efficiency.

Do callers to out-of-hours care misuse an option to jump the phone queue?

Objectives: Out-of-hours (OOH) services provide access to healthcare outside normal office hours, but the waiting time can sometimes be long. All callers must wait in the telephone queue, even if the health problem is urgent or life-threatening. We tested an emergency access button (EAB), which allowed callers with perceived severe health problems to bypass the queue. We aimed to investigate the severity of the health problems and the relevance of EAB use (assessed by triage professionals). Additionally, we aimed to calculate the number of suspected acute myocardial infarctions (AMI) and ambulance dispatches. Design: Descriptive study of a randomized intervention. Setting: OOH services in two major Danish healthcare regions. Subjects: 217,510 callers participated; 146,355 were randomized to intervention, and 6554 of 6631 (98.8%) questionnaires were completed by OOH triage professionals. Intervention: An EAB allowing randomly selected callers to bypass the telephone queue. Main outcome measures: Severity of contact and relevance of EAB use. Number of suspected AMIs and ambulance dispatches. Results: In both settings, contacts with EAB use concerned significantly more severe health problems than contacts without EAB use (p < 0.001). Triage professionals rated EAB use as "not relevant" in 23% of cases. Significantly more EAB users (10.4%) than EAB non-users (3.3% with EAB option and 1.7% without EAB option, p < 0.001) had a suspected AMI. Conclusions: We found higher proportions of severe health problems, suspected AMIs, and ambulance dispatches among EAB users. Only 23% of EAB use was rated "not relevant". This suggests that the EAB is used as intended. Key points Out-of-hours healthcare is challenged by increasing demand and long triage waiting times. An emergency access button may allow severely ill callers to jump the queue. Callers who bypassed the queue were more severely ill than callers who did not bypass the queue. Only 23% of bypassers presented "not relevant" health problems according to the triage staff.Trial registration: Identifier NCT02572115 registered at Clinicaltrials.gov on 5 October 2015.

Giving callers the option to bypass the telephone waiting line in out-of-hours services: a comparative intervention study.

OBJECTIVE: Acute out-of-hours (OOH) healthcare is challenged by potentially long waiting time for callers in acute need of medical aid. OOH callers must usually wait in line, even when contacting for highly urgent or life-threatening conditions. We tested an emergency access button (EAB), which allowed OOH callers to bypass the waiting line if they perceived their health problem as severe. We aimed to investigate EAB use and patient characteristics associated with this use. DESIGN: Comparative intervention study. SETTING: OOH services in two major Danish healthcare regions. INTERVENTION: Giving callers the option to bypass the telephone waiting line by introducing an EAB. PARTICIPANTS: OOH service callers contacting during end of October to mid-December 2017. MAIN OUTCOME MEASURES: Proportions of EAB use, waiting time and background information on participants in two settings differing on organisation structure, waiting time and triage personnel. RESULTS: In total, 97,791 out of 158,784 callers (61.6%) chose to participate. The EAB was used 2905 times out of 97,791 (2.97%, 95%CI 2.86; 3.08). Patient characteristics associated with increased EAB use were male gender, higher age, low education, being retired, and increasing announced estimated waiting time. In one region, immigrants used the EAB more often than native Danish callers. CONCLUSION: Only about 3% of all callers chose to bypass the waiting line in the OOH service when given the option. This study suggests that the EAB could serve as a new and simple tool to reduce the waiting time for severely ill patients in an OOH service telephone triage setting. Key Points Acute out-of-hours healthcare is challenged by overcrowding and increasing demand for services. This study shows that only approximately 3% of callers chose to bypass the telephone waiting queue when given the opportunity through an emergency access button. An emergency access button may serve as a new tool to help reduce the triage waiting time for severely ill patients in out-of-hours medical facilities.

Quality of out-of-hours telephone triage by general practitioners and nurses: development and testing of the AQTT - an assessment tool measuring communication, patient safety and efficiency.

OBJECTIVE: To develop a valid and reliable assessment tool able to measure quality of communication, patient safety and efficiency in out-of-hours (OOH) telephone triage conducted by both general practitioners (GP) and nurses. DESIGN: The Dutch KERNset tool was translated into Danish and supplemented with items from other existing tools. Face validity, content validity and applicability in OOH telephone triage (OOH-TT) were secured through a two-round Delphi process involving relevant stakeholders. Forty-eight OOH patient contacts were assessed by 24 assessors in test-retest and inter-rater designs. SETTING: OOH-TT services in Denmark conducted by GPs, nurses or doctors with varying medical specialisation. PATIENTS: Audio-recorded OOH patient contacts. MAIN OUTCOME MEASURES: Test-retest and inter-rater reliability were analysed using ICCagreement, Fleiss' kappa and percent agreement. RESULTS: Major adaptations during the Delphi process were made. The 24-item assessment tool (Assessment of Quality in Telephone Triage - AQTT) measured communicative quality, health-related quality and four overall quality aspects. The test-retest ICCagreement reliability was good for the overall quality of communication (0.85), health-related quality (0.83), patient safety (0.81) and efficiency (0.77) and satisfactory when assessing specific aspects. Inter-rater reliability revealed reduced reliability in ICCagreement and in Fleiss' kappa. Percent agreement revealed satisfactory agreements when differentiating between 'poor' and 'sufficient' quality). CONCLUSION: The AQTT demonstrated high face, content and construct validity, satisfactory test-retest reliability, reduced inter-rater reliability, but satisfactory percent agreement when differentiating between 'poor' and 'sufficient' quality. The AQTT was found feasible and clinically relevant for assessing the quality of GP- and nurse-led OOH-TT. KEYPOINTS Comparative knowledge is sparse regarding quality of out-of-hours telephone triage conducted by general practitioners and nurses. The assessment tool (AQTT) enables assessment of quality in OOH telephone triage conducted by nurses and general practitioners AQTT is feasible and clinically relevant for assessment of communication, patient safety and efficiency. AQTT can be used to identify areas for improvement in telephone triage.

Development and evaluation of an "emergency access button" in Danish out-of-hours primary care: a study protocol of a randomized controlled trial.

BACKGROUND: Out-of-hours (OOH) health care for acute medical problems is often challenged by long waiting time for callers in need of advice and triage. Allowing patients to bypass the OOH telephone waiting line may increase patient satisfaction and provide them with a feeling of safety. We aimed to develop an "emergency access button" enabling patients to bypass the normal telephone waiting line in out-of-hours primary care (OOH-PC) if they perceive their condition to be critical and to evaluate the effect of introducing the button in terms of patient satisfaction and their feeling of safety. METHODS: All patients calling the OOH-PC in two different Danish health care regions during three months will be included in this randomized controlled trial. Data will be collected through two questionnaires developed for this study: a pop-up questionnaire on the relevance of bypassing the normal waiting line to be completed by triage professionals after patient contact and a paper/electronic questionnaire on perceived safety and satisfaction with the emergency access button to be completed by the callers. These questionnaires were developed and validated using external and internal expert feedback, focus group interviews and a two-week field test. The study will be conducted over three months with an estimated user-rate of the emergency access button of 3%. DISCUSSION: We have developed an emergency access button and we now want to investigate whether this new option will influence upon the level of satisfaction and the feeling of safety in the calling patients. Additionally, the study will reveal the assessed relevance of the decision to bypass the line by triage professionals. TRIAL REGISTRATION: Registered as NCT02572115 at Clinicaltrials.gov on October 5th 2015.

[Practice assistant sometimes misses urgent request for help: telephone triage in general practice]. / Doktersassistent mist soms hoogurgente hulpvraag.

OBJECTIVE: To assess the organisation and appropriateness of telephone triage in general practices in the Netherlands. DESIGN: Cross-sectional observational study. METHODS: Via e-mail we invited all members of the Dutch Association of practice assistants to complete an online survey. The questionnaire included questions about practice assistants' background characteristics and the practices' triage organisation. Furthermore, they were asked to assess the indicated type of care for a number of fictive case scenarios involving a variety of health problems and levels of urgency. To determine the appropriateness of the respondents' assessments, each was compared to a reference standard agreed by experts. In addition, the association between practice assistants' background characteristics and organizational setup of the triage organisation with the appropriateness of triage was examined. RESULTS: The response rate was 41.1% (N=973). The required care was assessed appropriately in 63.6% of the cases, over-estimated in 19.3% and under-estimated in 17.1% of cases. The sensitivity of identifying patients with a highly urgent problem was 76.7%, whereas the specificity was 94.0%. The appropriateness of the assessments of the required care was higher for more experienced assistants and assistants with regular daily work meetings with the GP. Triage training, use of a triage tool and authorization of advice provision were not associated with appropriateness of triage. CONCLUSION: Triage by practice assistants in general practices is efficient, but potentially unsafe in highly urgent cases. It is therefore important to train practice assistants in the identification of highly urgent cases.

Agreement on urgency assessment between secretaries and general practitioners: an observational study in out-of-hours general practice service in Belgium.

BACKGROUND: In some European countries telephone triage (TT) during out-of-hours primary care showed to be safe and effective. Other countries, such as Belgium, may not have trained auxiliary personnel while their national health services want to establish TT. OBJECTIVES: To compare urgency levels assessed by secretaries and general practitioners in one general practice cooperative in Belgium. METHODS: Percentage of correct-, under-, and over-triage were calculated in total and per reason for encounter. Inter-rater agreement was investigated. RESULTS: The secretaries correctly triaged (same urgency level) 77% of the telephone calls, under-triaged 10% and over-triaged 13%.'Shortness of breath', 'skin cuts', 'chest pain', 'feeling unwell' and 'syncope' were often under-triaged. CONCLUSION: Before introducing TT, auxiliary staff should be trained and protocols should be used.

Nurse telephone triage: good quality associated with appropriate decisions.

BACKGROUND: Triage at out-of-hours GP cooperatives (GPCs) is aimed at determining medical urgency and guiding decisions. Both medical knowledge and communication skills are required for this complex task. OBJECTIVE: To explore the impact of quality of consultation and estimated urgency on the appropriateness of decisions. METHODS: We performed a secondary analysis of telephone triage consultations by nurses at 29 Dutch GPCs. Consultations were taped and assessed by trained observers, using a validated instrument. Measures concerned quality of consultation, nurse-estimated urgency (four levels) and appropriateness of decisions (urgency, follow-up advice and timing). Bivariate analyses and logistic multilevel regression analyses were used to explore the impact of quality of consultation (controlling for urgency) on appropriateness of decisions. RESULTS: The sample included 6739 telephone contacts, most of which (90%) were non-urgent. The majority of decisions were appropriate (91% for urgency, 96% for follow-up advice and 95% for timing). In bivariate analyses, appropriateness of decisions was positively related to higher quality of consultation. Estimated urgency was negatively associated with quality of consultation. Logistic multilevel analysis showed that higher quality of consultation was related to a more appropriate estimation of urgency [odds ratio (OR) = 1.82; 95% confidence interval (CI): 1.69-1.95], follow-up advice (OR = 2.69; 95% CI: 2.41-3.01) and timing of decisions (OR = 2.41; 95% CI: 2.20-2.63). CONCLUSIONS: High quality of consultation has a positive, but small, impact on the appropriateness of decisions. Quality of consultation needs to be targeted in training and support of triage nurses, especially when it concerns highly urgent contacts.