Towards task shifting? A comparison of the accuracy of acute trauma-radiograph reporting by medical officers and senior radiographers in an african hospital

Towards task shifting? A comparison of the accuracy of acute trauma-radiograph reporting by medical officers and senior radiographers in an african hospital

 

Johan du Plessis¹, Richard Pitcher^1,&

 

¹Division of Radiodiagnosis, Department of Medical Imaging and Clinical Oncology, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa

 

 

^&Corresponding author
Richard Pitcher, Division of Radiodiagnosis, Department of Medical Imaging and Clinical Oncology, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa

 

 

 

 

Due to the universal shortage of radiologists, medical officers are largely responsible for acute trauma radiograph reporting in public sector healthcare facilities in well-resourced countries [1-3]. The shortage of medical officers in sub-Saharan Africa (SSA), results in most acute trauma radiographs being unreported, particularly in the rural areas [3,4]. Considerable training, commitment and experience is required to achieve acceptable accuracy in trauma-radiograph reporting [5-7]. Fractures of the appendicular skeleton remain the most commonly missed injuries[8-10] and errors in trauma radiograph reporting may have significant clinical impact [11-13]. In the European Union (EU), experienced radiographers with no specific training have been shown to be more accurate than medical officers in reporting trauma radiographs of the appendicular skeleton [14], while EU radiographers who receive additional training can reach accuracies comparable to radiologists [15-18]. There are thus increasing data from high-income countries that radiographers constitute an important potential resource to help address imaging service demands. Some EU countries have already extended the role of specifically trained radiographers to include trauma-radiograph reporting. Furthermore, high-income countries on other continents are exploring this task-shifting option [5,16,19]. In Africa, a shortage of both radiologists and medical officers exacerbates radiological service pressures currently encountered in high-income countries. EU countries in which task shifting for radiographers has already been implemented have 47-110 radiologists per million population [20,21], compared to 0-3 public sector radiologists per million population in SSA countries [22-24]. In addition, EU countries have in excess of 100 medical officers, nurses and midwives per 10,000 population, compared to an average of 11.4 skilled healthcare personnel per 10,000 population in SSA. Africa also manages a disproportionately high percentage of the global burden of trauma, with injuries constituting an important cause of death and disability [ 25-28].

However, there has been very limited published work analysing the potential role of radiographers in addressing Africa's radiological reporting pressures. Although South Africa (SA) is a middle-income country with approximately 7.7 medical practitioners per 10,000 population [29], which is well above the World Health Organisation's benchmark for the minimum medical personnel required for basic health interventions [30], the country has major healthcare challenges. Half of all SA healthcare expenditure and two-thirds of all SA doctors are in the urban private sector, serving approximately 17% of the population. Some parts of rural SA have 14 times fewer doctors than the national average. The provision of healthcare in such areas is thus more comparable to that in low-income countries [ 31]. SA has adopted the District Health System (DHS) for delivery of comprehensive primary health care to its peoples. District Hospitals (DH's) form an integral part of this system and are staffed by medical officers who provide generalist services to in- and outpatients. All DH's have a 24-hour Accident and Emergency unit and are equipped with plain X-ray facilities [32]. Many rural DH's in SA are staffed by relatively junior medical officers on short-term contracts, while these same hospitals have a core of permanent-staff radiographers with many years of clinical experience [33]. A recent study showed that the acute fracture detection rate of experienced SA-trained radiographers with no specific post-graduate training in radiological reporting was comparable to that of EU radiographers with similar experience [34]. However, there has been no study comparing the acute fracture detection rate of SA medical officers with experienced SA radiographers. If experienced SA radiographers are shown to have higher trauma-radiograph reporting accuracy rates than SA medical officers, consideration could be given to additional training for senior SA radiographers, with a view to role extension, or task shifting [35], particularly in the rural areas [33,36,37]. Furthermore, such a finding would have potential implications for other African countries, given the critical shortage of medical officers across the continent [30,31]. Task shifting involves the delegation of tasks from more- to less-specialized health care workers who can competently and safely perform the assigned tasks. As such, it represents a method of strengthening and expanding the health workforce. The WHO recommends that task-shifting be pursued wherever there is evidence that it is safe and cost-effective, with quality of care and patient safety being the guiding principles [35]. The aim of this study was therefore to compare the accuracy of acute trauma-radiograph reporting by medical officers and senior radiographers in an African setting.

 

 

The study was undertaken from November 2013 through April 2014 in the Trauma and Emergency Unit of a 1386-bed public-sector hospital in the Western Cape Province of South Africa. Nine (n = 9) permanent-staff, SA-trained, public sector radiographers with more than ten years of clinical experience, and eight (n = 8) SA-trained, public sector medical officers employed on short-term contracts in the Trauma and Emergency Unit were recruited and reported the same set of forty (n = 40) digital trauma radiographs of the appendicular skeleton. Study radiographs were selected following a customized search of the Trauma and Emergency Unit's picture archive and communication system (PACS) and were representative of the Unit's appendicular skeleton plain-film imaging profile. Examinations with and without fractures were included. Thirty adult (n = 30) and ten (n = 10) paediatric images, including ten normal radiographs were selected. The consensus report of three consultant radiologists served as the reference standard for fracture identification. Participants were blinded to clinical details other than the history of recent trauma. All images were reported from a standard diagnostic-quality radiology workstation. Thirty seconds were allowed for the evaluation of each image, consistent with the “Rapid Reporting” component of the final Fellowship Examination of the College of Radiologists of the Colleges of Medicine of South Africa at the time. Participants were simply required to assess the presence or absence of a fracture. Data were collected on a customized MS Excel spreadsheet and analysed using Statistica v. 12 (2014). For each image, individual responses were stratified as true positive (TP), true negative (TN), false positive (FP) or false negative (FN). Overall accuracy, sensitivity and specificity were calculated for the two groups and expressed by means and standard deviations. Non-parametric T-tests were used to compare the two groups, with a 5% significance level. Sub-analyses were conducted for adult and paediatric patients. Ethics statement: the study was approved by the Health Research Ethics Committee of the Faculty of Medicine and Health Sciences of Stellenbosch University (Ref:S13/05/105) and the CEO of the public-sector hospital. Written, informed consent was obtained from all participants. Anonymity of individual results was assured through the assignment of unique study numbers.

 

 

All the participating public sector medical officers had less than three years of post-registration clinical experience. Experienced radiographers achieved significantly higher overall accuracy in acute appendicular skeleton fracture reporting (81.5% vs 67.8%, p = 0.002) (Table 1). The superior radiographer performance was a reflection of significantly higher sensitivity (86.3% vs 68.7%, p = 0.003), since the groups demonstrated similar specificity (65%, p = 0.942). Sub-analyses by patient age showed that radiographers achieved higher sensitivity in both adult (87.7% vs 66.8%, p = 0.002) and paediatric (83.3% vs 72.5%) reporting, although the latter did not achieve statistical significance (p = 0.167), due to the small paediatric sample size (n = 10). There was no significant difference in the specificity of the groups, although medical officers showed higher specificity in paediatric reporting.

 

 

To the best of our knowledge, this is the first study of its kind on the African continent. The results are strikingly similar to those from EU countries over the past two decades [14-18]. Experienced radiographers with no additional training in plain-film reporting have been shown to perform significantly better than junior doctors, consistently achieving above 80% overall accuracy in acute fracture detection. The fact that these findings have now been mirrored in an African setting has important ramifications for healthcare planning on the continent. These data can serve as a stimulus for further work in the domain of diagnostic imaging in Africa, since basic imaging is increasingly being viewed as an essential component of health care [3,4]. Currently, there is a critical shortage of healthcare workers globally, and the demand is increasing, driven by population growth, longer life expectancy, a rise in chronic disease, the HIV pandemic and technological advances in healthcare [30]. It is estimated that at least 7.2 million additional skilled health workers are currently required to meet the WHO standard of 22.8 doctors, nurses and midwives per 10,000 population, for provision of basic health interventions globally. It is anticipated that this figure will reach 12.9 million in the next two decades [38,39]. The shortage is most acute in SSA, which has 24% of the world's disease burden, 10% of the world's population, 3% of the world's healthcare workers and less than 1% of world health expenditure [40]. Thirty-one African countries do not meet the UN target of 22.8 doctors, nurses and midwives per 10,000 population [38,39]. There is an urgent need for nations to embark on medium- and long-term health workforce planning [38,39]. Such planning requires accurate data and should integrate all cadres of health worker [41]. Task shifting should be an integral part of this planning. It should not be seen as an emergency response to health worker shortages, but rather as a dynamic process that constantly assesses whether tasks within the job description of highly trained but scarce personnel can be performed by personnel that are in greater supply, but have either less training or narrowly focussed training [30].

 

There is also growing realisation that some form of task shifting will be required at many levels of healthcare in the future, to facilitate more equitable access to services. The implementation of task shifting requires careful planning and inter-disciplinary professional collaboration, to ensure quality of care and sustainability [42]. Many countries have not fully considered how task shifting could affect the number and mix of health workers. Furthermore, many countries have professional regulations that prohibit the most productive and efficient use of health workers [43]. It is against this background that the findings of this study are considered particularly important. While radiographers in our study achieved reporting accuracies in excess of 80%, it is accepted that 95% accuracy is required for clinical practice [15]. On the strength of our findings, consideration should be given to a pilot project training a select group of experienced SA radiographers for plain-film trauma reporting, according to EU guidelines [44,45]. Should reporting accuracies of 95% or higher be achieved, task shifting for such radiographers would be justified. The initial successful training of even a small number of experienced, rural-based SA radiographers has the potential to improve the country's existing trauma-radiograph reporting infrastructure. The findings of such a pilot project could inform further work in other African countries. Our small sample size limited statistical power and may have masked significant differences in the paediatric group. Sample size also precluded analysis by body part. Additionally, this study could not be conducted in the clinical domain, since reporting is not included in the scope of practice of SA radiographers. By precluding clinical correlation with radiological findings, study design may have negatively impacted overall accuracy and contributed to relatively low specificity (true negatives) in both groups. Similarly, the 30 second time-limit imposed for reporting may have decreased overall reporting accuracy, since the clinical domain has no such time constraints. Our finding that junior SA medical officers achieved only 67.8% accuracy for trauma radiograph reporting highlights just how difficult such reporting can be and underscores the training and experience required to achieve competence in this area of practice [5-7]. Of note, UK Casualty Officers achieved just 57.0% accuracy in a similar study [14]. Our results suggest that undergraduate radiology training in SA should be re-evaluated in an attempt to better equip medical graduates for accident and emergency unit clinical responsibilities in the first years of medical practice. We have also identified a need amongst recently qualified SA doctors for continuous professional development in plain X-ray interpretation.

 

 

It is hoped that this study will serve as a stimulus for further critical evaluation of the role senior radiographers in the provision of healthcare in Africa. We have shown that senior SA radiographers represent a potentially important resource for acute trauma-radiograph reporting in the public healthcare sector and recommend a pilot project, training a select group of such radiographers for plain-film trauma reporting. The results of such a project could inform further work in other parts of Africa. Furthermore, accurate data on the number and distribution of radiographers in African countries is required to facilitate future health workforce planning.

 

 

The authors declare's they have no conflict of interests.

 

 

Both authors contributed to the conception and planning of the study. Johan du Plessis recruited study participants, collated the study radiographs, collected the data and analysed results. Both authors contributed to preparation of the final manuscript.

 

 

The authors are grateful to Dr Anne-Marie du Plessis, Ms Debbie Purdy and Mr Wandile Guma for assistance in collation and presentation of the study radiographs, to Drs Razaan Davis, Tharbit Hartley and Francois Roux for the consultant reporting of the study radiographs, and to Dr Justin Harvey for conducting the statistical analysis.

 

 

Table 1: statistical comparison

 

 

1. Pitman AG, Jones DN. Radiologist workloads in teaching hospital departments: measuring the workload. Australas Radiol. 2006;50(1):12-20. PubMed | Google Scholar


2. Brady AP. Measuring Consultant Radiologist workload: method and results from a national survey. Insights Imaging. 2011;2(3):247-60. PubMed | Google Scholar


3. Mullora DJ, Lungren MP. Eds Radiology in Global Health. Springer-Verlag. New York. ISBN-13 978-1-4614-0603-7. PubMed | Google Scholar


4. Kawooya MG. Training for rural radiology and imaging in sub-Saharan Africa: addressing the mismatch between services and population. J Clin Imaging Sci. 2012;2:37. PubMed | Google Scholar


5. Gatt ME, Spectre G, Paltiel O, Hiller N, Stalnikowicz R. Chest radiographs in the emergency department: is the radiologist really necessary?. Postgrad Med J. 2003;79(930):214-7. PubMed | Google Scholar


6. De Lacey G, Barker A, Harper J, Wignall B. An assessment of the clinical effects of reporting accident and emergency radiographs. Br J Radiol. 1980;53(628):304-9. PubMed | Google Scholar


7. Mayhue FE, Rust DR, Aldag JC, Jenkins AM, Ruthman JC. Accuracy of interpretations of emergency department radiographs: effect of confidence levels. Ann Emerg Med. 1989;18(8):826-30. PubMed | Google Scholar


8. Ha AS, Porrino JA, Chew FS. Radiographic Pitfalls in Lower Extremity Trauma. Am J Roentgenol. 2014;203(3):492-500. PubMed | Google Scholar


9. Whang JS, Baker SR, Patel R, Luk L, Castro A. The causes of medical malpractice suits against radiologists in the United States. Radiology. 2013;266(2):548-54. PubMed | Google Scholar


10. Donald JJ, Barnard SA. Common patterns in 558 diagnostic radiology errors. J Med Imaging Radiat Oncol. 2012;56(2):173-8. PubMed | Google Scholar


11. McLauchlan CAJ, Jones K, Guly HR. Interpretation of trauma radiographs by junior doctors in accident and emergency departments: a cause for concern?. J Accid Emerg Med. 1997;14(5):295-8. PubMed | Google Scholar


12. Harrison W, Newton AW, Cheung G. The litigation cost of negligent scaphoid fracture management. Eur J Emerg Med. 2015;22(2):142-3. PubMed | Google Scholar


13. Ahrberg AB, Leimcke B, Tiemann AH, Josten C, Fakler JK. Missed foot fractures in polytrauma patients: a retrospective cohort study. Patient Saf Surg 2014;25;8(1):10. Google Scholar


14. Coleman L, Piper K. Radiographic interpretation of the appendicular skeleton: a comparison between casualty officers, nurse practitioners and radiographers. Radiography .2009;15(3):196-202. PubMed | Google Scholar


15. Loughran CF. Reporting of fracture radiographs by radiographers: the impact of a training program. Br J Radiol. 1994;67(802):945-950. PubMed | Google Scholar


16. Brealey S, Scally A, Hahn S, Thomas N, Godfreya C, Coomarasamy A. Accuracy of radiographer plain radiograph reporting in clinical practice: a meta-analysis. Clin Radiol. 2005;60(2):232-41. PubMed | Google Scholar


17. Piper KJ, Paterson AM, Godfrey RC. Accuracy of radiographers? reports in the interpretation of radiographic examinations of the skeletal system: a review of 6796 cases. Radiography. 2005;11(1):27-34. PubMed | Google Scholar


18. Buskov L, Abild A, Christensen A, Holm O, Hansen C, Christensen H. Radiographers and trainee radiologists reporting accident radiographs: a comparative plain film-reading performance study. Clin Rad. 2013;68(1):55-8. PubMed | Google Scholar


19. Brown N, Leschke P. Evaluating the true clinical utility of the red dot system in radiograph interpretation.JMed Imaging Radiat Oncol. 2012;56(5):510-3. PubMed | Google Scholar


20. Richard Fowler. The bigger picture in radiology. (http://m.hsj.co.uk/5053658.article). Accessed 29 April 2015. Google Scholar


21. The Royal Australian and New Zealand College of Radiologists. 2010. Workforce Report. http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=10&ved=0CG4QFjAJ&url=http://www.ranzcr.edu.aucomponentdocmandoc_download718-2010-radiology-workforce-survey-report&ei=xnTgVNq9Cou5UZ2zg4gH&usg=AFQjCNGCKV04VqGwTgE0GsbVCwMkexVlHA&bvm=bv.85970519,d.d2. Accessed 29 April 2015. Google Scholar


22. Radiological Society of South Africa. Personal Communication. Google Scholar


23. Monu JU, Muyinda Z, Taljanovic M. ISS outreach sub-Saharan Africa insight: Uganda 2011. Skeletal Radiol. 2012;41(11):1347-8. PubMed | Google Scholar


24. Monu JU, Kopakopa D, Taljanovic M. ISS outreach Sub-Saharan Africa: Zambia 2011. Skeletal Radiol. 2012;41(12):1493-4. PubMed | Google Scholar


25. Tyson AF, Varela C, Cairns BA, Charles AG. Hospital Mortality Following Trauma: an Analysis of a Hospital-Based Injury Surveillance Registry in sub-Saharan Africa. J Surg Educ. 2015;72(4):e66-72. PubMed | Google Scholar


26. Wong EG, Gupta S, Deckelbaum DL, Razek T, Kushner AL. Prioritizing injury care: a review of trauma capacity in low and middle-income countries. J Surg Res. 2015;193(1):217-22. PubMed | Google Scholar


27. Barbiero VK. Urban health: it's time to get moving!. Glob Health Sci Pract. 2014; 13;2(2):139-44. PubMed | Google Scholar


28. Norman R, Matzopoulo R, Groenewald P, Bradshaw D. The high burden of injuries in South Africa. Bull World Health Organ. 2007;85(9):695-702. PubMed | Google Scholar


29. World Health Organization. Country statistics. South Africa. Available: (http://www.who.int/countries/zaf/en/.) Accessed 29 April 2015. PubMed | Google Scholar


30. World Health Organization. 2006. The World Health Report 2006?Working Together for Health. Geneva: World Health Organization. [http://www.who.int/whr/2006/en.]. PubMed | Google Scholar


31. O'Brien P, Gostin LO. Health worker shortage and global justice. Milbank Memorial Fund. Google Scholar


32. Department of Health. A District Hospital Service Package for South Africa: a set of norms and standards. Pretoria. March 2002. Google Scholar


33. Gqweta N. Role extension: the needs, perceptions and experiences of South African radiographers in primary health care. The South African Radiographer. 2012;50(1):22-26. PubMed | Google Scholar


34. Hlongwane S, Pitcher R. Accuracy of“red-dot”after-hour trauma radiography triage by radiographers in a South African regional hospital. S Afr Med J. 2013;103(9):638-640. PubMed | Google Scholar


35. World Health Organization 2008. Task shifting: rational redistribution of tasks among health workforce teams. global recommendations and guidelines. Google Scholar


36. Williams I. Professional role extension for radiographers. The South African Radiographer. 2006;44(2):14-17. PubMed | Google Scholar


37. Williams I. Reporting trauma and emergency plain film radiographs: radiologists? support for role extension in South African radiographers. The South African Radiographer. 2009;47(1):15-17. PubMed | Google Scholar


38. World Health Organization 2014. Human Resources for Health: Foundation for Universal Health Coverage and the post-2015 development agenda. Global Health Workforce Alliance. Report of the Third Global Forum on Human Resources for Health. ISBN 978 92 4 150739 4. Google Scholar


39. World Health Organization 2014. Global Health Workforce Alliance. A Universal Truth: No Health without a Workforce. ISBN 978 92 4 150676 2. PubMed | Google Scholar


40. World Health Organization 2013. World Health Statistics. ISBN 978 92 4 156458 8. Google Scholar


41. International Council of Nurses 2006. The global nursing shortage. Priority areas for intervention. ISBN: 92-95040-57-0. PubMed | Google Scholar


42. Fulton BD, Scheffler RM, Sparkes SP, Auh EY, Vujicic M, Soucat A. Health workforce skill mix and task shifting in low income countries: a review of recent evidence. Hum Resour Health. 2011;9:1. PubMed | Google Scholar


43. Moore A, Morrison SJ. Health Worker shortages challenge PEPFAR options for strengthening Health Systems. A Report of the Task Force on HIV/AIDS. Center for Strategic and International Studies 2007. Google Scholar


44. Society of Radiographers. Preliminary Clinical Evaluation and Clinical Reporting by Radiographers: Policy and Practice Guidance. Society of Radiographers 2013. Google Scholar


45. Canterbury Christ Church University. School of Allied Health Professions. MSc Clinical Reporting. Google Scholar