Application of Pediatric Index of Mortality version 2: score in pediatric intensive care unit in an African developing country
Application of pediatric index of mortality version 2: score in pediatric intensive care unit in an African developing country
Osama El Sayed Mohamed Bekhit1,&, AlKassem Ahmed Algameel1, Hanaa Hasan Eldash1
1Pediatrics Department, Faculty of Medicine, Al Fayoum University, Al Fayoum, Egypt
Osama El Sayed Mohamed Bekhit, Pediatrics Department, Faculty of Medicine, Al Fayoum University, Al Fayoum, Egypt
Introduction: Outcome of patients admitted to PICU can be evaluated by many illness severity scoring systems. This prospective observational study evaluated the outcome of patients admitted to PICU in Fayoum University hospital of a developing country using the pediatric index of mortality version 2 scoring system.
Methods: All patients included in this study were subjected to data collection including demographics, diagnoses at admission, duration of ICU stay (DOS), pediatric index of mortality version 2 (PIM2) score and hospital outcome. The ratio of observed to predicted mortality (standardized mortality ratio (SMR)) was calculated for the set of patients.
Results: The study included 205 patients. The main causes of admission were respiratory, cardiovascular and neurological illnesses. Patients stay in ICU ranged from 1 - 45 days with a median 6 (interquartile range (IQ): 3-9) days. Discriminatory function of PIM2 scoring system was acceptable with the area under the ROC curve 0.76 (95%CI: 0.60-0.91). PIM2 calibrated well using Hosmer Lemeshow analysis (H-L X2= 1.410, df= 8, p=0.9). The mean predicted mortality was 5.6 (95% CI: 3.43 - 7.91) and the observed mortality was 8.8% giving a SMR 1.55.
Conclusion: PIM2 scoring system show adequate discriminatory function and well calibrated for the case mix of patients in PICU of Fayoum, Egypt. It can be used as beneficial tool for evaluation of risk adjusted mortality. Further larger scale studies in cooperation with other Egyptian universities and neighboring countries can improve the performance of our PICUs and critical care services.
Mortality reduction is the fundamental aim of a pediatric intensive care unit (PICU). A physician's accuracy in estimating mortality risk for patients admitted to intensive care unit is largely subjective . Scoring systems are used to predict the outcome of patients admitted to intensive care units . Moreover they are used to evaluate the performance of ICUs . Pediatric risk of mortality III is one of the principal scores used in PICUs throughout the world . Because of the large differences in case mix, comparing the mortality among different units and countries must be corrected for the severity of illness on admission to the ICU and severity scoring systems have proved valuable for quality assurance and research in intensive care medicine .
Pediatric Index of Mortality 2 scoring system is the updated version of PIM introduced by Shann et al in 1997, with better outcome predictability. The score analyze the condition of the patient directly upon arrival in PICU, i.e the condition the least affected by any therapeutic interventions. This differs from other scoring systems, which could be applied at different time intervals throughout the ICU stay . Comparison of intensive care outcomes at different regions is important because the employment of resources varies considerably in different countries especially the developing ones . Pediatric index of mortality version 2 (PIM2) scoring system was validated in different regions including developed and developing countries, however reports about its application in our region are lacking.
The objective of this prospective study was to determine the performance of PIM2 score in Fayoum University Hospital pediatric ICU, to assess the quality of critical care services in our unit and to compare it with the international reports.
Fayoum university Hospital is a tertiary care center that serves Fayoum Governorate with a 2000000 population. Pediatric ICU is a four bed unit. A resident and a senior registrar are in duty around the clock under supervision of a consultant. The nurse patient ratio is 1:1. The unit receives cases from general ward and emergency department including different medical specialties.
The ethical committee of Faculty of Medicine, Fayoum University approved the study. All consecutive admissions from May 2010 to June 2011 were included. Patients with a PICU stay less than 2 hours and those transferred to other PICU are excluded from the study.
Age, gender, diagnosis at the time of admission, duration of PICU stay and outcome (survived / death) were recorded in a data collection form devised for the study. PIM2 scoring system was applied on the day of admission before any therapeutic intervention was undertaken. The regression equation published with PIM2 scoring system was used to calculate the predicted mortality .
Data was summarized using mean and standard deviation or median and percentiles for quantitative variables and frequency and percentage for qualitative variables. Comparison between groups was done using Mann Whitney U-test for quantitative variables and chi square test or Fisher's exact test for qualitative variables.
Hosmer-Lemeshow goodness-of-fit analysis was done to calibrate the scoring system. Receiver Operating Characteristic curve (ROC) analysis was done to analyze the discriminant function of the system. Standardized Mortality Ratio (SMR) (the ratio of observed mortality to the predicted mortality) was obtained for the case mix. The statistical significance was fixed at p<0.05 level. Statistical analyses were done using the Statistical Package for Social Sciences (SPSS), (version 15).
During the period of the study 205 patients were admitted to the PICU. Of the 205 patients, 105(51.2%) were males and 100(48.8%) were females. The age of the patients ranged from 1 - 168 months, with a median 14 (interquartile range (IQ): 7-30) months. Patients stay in PICU ranged from 1 - 45 day with a median 6 (IQ 3 - 9) days. Respiratory illnesses such as pneumonia, bronchiolitis and status asthmaticus were the most common diagnoses among admitted patients followed by cardiovascular and neurological diseases. Figure 1 shows the percentage of diagnostic categories on admission to PICU. The predicted mortality by PIM2 score ranged from 0.03% - 96.5% with a mean 5.67% (95% CI: 3.43 - 7.91). The observed mortality rate was 8.8%, the SMR being 1.55. Table 1 shows age, gender, diagnoses on admission, DOS and PIM2 in all patients. Calibration of PIM2 using Hosmer Lemeshow goodness-of-fit-chi square test showed a good calibration of the model to studied patients in our PICU (H-L X2= 1.410 (df=8), p=0.9).
The distribution of risk deciles in the case mix is shown in Table 2. Area under the curve (AUC) of the ROC curve for PIM2 scoring system was 0.75 (95% CI: 0.60 - 0.91), P <0.001. Figure 2 shows the ROC curve for PIM2.
Improvement of pediatric critical care service can be achieved by strict quality control to identify groups at high risk of death and provide adequate treatment with rational use of resources .
The main finding of the present study is good performance of PIM2 scoring system in Fayoum University hospital PICU.
Several studies comparing different prognostic models such as PIM, PIM2, PRISM and PRISMIII scoring systems reported good performance of PIM scoring system [5,8,9]. Therefore the updated version of PIM scoring system was used in our unit.
Performance of PIM2 was evaluated by assessing discrimination and calibration. Discrimination estimates the probability of concordance between outcomes and predictions. It is the ability of the model to categorize patients into two outcome groups such as survivors and non-survivors. It is assessed by measuring area under the Receiver Operating Characteristics Curve .
Acceptable discrimination is represented by an area under the curve of >0.7, >0.8 is good and >0.9 is excellent . Several studies reported the AUC for PIM2, in our study AUC was 0.75. In other developing countries such as India  and Barbados  it was 0.81, while in Trinidad it was 0.62 . In developed countries AUC 0.9 was reported from Australia and New Zealand , and 0.87 from Spain .
Calibration of a model measures the correlation between the predicted outcomes and actual outcomes over the entire range of risk prediction. Calibration was assessed by Hosmer and Lemeshow goodmess of fit test . A good calibration is represented by p value >0.1 . Some studies suggested modification of the coefficient of regression equation separately in each country to obtain satisfactory calibration [17,18], while others did not support this suggestion, as this will oppose the purpose of the model  and validation of the PIM2 score in their study had good calibration and discrimination .
Calibration of PIM2 score was reported from different regions of the world. A study from Italy applied PIM2 and found that it calibrate well (X2=4.92, df=8, p=0.26) . Nether Land calibrated the model and found to be acceptable (X2=4.92, df=8, p=0.77) . Also in Spain, the model calibrated well (X2=4.87, df=8, p=0.85) . Studies from developing countries also reported good calibration of PIM2 score, such as a study from Trinidad (X2=5.61, df=8, p=0.69) , and a study from Barbados (X2=5.64, df=7, p=0.58) . In our study PIM2 calibrated well to the case mix of Fayoum, Egypt.
The SMR is valid measure that compare risk adjusted mortality, between different centers, but it may vary according to the case mix and care offered to the patients. Also it can be used to compare different scoring systems applied to the same setting. The SMR was reported to be 0.97 in a study from Australia and New Zealand . Studies from developing countries reported varying SMRs. Studies from Trinidad and Barbados, Caribbean countries reported similar SMRs of 0.86 [11,12], while a study from India reported SMR 1.57 . The SMR of the present study is similar to the SMR reported from India. Although this high SMR may reflect under prediction of mortality by PIM2 score, it should raise the attention of medical care offered to the patients in our developing countries including the primary management in the emergency department, avoidance of delayed referral to PICU from ward and more employment of resources that could upgrade the critical care services.
Outcome evaluation of the critically ill patients is a challenging task that needs plenty of future research work . Quality assessment of an ICU using severity of illness scoring system is controversial as the performance of a unit is multidimensional [22,23].
PIM2 scoring system show adequate discriminatory function and well calibrated for the case mix of patients in PICU of Fayoum, Egypt. It can be used as beneficial tool for evaluation of risk adjusted mortality. Despite this good performance of PIM2 scoring system in Fayoum University PICU, further larger scale studies in cooperation with other universities of Egypt as well as neighboring countries are required for the optimal use of the score within our region.
The authors declare no competing interest.
Osama El Sayed Mohamed Bekhit: conception and design of the study, acquisition of data and writing the manuscript. AlKassem Ahmed Algameel: Participate to the acquisition of data. Hanaa Hasan Eldash: Participate to the acquisition of data.
The authors thank Professor DR Khaled Elkhashab, the dean of faculty of medicine and Professor Dr Mona Farid, the deputy of faculty of medicine, Fayoum University for their continuous support. The authors also thank all the PICU team for their help to accomplish this work.
Table 1: Age, gender, diagnoses on admission, duration of ICU stay and pediatric index of mortality version 2 in all patients
Table 2: The distribution of risk deciles in the case mix
Figure 1: The percentage of diagnostic categories on admission to pediatric intensive care unit
Figure 2: The ROC curve for pediatric index of mortality version 2
|The Pan African Medical Journal articles are archived on Pubmed Central. Access PAMJ archives on PMC here|
Volume 26 (Jan - Apr 2017)
This article authors
|On Google Scholar|
Navigate this article
Tables and figures
|Table 1: Age, gender, diagnoses on admission, duration of ICU stay and pediatric index of mortality version 2 in all patients|
|Table 2: The distribution of risk deciles in the case mix|
|Figure 1: The percentage of diagnostic categories on admission to pediatric intensive care unit|
|Figure 2: The ROC curve for pediatric index of mortality version 2|
Rate this article
Popular articles in Research
|1||Epilepsy and Education in developing countries: a survey of school teachers’ knowledge about epilepsy and their attitude towards students with epilepsy in Northwestern Nigeria|
|2||Impact de la varicocèle sur le volume testiculaire et les paramètres spermatiques|
|3||Profil épidémiologique et clinique de la tuberculose dans la zone de santé de Lubumbashi (RD Congo)|
|4||Implementation challenges of free maternity services policy in Kenya: the health workers’ perspective|
|5||Assessment of renal function and electrolytes in patients with thyroid dysfunction in Addis Ababa, Ethiopia: a cross sectional study|
|6||Health care utilization among rural women of child-bearing age: a nigerian experience|
|7||Pan African Medical Journal (Pamj) and African Field Epidemiology Network (AFENET): A partnership for the future of medical publishing in Africa|