- Research article
- Open Open Peer Review
Comparison of AIMS65, Glasgow–Blatchford and Rockall scoring approaches in predicting the risk of in-hospital death among emergency hospitalized patients with upper gastrointestinal bleeding: a retrospective observational study in Nanjing, China
BMC Gastroenterologyvolume 18, Article number: 98 (2018)
This study aims to compare the performance of AIMS65, Glasgow–Blatchford (GBS) and Rockall scores (RS) in predicting the death risk among emergency-hospitalized patients with upper gastrointestinal bleeding (UGIB) in regional China.
A retrospective study was implemented between January 2014 and December 2015. Eligible participants were those who were hospitalized with UGIB. The outcome variable was in-hospital death, while explanatory variables were AIMS65, GBS and RS scores. Odds ratios (OR) and 95% confidence interval (CI) were estimated to assess the association of AIMS65, GBS and RS with death risk using multivariate logistic regression models. The areas under the receiver operating characteristics curve (AUC) of three scoring systems were computed to compare their predictive power.
Among 799 UGIB participants, 674 were non-variceal bleeding (NVUGIB) and 125 variceal bleeding (VUGIB) patients. AIMS65 (OR = 14.72, 95% CI = 6.48, 33.43) and RS (OR = 1.60, 95% CI = 1.20, 2.13) were positively associated with the risk of in-hospital death. Moreover, AIMS65 (AUC = 0.91, 95% CI = 0.84, 0.98) performed the best in predicting in-hospital death, followed by RS (AUC = 0.79, 95% CI = 0.72, 0.86) and GBS (AUC = 0.71, 95% CI = 0.59, 0.83) among overall UGIB participants. AIMS65 was also the best indicator to predict in-hospital death among either NVUGIB participants (AUC = 0.89, 95% CI = 0.80, 0.98) or VUGIB participants (AUC = 0.94, 95% CI = 0.89, 1.00).
AIMS65, GBS and RS scoring approaches were all acceptable for predicting in-hospital death among UGIB patients irrespective of the subtype of UGIB in China. The AIMS65 might be the most powerful predictor.
Upper gastrointestinal bleeding (UGIB) refers to the acute bleeding caused by upper gastrointestinal tract lesions beyond the ligament of Treitz, including non-variceal upper gastrointestinal bleeding (NVUGIB) and variceal upper gastrointestinal bleeding (VUGIB) . Over the past decades, the treatment and management of UGIB have been substantially improved, however the death rate among UGIB patients did not decline notably. The death rate was approximately 10% within overall UGIB patients and even as high as 35% among those with acute and chronic co-morbidities in Western countries [2,3,4]. In China, UGIB-specific death rate was estimated to be 4–14%, showing a heavy disease burden caused by UGIB .
The scenarios of prognosis are different for UGIB patients. Some patients with minor bleeding might get completely recovered without clinical treatment, while others with severe clinical symptoms might lose lives if they could not receive appropriate and effective clinical treatment timely. Therefore, it is of particular importance for clinical practitioners to effectively identify those UGIB patients who are at high risk of experiencing subsequent adverse outcomes. Recently, some scoring approaches have been developed to predict the subsequent outcomes for patients with UGIB, including Rockall score (RS), Glasgow Blatchford Score (GBS), Baylor Bleeding score, Cedars-Sinai Medical Center predictive index, Almela score and AIMS65 score. Among the above mentioned scoring approaches, RS and GBS are the most often-used [6,7,8,9,10]. However, they were not applied as widely as expected in clinical practice due to the complicated score calculation. Fortunately, the AIMS65 scoring system has recently been developed and validated to predict in-hospital death by Harvard Medical School in 2011 , which was more easily-calculated relative to either GBS or RS.
Considering that there are approximately 1 million UGIB patients visiting hospital each year and high mortality among these UGIB patients in China , it is of great significance to identify those UGIB patients who are at high risk of death (or other severe adverse outcomes) and provide them appropriate clinical treatment in time. Therefore, an effective and easily-used scoring approach is urgently needed for identifying those UGIB patients at high risk of death in China. Using hospital-based retrospective data, we aimed to evaluate the performance of AIMS65, GBS and RS scoring approaches in predicting the risk of death for hospitalized UGIB patients in China.
This was a retrospective hospital-based observational study. Participants were UGIB patients who visited the Department of Gastroenterology of Nanjing First Hospital with related signs and symptoms (i.e., melena, hematemesis, coffee ground vomiting, and/or abdominal pain) and were hospitalized for clinical treatment between January 2014 and December 2015. Those patients were excluded from the study if they (1) did not receive endoscopy examination as they had severe clinical symptoms and needed emergent clinical treatment to save their lives (n = 7), and/or (2) had missing data regarding calculation of GBS, RS and AIMS65. Finally, 799 of 814 UGIB patients were successfully included in this study. Prior to data collection, written informed consent was obtained from each alive participant or from his/her next of kin for the died. This study was approved by the Academic and Ethical Committee of Nanjing First Hospital.
For each participant, the following information were collected: age, gender, symptoms and signs on admission (including hematemesis, coffee ground vomiting, melena, syncope, mental status, blood pressure and pulse), co-morbidities (e.g., ischemic heart disease, diabetes mellitus, congestive cardiac failure, liver disease), profiles from laboratory tests (e.g., albumin level, urea, international normalized ratio, creatinine, hemoglobin), endoscopy examination records and subsequent clinical outcome events (in-hospital death or being alive).
The primary outcome variable was in-hospital death (“Yes” or “No”), defined as any death occurred during the period of hospitalization due to UGIB attack.
Explanatory variables were GBS, RS and AIMS65 scores, which were used as continuous and categorical measures, separately, in our analysis. There were 8, 5 and 5 risk factors involved to compute the score of GBS, RS and AIMS65, respectively. Table 1 presented all the specific risk factors and scoring algorithms included in each scoring system.
First, we conducted descriptive analysis using t-test (continuous variables) or Chi-square test (categorical variables). Then, using logistic regression models, we examined the relationship between outcome events and scores, separately. Two models were introduced: model 1 was a univariate analysis with each score as the single predictor; model 2 was a multivariate regression model with adjustment for participants’ age and/or gender and/or other potential clinical confounders (including albumin, urea, international normalized ratio, hemoglobin, blood pressure, pulse, comorbidity, mental status [12, 13], blood platelet count, prothrombin time or bleeding causes based on endoscopy exam) with consideration of specific variables included in each scoring system. Next, we used receiver operator characteristic curve (ROC) analysis, a widely used approach, to compare the predictive power of each scoring system on the risk of experiencing outcome events [14, 15]. ROC curve is a graphic representation of the relation between sensitivity and specificity for a diagnostic test. The areas under the receiver operating characteristics curve (AUC) were calculated with sensitivity as y-axis against 1-specifity as x-axis. With AUC, ROC curve can estimates and compares the predictive power of different tests or measures, which can assist with the choice of one test over the others. Generally, a perfect test will have an AUC of 1.0 and an AUC = 0.5 means the test performs no better than chance. Sensitivity and specificity of each scoring system were calculated at all possible cut-off points. The optimal cut-off value was identified based on the maximum sum of sensitivity and specificity for each scoring system. Data were double-entered and cleaned with EpiData 3.0 (The Epidata Association, Odense, Denmark) and analyzed using SPSS 21.0 (IBM Corp, Armonk, NY, USA).
Selected participants’ characteristics
Among the total 814 patients with UGIB, 799 participants were eligibly included in this study, with a mean (SD) age of 57.46 (18.04) years and 612 (76.60%) of men. Table 2 displayed the selected characteristics for 799 participants in this study. There were only 15 patients (1.8%) excluded from our analysis due to incomplete information. No death case was observed among those 15 excluded patients. The 15 patients excluded from our analysis (mean ± SD: 73.93 ± 14.84, p < 0.05) were significantly older than those 799 participants included in this study. However there was no statistical difference in gender proportion between the 15 excluded (60% of men) and 799 included patients (76.60% of men, p = 0.13).
Of those 799 UGIB patients, 125 (15.60%) were with variceal bleeding and 674 (84.40%) with nonvariceal bleeding. With respect to the causes of bleeding for these 799 patients, 484 (60.58%) participants were with peptic ulcer bleeding, 65 (8.14%) with cancer bleeding, 40 (5.01%) with Mallory-Weiss syndrome, 9 (1.13%) with erosive esophagitis and 201 (25.16%) with other diseases (e.g., gastro-oesophageal varices, acute gastric mucosal lesions, Dieulafoy’s lesion, or diverticular bleeding).
Associations of RS, GBS and AIMS65 scores with the risk of in-hospital death
The death rate was 3.1% (25/799) among UGIB patients in this study. Table 3 presented the associations of RS, GBS and AIMS65 scores with the risk of in-hospital death among overall 799 participants. After adjustment for potential confounders, AIMS65 (OR = 14.72, 95% CI = 6.48, 33.43) and RS (OR = 1.60, 95% CI = 1.20, 2.13) scores were examined to be positively associated with the risk of death among the overall participants, while marginally significant link (OR = 1.09, 955CI = 0.93, 1.27) was observed between GBS score and death risk.
Table 4 showed the associations of RS, GBS and AIMS65 scores with in-hospital death by type of UGIB. Among participants with NVUGIB, the scenarios of the associations of RS, GBS and AIMS65 scores with in-hospital death were similar to those within overall participants. However, for patients with VUGIB, only AIMS65 was examined to be positively associated with the likelihood of death.
Predictive power of RS, GBS and AIMS65 scoring approaches on the risk of experiencing in-hospital death based on ROC analysis
Figure 1 displayed the AUCs of RS, GBS and AIMS65 scoring systems to predict in-hospital death among overall participants. AIMS65 (AUC = 0.91, 95% CI = 0.84, 0.98) performed the best in predicting in-hospital death, followed by RS (AUC = 0.79, 95% CI = 0.72, 0.86) and GBS (AUC = 0.71, 95% CI = 0.59, 0.83).
Figures 2 and 3 showed the AUCs of RS, GBS and AIMS65 scoring systems to predict in-hospital death among NVUGIB and VUGIB participants, separately. Among the NVUGIB participants, AIMS65 (AUC = 0.89, 95% CI = 0.80, 0.98) performed the best to predict in-hospital death, then RS (AUC = 0.81, 95% CI = 0.73, 0.88) and GBS (AUC = 0.65, 95% CI = 0.50, 0.80), while AIMS65 (AUC = 0.94, 95% CI = 0.89, 1.00) was also the best predictor of in-hospital death, and then GBS (AUC = 0.78, 95% CI = 0.54, 0.93) and RS (AUC = 0.67, 95% CI = 0.50, 0.84) among VUGIB participants.
Optimal cutoff values of RS, GBS and AIMS65 scoring approaches for predicting in-hospital death
In this study, we estimated the optimal cutoff values of RS, GBS and AIMS65 scoring system, separately, for predicting in-hospital death among overall participants based on our ROC analysis (Table 5). The optimal cutoffs were identified to be 3, 12 and 2 for RS, GBS and AIMS65, respectively, and the largest sum of sensitivity (true positive rate) and specificity (true negative rate) produced for each scoring approach was 146% (RS), 140% (GBS) and 172% (AIMS65), separately, based on the corresponding estimated optimal cutoffs in this study.
In this retrospective study, significantly positive associations were identified between either RS or AIMS65 score and the risk of in-hospital death but marginally statistical link was observed for GBS scores among UGIB patients in Nanjing, China. Furthermore, based on AUCs, AIMS65 was the best approach, against the other two scoring systems, to predict in-hospital death (AIMS65 > RS > GBS for overall participants) among overall participants. Finding from this study suggested that these three scoring systems might be acceptable to predict in-hospital death for emergency hospitalized UGIB patients in China, which also added further evidence to existing literature.
The majority (91.7%) of the 799 UGIB patients were those with peptic ulcer bleeding, gastro-oesophageal varices, cancer bleeding, Mallory-Weiss syndrome or acute gastric mucosal lesions in our study. This was consistent not only with that reported from Western societies  but also with findings from a survey among Chinese UGIB patients .
The death rate (3.10%) observed among UGIB patients in this study was lower relative to those documented in previous literatures from both China and UK [17, 18]. This might be explained, in part, by that application of proton pump inhibitors (PPIs) prior to endoscopy, which could reduce the risk of re-bleeding and death . In addition, different from some previous studies, the outcome events (in-hospital death) assessed in this study were limited to those observed in the period of hospitalization, therefore the potential death cases after discharge were not investigated, which might have the number of death cases underestimated.
Some recent studies found that AIMS65 had similar power to RS or GBS in predicting death for UGIB patients [5, 19]. However, our study showed that AIMS65 was better than either GBS or RS in predicting in-hospital death. In addition to the interesting findings for overall participants, our study demonstrated that each of AIMS65, GBS and RS also could be used to assess the risk of in-hospital death in either NVUGIB or VUGIB patients. This was in line with the reports from previous retrospective studies [20, 21].
Only five variables are included to compute the AIMS65 score and the calculation of AIMS65 score is really simpler relative to GBS or RS. In our study, AIMS65 performed the best among these three scoring systems to predict in-hospital death for UGIB patients. Therefore, in terms of easy-use and predictive power, AIMS65 might be the most optimal instrument for predicting in-hospital death among UGIB patients in China.
A cut-off value is critically important for each scoring system in predicting clinical outcome events. Unfortunately, cutoffs were almost different for each of these three scoring systems in previous studies [6, 19]. It is really difficult to explain such inconsistency of cutoff values among different studies. However, this might be partly due to some differences in those studies: participants and ethnicity, bleeding cause based on endoscopy exam, use of PPIs, time of endoscopy exam and adherence to guidelines regarding endoscopic therapy . For example, a study from Spain found that the optimal cutoff value for predicting death among UGIB patients was 1 for AIMS65, 12 for GBS and 6 for RS . An Australian study reported that the preferable cutoff was 3 for AIMS65, 15 for GBS and 7 for RS to predict death among UGIB patients . And, our study suggested that the optimal cutoff value among Chinese UGIB patients was 2 for AIMS65, 12 for GBS and 3 for RS to predict in-hospital death. Therefore, the optimal cutoff of each scoring system should be specified for different population to maximize the power of identifying UGIB patients at high risk of death.
To the best of our knowledge, this is the first study conducted in China to compare the performance of GBS, RS and AIMS65 to predict the risk of in-hospital death among Chinese UGIB patients. The sample size was relatively large with sufficient number of VUGIB patients included, which allowed us to examine the predictive power of each scoring system within NVUGIB or VUGIB patients. Reasonable and appropriate statistical methods were used to investigate the association of scores generated by each instrument with the risk of death, to make comparison of predictive performance among the three scoring system, and to estimate the optimal cutoff for each scoring approach within this study.
Some limitations also need to be mentioned. First, this was a retrospective study, which implied potential information bias due to the study design, so the findings should be prudently interpreted. Second, 15 patients were excluded from our analysis due to incomplete data, which might cause potential bias in interpretation of the generalization of the present study findings. Third, only those UGIB patients died in hospital were included in this study and patients died after discharge were missed out. However, this might underpowered the effects of our analysis. In future, perspective studies are needed to further examine the performance of those scoring systems for predicting clinical outcome events among large scale representative sample population with UGIB in China.
AIMS65, GBS and RS were all acceptable for predicting in-hospital death among either overall UGIB, NVUGIB or VUGIB patients in China. Among the three scoring systems, AIMS65 might be the best to predict in-hospital death for hospitalized UGIB patients.
Areas under the receiver operating characteristics curve
Non-variceal upper gastrointestinal bleeding
Receiver operator characteristic curve
Upper gastrointestinal bleeding
Variceal upper gastrointestinal bleeding
Chinese Association of Emergency Physicians. Expert consensus about the emergency diagnosis and treatment of acute upper gastrointestinal hemorrhage. Chin J Crit Care Med. 2015;35:865–73. (In Chinese).
Rockall TA, Logan RF, Devlin HB, Northfield TC. Incidence of and mortality from acute upper gastrointestinal haemorrhage in the United Kingdom. Steering committee and members of the National Audit of acute upper gastrointestinal Haemorrhage. BMJ. 1995;311:222–6.
Christensen S, Riis A, Norgaard M, Sorensen HT, Thomsen RW. Short-term mortality after perforated or bleeding peptic ulcer among elderly patients: a population-based cohort study. BMC Geriatr. 2007;7:8.
Zimmerman J, Siguencia J, Tsvang E, Beeri R, Arnon R. Predictors of mortality in patients admitted to hospital for acute upper gastrointestinal hemorrhage. Scand J Gastroenterol. 1995;30:327–31.
Zhong M, Chen WJ, Lu XY, Qian J, Zhu CQ. Comparison of three scoring systems in predicting clinical outcomes in patients with acute upper gastrointestinal bleeding: a prospective observational study. J Dig Dis. 2016;17:820–8.
Chen IC, Hung MS, Chiu TF, Chen JC, Hsiao CT. Risk scoring systems to predict need for clinical intervention for patients with nonvariceal upper gastrointestinal tract bleeding. Am J Emerg Med. 2007;25:774–9.
Masaoka T, Suzuki H, Hori S, Aikawa N, Hibi T. Blatchford scoring system is a useful scoring system for detecting patients with upper gastrointestinal bleeding who do not need endoscopic intervention. Journal of Gastroenterology & Hepatolog. 2007;22:1404–8.
Bryant RV, Kuo P, Williamson K, Yam C, Schoeman MN, Holloway RH, Nguyen NQ. Performance of the Glasgow-Blatchford score in predicting clinical outcomes and intervention in hospitalized patients with upper GI bleeding. Gastrointest Endosc. 2013;78:576–83.
Barkun AN, Bardou M, Kuipers EJ, Sung J, Hunt RH, Martel M, Sinclair P. International consensus recommendations on the Management of Patients with Nonvariceal Upper Gastrointestinal Bleeding. Ann Intern Med. 2010;152:101–13.
Li ZS. Guidelines for the diagnosis and treatment of acute non-variceal upper gastrointestinal bleeding. Chin J Dig. 2015;35:793–8. (In Chinese).
Saltzman JR, Tabak YP, Hyett BH, Sun X, Travis AC, Johannes RS. A simple risk score accurately predicts in-hospital mortality, length of stay, and cost in acute upper GI bleeding. Gastrointest Endosc. 2011;74:1215–24.
Thanapirom K, Ridtitid W, Rerknimitr R, Thungsuk R, Noophun P, Wongjitrat C, Luangjaru S, Vedkijkul P, Lertkupinit C, Poonsab S. Prospective comparison of three risk scoring systems in non-variceal and variceal upper gastrointestinal bleeding. Journal of Gastroenterology & Hepatology. 2016;31:761–7.
Hyett BH, Abougergi MS, Charpentier JP, Kumar NL, Brozovic S, Claggett BL, Travis AC, Saltzman JR. The AIMS65 score compared with the Glasgow-Blatchford score in predicting outcomes in upper GI bleeding. Gastrointest Endosc. 2013;77:551–7.
Hanley JA, Mcneil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.
Greiner M, Pfeiffer D, Smith RD. Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Preventive Veterinary Medicine. 2000;45:23–41.
Sung JJ, Tsoi KK, Ma TK, Yung MY, Lau JY, Chiu PW. Causes of mortality in patients with peptic ulcer bleeding: a prospective cohort study of 10,428 cases. Am J Gastroenterol. 2010;105:84–9.
Xu Q, Hu NZ, Cui XL. Etiology and clinical characteristic of upper gastrointestinal haemorrhage: analysis of 1520 cases. Chinese journal of general practice. 2010;8:1079–80. (In Chinese)
Hearnshaw SA, Logan RF, Lowe D, Travis SP, Murphy MF, Palmer KR. Acute upper gastrointestinal bleeding in the UK: patient characteristics, diagnoses and outcomes in the 2007 UK audit. Gut. 2011;60:1327–35.
Martínez-Cara JG, Jiménez-Rosales R, Úbeda-Muñoz M, de Hierro ML, de Teresa J, Redondo-Cerezo E. Comparison of AIMS65, Glasgow–Blatchford score, and Rockall score in a European series of patients with upper gastrointestinal bleeding: performance when predicting in-hospital and delayed mortality. United European Gastroenterol J. 2016;4:371–9.
Park SW, Song YW, Tak DH, Ahn BM, Kang SH, Moon HS, Sung JK, Jeong HY. The AIMS65 score is a useful predictor of mortality in patients with nonvariceal upper gastrointestinal bleeding: urgent endoscopy in patients with high AIMS65 scores. Clinical Endoscopy. 2015;48:522–7.
Budimir I, Gradišer M, Nikolić M, Baršić N, Ljubičić N, Kralj D, Budimir I Jr. Glasgow Blatchford, pre-endoscopic Rockall and AIMS65 scores show no difference in predicting rebleeding rate and mortality in variceal bleeding. Scand J Gastroenterol. 2016;51:1375–9.
Our special thanks go to those staff who assisted us in data collection.
The work was supported by Nanjing Municipal Science and Technology Development Foundation (2007ZD011).
Availability of data and materials
All the data and materials are included within the manuscript. The raw datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Written informed consent was obtained from each alive participant or from his/her next of kin for the died. This study was approved by the Academic and Ethical Committee of Nanjing First Hospital.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.