Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

A neutrophil-to-lymphocyte ratio-based prognostic model to predict mortality in patients with HBV-related acute-on-chronic liver failure

BMC Gastroenterology volume 21, Article number: 422 (2021) Cite this article

Abstract

Background

Although the Asian Pacific Association for the Study of the Liver acute-on-chronic liver failure (ACLF) research consortium (AARC) ACLF score is easy to use in patients with hepatitis b virus-related ACLF (HBV-ACLF), serum lactate is not routinely tested in primary hospitals, and its value may be affected by some interference factors. Neutrophil-to-lymphocyte ratio (NLR) is used to assess the status of bacterial infection (BI) or outcomes in patients with various diseases. We developed an NLR-based AARC ACLF score and compared it with the existing model.

Methods

A total of 494 HBV-ACLF patients, enrolled in four tertiary academic hospitals in China with 90-day follow-up, were analysed. Prognostic performance of baseline NLR and lactate were compared between cirrhotic and non-cirrhotic subgroups via the receiver operating curve and Kaplan–Meier analyses. A modified AARC ACLF (mAARC ACLF) score using NLR as a replacement for lactate was developed (n = 290) and validated (n = 204).

Results

There were significantly higher baseline values of NLR in non-survivors, patients with admission BI, and those with higher grades of ACLF compared with the control groups. Compared with lactate, NLR better reflected BI status in the cirrhotic subgroup, and was more significantly correlated with CTP, MELD, MELD-Na, and the AARC score. NLR was an independent predictor of 90-day mortality, and was categorized into three risk grades (< 3.10, 3.10–4.78, and > 4.78) with 90-day cumulative mortalities of 8%, 21.2%, and 77.5% in the derivation cohort, respectively. The mAARC ACLF score, using the three grades of NLR instead of corresponding levels of lactate, was superior to the other four scores in predicting 90-day mortality in the derivation (AUROC 0.906, 95% CI 0.872–0.940, average P < 0.001) and validation cohorts (AUROC 0.913, 95% CI 0.876–0.950, average P < 0.01), with a considerable performance in predicting 28-day mortality in the two cohorts.

Conclusions

The prognostic value of NLR is superior to that of lactate in predicting short-term mortality risk in cirrhotic and non-cirrhotic patients with HBV-ACLF. NLR can be incorporated into the AARC ACLF scoring system for improving its prognostic accuracy and facilitating the management guidance in patients with HBV-ACLF in primary hospitals.

Peer Review reports

Background

Acute-on-chronic liver failure (ACLF) is associated with substantial short-term mortality and a high incidence of secondary infection [1,2,3,4]. Bacterial infection (BI) is a severe complication and predominates in the aetiology of secondary infection in ACLF [1,2,3,4]. Numerous studies have suggested that BI is a vital factor for triggering or aggravating systemic inflammation (SI) in ACLF and contributes to organ failure and poor outcomes in patients with the disease [4,5,6].

Complex scoring models have been developed to improve short-term survival prediction in patients with ACLF. White blood cell count (WBC), regarded as a critical independent risk factor associated with 28-day mortality in cirrhotic patients with ACLF, has been incorporated in the Chronic Liver Failure Consortium (CLIF-C) ACLF score [7] and the North American Consortium for the Study of End-Stage Liver Disease (NACSELD) ACLF score [8]. In the Asia–Pacific region, hepatitis b virus (HBV) infection is the main aetiology of ACLF, and research has suggested that a significant proportion of ACLF patients are non-cirrhotic or do not have extrahepatic organ failures upon admission [9, 10]. Additionally, most ACLF patients in this region are not treated in the intensive care unit because of objective limitations, impeding data collection for the two aforementioned scores.

Four frequently-used indexes (including total bilirubin [TB], hepatic encephalopathy [HE] grade, international normalized ratio [INR], and creatinine) and one metabolic index (serum lactate) are used for severity prediction in cirrhotic or non-cirrhotic patients with ACLF, per the Asian Pacific Society for the Study of the Liver (APSAL) ACLF Research Consortium (AARC) ACLF score [11]. Compared with the CLIF-C or NACSELD ACLF score, the AARC ACLF score is easier to calculate and suits more patients with HBV-ACLF in the Asia–Pacific region [10,11,12]. However, the value of serum lactate may be affected by several interference factors, like the source of the blood sample and the cirrhotic status of a patient. Additionally, serum lactate is not a routine testing item in primary hospitals in this region, impeding the promotion of the lactate-based AARC ACLF score.

Increased neutrophil/lymphocyte ratio (NLR), a physiological response of circulating leucocytes to inflammatory stress, serves as a useful biomarker to reflect the status of BI or SI in various inflammatory conditions [13, 14]. It is used for survival prediction before or after a liver transplant [15,16,17]. Recent studies have suggested that NLR is a novel biomarker for predicting short-term mortality particularly 90-day mortality, not only in patients with non-HBV ACLF [18,19,20] but also in those with HBV-ACLF [21,22,23]. However, it is unknown whether incorporating NLR into the existing AARC ACLF score can improve its prognostic value. Therefore, we designed this multi-centre study to develop an NLR-based AARC ACLF score to predict short-term mortality risk in patients with HBV-ACLF.

Methods

Study design

This retrospective study evaluated consecutive admissions of HBV-ACLF patients to four academic centres (Huashan Hospital, Shanghai; Shanghai Public Health Clinical Centre, Shanghai; First Affiliated Hospital of Wannan Medical College, Wuhu; and First hospital of Quanzhou affiliated to Fujian Medical University, Quanzhou) in China from January 2013 to December 2019. Two investigators at each centre were responsible for reviewing the patient charts to (a) diagnose and grade ACLF according to the APSAL criteria; (b) confirm the presence of cirrhosis and BI; and (c) assess survival. Any discrepancy between the two investigators was adjudicated by a senior physician.

Patient selection-derivation and validation cohorts

A total of 867 HBV-ACLF patients were retrospectively screened at the four enrolled centres from 2013 to 2019. Of these, 494 patients were transplant-free with complete data for ascertainment of the study outcome and were finally included. The criteria of inclusion and exclusion are summarized in Fig. 1. Two hundred and ninety patients from Huashan Hospital and Shanghai Public Health Clinical Centre were evaluated as the derivation cohort, and 204 patients from the other two centres were evaluated as the validation cohort. All patients received standard medical treatment, and antibiotic therapy was managed in patients with proven or suspected BI. Per the national guideline for non-bioartificial liver support systems in the treatment of liver failure, artificial liver support was utilized after comprehensive evaluation of the clinical state of a patient with informed consent [24].

Fig. 1
figure 1

Flow chart of the study design. ACLF was diagnosed and graded according to the criteria of the APASL ACLF Research Consortium (AARC). Eighty-six patients (21 patients from the derivation cohort and 65 from the validation cohort) had no baseline data of lactate and were excluded. Survival status (or hospital mortality, whichever occurred sooner) was identified using follow-up for 90 days after admission. Abbreviations: ACLF, acute-on-chronic liver failure; HBV-ACLF, hepatitis b related ACLF; AARC, Asian Pacific Society for the Study of the Liver ACLF research consortium

Full size image

Data collection and follow-up

Collected data included patient demographics, medical history, clinical parameters, and data of laboratory, radiologic, and microbiologic tests. Baseline data were defined as the poorest result/score obtained in the first 24-h period during hospitalization. Calculated severity scores were as follows: Child-Turcotte-Pugh (CTP) [25], model of end-stage liver disease (MELD) [26], MELD-Na [27], and AARC ACLF score [11]. All patients were followed up for 90 days with respect to their clinical outcome (or hospital mortality, whichever came sooner). Leucocytes were quantified using flow-cytometry-based cell counters in the four enrolled centres from 2013 to 2019. This approach can reduce the discrepancy in the value of NLR and increase subsequent prognostic accuracy [19].

Definition

ACLF was diagnosed and graded according to the updated criteria of AARC-ACLF, irrespective of the presence of cirrhosis or extrahepatic organ failures [10]. Diagnosis of cirrhosis was mainly based on clinical presentation, biochemical, and radiological evidence (e.g., shrinkage or superficial changes of the liver, portal hypertension, ascites, and splenomegaly); some patients undertook liver biopsy or endoscopy or FibroScan previously, and their reports were taken into consideration either. BI was diagnosed based on a comprehensive evaluation that included clinical symptoms, laboratory and/or imaging findings, and positive results of microbiological tests. Admission BI, categorized as community-acquired or healthcare-associated infections per the conventional criteria [28], was diagnosed in patients within 48 h of admission to any of the four enrolled centres.

Statistical analyses

Continuous variables with normal distributions were described using the mean ± SD and compared using Student’s t test. Continuous variables with skewed distributions, described using median with the interquartile range (IQR), were compared using the Mann‐Whitney U test for the comparison of two variables, and the Kruskal–Wallis test was used for the comparison of more than two groups. Categorical variables, expressed as percentages (frequencies), were compared using the Chi-square test followed by Fisher’s exact test, as appropriate. Cut-off values of NLR and the mAARC ACLF score for 90-day mortality prediction were calculated using the receiver operating characteristic (ROC) analysis. The area under ROC (AUROC) comparisons were performed via the Hanley & McNeil method. Survival analyses were performed for 90 days by the Kaplan–Meier (K–M) method. Cox regression models were used for univariate and multivariate analysis of 90-day mortality predictors. Two-tailed P value < 0.05 was considered as statistically significant. Statistical analyses were performed using SPSS v22.0 (IBM Inc) and MedCalc v20.008 (MedCalc Software).

Results

Baseline characteristics

Table 1 summarises the baseline characteristics of patients in the derivation and validation cohorts. The derivation cohort included 290 patients; the median age was 44 (37–54) years; 86.9% were men; and 232 were admitted or transferred to a liver intensive therapy unit. Patients were graded per the AARC ACLF score, as follows: < 8 in 70 (24.1%) patients; 8–10 in 139 (47.9%); and > 10 in 81 (27.9%). Compared with survivors, non-survivors had a higher proportion of old age, cirrhosis, ascites, poor hepatic/extra-hepatic performance, AARC ACLF score > 10, and history of artificial liver support or antibiotic management (Additional file 1: Table S1). Admission BI was diagnosed in 123 (42.4%) patients, and was observed more in non-survivors (Additional file 1: Table S1). Admission BI most frequently manifested as pneumonia (26.2%), followed by spontaneous bacterial peritonitis (SBP) (17.9%) (Additional file 1: Table S2).

Table 1 Baseline characteristics of the study population in derivation and validation cohorts
Full size table

Relation among BI status, ACLF grade, and short-term mortality risk

Figure 2 summarises the correlation among BI status, AARC ACLF grade, and 28/90-day mortality risk in 290 patients evaluated in the derivation cohort. Admission BI incidence had a positive correlation with the AARC ACLF grade, particularly for those diagnosed with ACLF grade 3 (Fig. 2a). Overall, there was a significantly higher incidence of 28/90-day mortality in ACLF patients admitted with BI, particularly in those with higher ACLF grades (Fig. 2b, c). However, there was no statistical difference in the 28-day mortality incidence between patients with and without admission BI (Fig. 2b).

Fig. 2
figure 2

Correlation among BI status, ACLF grade, and short-term mortality was analysed in 290 patients with HBV-ACLF in the derivation cohort. a Comparison of admission BI incidence among three patient subgroups (ACLF-1, n = 70; ACLF-2, n = 139; ACLF-3, n = 81); b The 28-day mortality incidence was compared between patients with (n = 123) or without admission BI (n = 167), and was further compared within the ACLF-1 (with BI, n = 8; without BI, n = 62), ACLF-2 (with BI, n = 29; without BI, n = 71), and ACLF-3 (with BI, n = 86; without BI, n = 34) subgroups. c The 90-day mortality incidence was compared likewise. Categorical data are expressed as percentages (frequencies) and analysed using the Chi‐square test followed by Fisher’s exact test, as appropriate. *P < 0.05, **P < 0.01, ***P < 0.001, ****P < 0.0001. ACLF was graded per the AARC ACLF score (5–7; 8–10; 11–15). Abbreviations: BI, bacterial infection; ACLF, acute-on-chronic liver failure; HBV-ACLF, hepatitis b related ACLF; AARC, Asian Pacific Society for the Study of the Liver ACLF research consortium

Full size image

Comparisons for performance of NLR and lactate among different patient subgroups

In the derivation cohort, non-survivors had higher values of NLR and lactate compared with survivors (Additional file 1: Table S1). Performance of the two variables was further compared among different patient subgroups and summarized in Fig. 3. Overall, there were significantly higher values of NLR (Fig. 3a) and lactate (Fig. 3b) in patients with higher ACLF grades than those in the control subgroups. Patients with admission BI had significantly higher NLR values compared with those without admission BI, with no discrepancy in the cirrhotic or non-cirrhotic subgroup (Fig. 3c). Conversely, the positive correlation between BI and lactate was only observed in the cirrhotic subgroup (Fig. 3d).

Fig. 3
figure 3

Performance of NLR and lactate in assessment of ACLF progression and BI status was compared in 290 patients with HBV-ACLF in the derivation cohort. a Comparison of baseline values of NLR among three patient subgroups (ACLF-1, n = 70; ACLF-2, n = 139; ACLF-3, n = 81); b Comparison of baseline values of lactate among the above-mentioned three subgroups; c Comparison of baseline values of NLR among four patient subgroups (without LC or BI, n = 43; without LC and with BI, n = 24; with LC and without BI, n = 86; with LC and with BI, n = 137); d Comparison of baseline values of lactate among the above-mentioned four patient subgroups. Continuous data are expressed using median (IQR) and compared using the Kruskal–Wallis test. *P < 0.05, **P < 0.01, ***P < 0.001, ****P < 0.0001. ACLF was graded per the AARC ACLF score (5–7; 8–10; 11–15). Abbreviations: NLR, neutrophil-to-lymphocyte ratio; LC, liver cirrhosis; BI, bacterial infection; ACLF, acute-on-chronic liver failure; HBV-ACLF, hepatitis b related ACLF; AARC, Asian Pacific Society for the Study of the Liver ACLF research consortium

Full size image

Comparisons for performance of baseline NLR and lactate in disease severity and short-term mortality

Spearman analyses showed that NLR correlated well with the CTP score, the MELD score, the MELD-Na score, and the lactate-absent AARC ACLF score (Fig. 4a), and lactate had weaker correlation with the above-mentioned four scores compared with NLR (Fig. 4b). Compared with lactate, NLR had more excellent performance in predicting 28-day mortality (AUROC 0.713, 95% CI 0.649–0.771; AUROC 0.854, 95% CI 0.802–0.898) and 90-day mortality (AUROC 0.670, 95% CI 0.605–0.731; AUROC 0.887, 95% CI 0.837–0.926) in the cirrhotic subgroup, whereas there were no statistical difference between lactate and NLR in predicting 90-day mortality (AUROC 0.684, 95% CI 0.559–0.792; AUROC 0.838, 95% CI 0.727–0.916) and particularly 28-day mortality (AUROC 0.672, 95% CI 0.457–0.782; AUROC 0.809, 95% CI 0.695–0.895) in the non-cirrhotic subgroup (Fig. 5a, b).

Fig. 4
figure 4

The correlation between accepted severity scores and NLR or lactate were compared using Spearman analysis in 290 patients in the derivation cohort, and was stratified for performance of baseline NLR using the CTP score (a), the MELD score (b), the MELD-Na score (c), and the lactate-absent AARC ACLFs (d); for performance of baseline lactate using the CTP score (e), MELD score (f), MELD-Na score (g), and the lactate-absent AARC ACLFs (h). The lactate-absent AARC ACLFs was calculated based on the AARC ACLFs and the item of lactate was excluded for an objective result. Abbreviations: NLR, neutrophil-to-lymphocyte ratio; ACLF, acute-on-chronic liver failure; CTP, Child-Turcotte-Pugh; MELD, model of end-stage liver disease; AARC ACLFs, Asian Pacific Society for the Study of the Liver ACLF research consortium ACLF score

Full size image
Fig. 5
figure 5

Performance of NLR and lactate in predicting short-term mortality risk was compared in 290 patients with HBV-ACLF in the derivation cohort. a Receiver operating characteristics (ROC) curve analyses for 28-day mortality risk in non-cirrhotic (n = 67) or cirrhotic subgroup (n = 223); b ROC analyses for 90-day mortality risk in the above-mentioned two subgroups; c Kaplan–Meier analyses for 90-day survival based on three risk levels of baseline lactate; d KM analyses for 90-day survival based on three risk levels of baseline NLR. Lactate was graded into three risk levels (< 1.5 mmol/L, 1.5–2.5 mmol/L, and > 2.5 mmol/L) according to the AARC ACLF score. NLR was divided into three risk levels (< 3.10, 3.10–4.78, and > 4.78) based on the upper limit of normal and the optimal cut-off value evaluated in the sensitivity analyses in the derivation cohort. The Hanley & McNeil method was used for AUROC comparisons. Abbreviations: NLR, neutrophil-to-lymphocyte ratio; ACLF, acute-on-chronic liver failure; HBV-ACLF, hepatitis b related ACLF; AARC, Asian Pacific Society for the Study of the Liver ACLF research consortium

Full size image

The optimal cut-off value for baseline NLR in predicting 90-day mortality risk was 4.78. Kaplan–Meier survival analyses showed that patients with a low value of lactate (< 1.5 mmol/L) and those with a medium value (1.5–2.5 mmol/L) had equal short-term survival rate (Fig. 5c). Conversely, the performance of NLR was excellent among patient subgroups divided via three risk levels of baseline NLR (< 3.10, 3.10–4.78, and > 4.78); NLR > 4.78 was associated with a 58.0% 28-day mortality risk and 77.5% 90-day mortality risk (Fig. 5d).

Predictors of 90-day mortality risk in patients with HBV-ACLF

Baseline data obtained from 290 patients in the derivation cohort were subjected to Cox regression analyses for identifying 90-day mortality predictors. Univariate and multivariate analyses were conducted by common variables (model 1), and three risk grades of NLR and five AARC-ACLF-related variables (model 2). NLR, HE, INR, and creatinine were consistently predictors of 90-day mortality as assessed using multivariate analyses controlled by the above-mentioned two Cox regression models, whereas lactate was not independently associated with 90-day mortality using multivariate analyses controlled by the model 2 (Table 2). The modified AARC ACLF score (mAARC ACLF score) was generated by using three grades of NLR (< 3.10, 3.10–4.78, and > 4.78) as a replacement of the corresponding levels of lactate (< 1.5 mmol/L, 1.5–2.5 mmol/L, and > 2.5 mmol/L).

Table 2 Cox regression analysis for predictors of 90-day mortality in 290 patients with HBV-ACLF in the derivation cohort
Full size table

Predictive performance of the mAARC ACLF score

Overall, the performance of the mAARC ACLF score for predicting 28-day mortality (AUROC 0.927, 95% CI 0.891–0.954, average P < 0.05) and particularly 90-day mortality (AUROC 0.906, 95% CI 0.866–0.937, average P < 0.001) was superior to that of the CTP score, the MELD score, the MELD-Na score, and the AARC ACLF score (Fig. 6a, b). Kaplan–Meier survival analyses showed that there was equal short-term survival rate between non-cirrhotic patients with low or medium AARC ACLF score (Fig. 7a), and dividing ACLF grades via corresponding values of the mAARC ACLF score had excellent performance in the cirrhotic or non-cirrhotic subgroup (Fig. 7b).

Fig. 6
figure 6

Prognostic performance of the accepted ACLF scores and the mAARC ACLFs was compared using the area under the receiver operating curve (AUROC), and was stratified for their performance in 290 patients in the derivation cohort by a comparison of 28-day mortality and b comparison of 90-day mortality; for their performance in 204 patients in the validation cohort by c comparison of 28-day mortality and d comparison of 90-day mortality. The mAARC ACLFs was calculated using three risk levels of baseline NLR (< 3.10, 3.10–4.78, and > 4.78) instead of corresponding levels of lactate (< 1.5 mmol/L, 1.5–2.5 mmol/L, and > 2.5 mmol/L). The Hanley & McNeil method was used for AUROC comparisons. Abbreviations: NLR, neutrophil-to-lymphocyte ratio; ACLF, acute-on-chronic liver failure; CTP, Child-Turcotte-Pugh; MELD, model of end-stage liver disease; AARC ACLFs, Asian Pacific Society for the Study of the Liver ACLF research consortium ACLF score; mAARC ACLFs, modified AARC ACLFs

Full size image
Fig. 7
figure 7

Prognostic performance of the AARC ACLF score and the mAARC ACLF score was compared in the derivation cohort using Kaplan–Meier (K–M) analysis, and was stratified for the performance of the AARC ACLF score in the non-cirrhotic (n = 67) or cirrhotic subgroup (n = 223) using (a); for the performance of the mAARC ACLF score in above-mentioned two subgroups using (b). The mAARC ACLF score was calculated using three risk levels of baseline NLR (< 3.10, 3.10–4.78, and > 4.78) instead of corresponding levels of lactate (< 1.5 mmol/L, 1.5–2.5 mmol/L, and > 2.5 mmol/L). Abbreviations: ACLF, acute-on-chronic liver failure; AARC, Asian Pacific Society for the Study of the Liver ACLF research consortium

Full size image

Prognostic interest of the mAARC ACLF score was further compared with the above-mentioned four scores in the cirrhotic or non-cirrhotic subgroup. For predicting 28-day mortality risk, performance of the mAARC ACLF score was not inferior to that of the other four scores in the non-cirrhotic subgroup (AUROC 0.916, 95% CI 0.822–0.970, average P > 0.05); its performance (AUROC 0.926, 95% CI 0.884–0.957, average P < 0.01) was superior to that of CTP, MELD, and MELD-Na except the AARC ACLF score (AUROC 0.903, 95% CI 0.856–0.939, P = 0.079) in the cirrhotic subgroup (Additional file 2: Fig. S1a). For predicting 90-day mortality risk, prognostic value of the mAARC ACLF score was superior to the other four scores, not only in the cirrhotic subgroup (AUROC 0.916, 95% CI 0.872–0.949, average P < 0.001) but also in the non-cirrhotic subgroup (AUROC 0.850, 95% CI 0.741–0.925, average P < 0.05) (Additional file 2: Fig. S1b).

Validation cohort

Of 269 patients meeting the enrollment criteria in the validation cohort, few were managed in a liver intensive therapy unit, 65 of 269 (24.2%) did not have baseline tests of serum lactate, and 204 patients were finally evaluated (Fig. 1). Compared with the derivation cohort, this cohort had a lower incidence of BI, lower severity scores except the CTP score, and a smaller patient proportion with the AARC ACLF score > 10 or antibiotic history up admission; there was no significant discrepancy in other patient demographics between the two cohorts (Table 1). Admission BI, most frequently manifested as SBP (Additional file 1: Table S2), was observed more in non-survivors compared with that in survivors (Additional file 1: Table S3). The baseline value of NLR was higher in non-survivors than that in survivors (Additional file 1: Table S3), and correlated well with the above-mentioned four scores (average P < 0.001).

ROC analysis showed that performance of NLR was superior to that of lactate in predicting 28-day mortality (AUROC 0.876, 95% CI 0.822–0.917; AUROC 0.681, 95% CI 0.612–0.744) (Additional file 3: Fig. S2a) and 90-day mortality (AUROC 0.893, 95% CI 0.842–0.932; AUROC 0.610, 95% CI 0.539–0.677) (Additional file 3: Fig. S2b). Kaplan–Meier analyses showed that in patients with a low or median value of risk index, grading patients via three risk levels of NLR had significantly greater interest compared with using the corresponding levels of lactate (Additional file 3: Fig. S2c, Additional file 3: Fig. S2d).

Despite being a less sick cohort, the performance of the mAARC ACLF score (AUROC 0.895, 95% CI 0.845–0.933, average P > 0.05) was not inferior to that of the above-mentioned four scores in 28-day mortality prediction (Fig. 6c), and its performance (AUROC 0.913, 95% CI 0.866–0.948, average P < 0.01) was superior to them in 90-day mortality prediction (Fig. 6d). There was a linear correlation between increasing short-term mortality risk and elevating ACLF grades, per the AARC ACLF score (Additional file 4: Fig. S3a) or the mAARC ACLF score (Additional file 4: Fig. S3b).

Discussion

The present study demonstrated that NLR had excellent performance for predicting short-term mortality risk in patients with HBV-ACLF; the prognostic value of NLR was superior to that of lactate, not only in the cirrhotic patient subgroup but also in the non-cirrhotic subgroup. NLR, a frequently-used and dependable inflammatory index, can be incorporated into the AARC ACLF scoring system for improving its prognostic accuracy, and benefiting the stratification and therapeutic guidance in HBV-ACLF patients admitted to primary hospitals.

High-level SI is often observed in the development of ACLF, presenting as activation of Toll-like and Nod-like receptors in peripheral myeloid cells (e.g., monocytes, dendritic cells, and neutrophils), overproduction of pro-inflammatory (e.g., tumor necrosis factor α [TNFα], interleukin-6 [IL-6], and IL-8) and anti-inflammatory cytokines (e.g., IL-10), and activated oxidative burst and recruitment of neutrophils [29, 30]. As ACLF progresses, the innate and adaptive immune cells gradually develop into suppression or paralysis, presenting as the exhaustion of immune cells (e.g., CD4+ T lymphocytes and CD8+ T lymphocytes) or effectors (e.g., interferon-γ, HLA-DR, TNFα, IL-6, and IL-8) [30,31,32], up-regulated expression of immune inhibitory receptors (e.g., programmed death-1, programmed death-ligand 1, and MER tyrosine kinase) [31, 33], impaired phagocytosis of myeloid cells [34, 35], and expansion of myeloid-derived suppressor cells [33, 34, 36]. Although disparity exists in the etiologies and definitions of ACLF between different regions, numerous studies have demonstrated that BI contributes to the development and progression of ACLF caused by non-HBV [5, 7, 8] or HBV [10, 11] etiologies. NLR serves as a simple inflammatory biomarker for assessing BI or SI, and may reflect the immunologic balance between the circulating neutrophils and lymphocytes in ACLF patients.

In contrast, elevation of serum lactate is caused by metabolic dysfunction (e.g., tissue hypoperfusion and decreased lactate clearance), and is often found in critically ill patients in the intensive care setting [37] and in patients with decompensated cirrhosis [38]. However, most HBV-ACLF patients evaluated in this study, particularly those from the validation cohort, were treated in the general ward, and around 23% of them were non-cirrhotic. Our data showed that compared with NLR, lactate had a weaker correlation with existing severity scores, insignificant reflection of the BI status in non-cirrhotic patient subgroup, and less accurate assessment of short-term mortality risk in patient subgroups with a low or medium level of lactate.

Our present study showed that compared with the lactate-based AARC ACLF score, the NLR-based mAARC ACLF score was more sensitive in predicting short-term mortality risk in patients with HBV-ACLF in the early phase, and its predictive value was less affected by the cirrhosis status of a patient. Additionally, 84 of 590 (14.8%) transplant-free patients with HBV-ACLF did not have data of the baseline lactate and were excluded in the analysis in this study, and 65 of them (77.4%) were from the validation cohort. Using three grades of NLR (< 3.10, 3.10–4.78, and > 4.78) instead of the corresponding levels of lactate (< 1.5 mmol/L, 1.5–2.5 mmol/L, and > 2.5 mmol/L) is more suitable for physicians in primary hospitals in this region because the routine blood test is more frequently taken than the lactate test at these centres.

Although WBC is incorporated in the CLIF-C ACLF score and the NACSELD ACLF score, we did not use this inflammatory index because disparity in the baseline values of WBC exists between cirrhotic and non-cirrhotic patient subgroups, or among cirrhotic patients using different management strategies. Our data showed that although there was overall statistical difference in baseline WBC between HBV-ACLF patients with or without admission BI, WBC did not exceed the upper limit of normal in more than half of the cirrhotic subgroup with admission BI. Additionally, ROC analysis showed that the performance of WBC was not inferior to that of lactate, but was significantly inferior to that of NLR. Thus, compared with the above-mentioned two complex scores, the mAARC ACLF score is significantly easier to calculate, and better suits patients with HBV-ACLF in primary hospitals in this region.

This study had some limitations in addition to its retrospective design. First, patients with non-HBV ACLF (e.g., alcoholic ACLF) were excluded to avoid discrepancy in baseline NLR values, and this may limit the generality of the mAARC ACLF score. Predictive values of NLR and the mAARC score need further validation in non-HBV ACLF patient populations. Additionally, the episodes of BI may be not accurately categorized because numerous patients diagnosed with healthcare-associated BI had long-term utility of preventive antibiotics, particularly extra-broad spectrum antibiotics in the primary facilities. Although significantly increased values of NLR and severity scores were observed in a significant proportion of ACLF patients diagnosed with hospital-acquired BI after 48 h of admission, we did not include their dynamic course in analysis because of objective limitations (e.g., lack of lactate or other laboratory variables for calculation of complex scores and inconsistent intervals of blood samples at different enrolled centres). The predictive values of NLR and the mAARC ACLF score need to be further validated in future prospective research.

Conclusion

Our present study aimed first to use an NLR-based AARC ACLF scoring system for short-term mortality prediction in patients with HBV-ACLF. The findings indicate that the mAARC ACLF score is reliable, time-saving, and suitable for physicians in primary hospitals. Its prognostic accuracy needs further validation in patients with HBV-ACLF in other regions and in patients with non-HBV related ACLF. We implemented a multi-centre prospective study to further validate its prognostic value.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding authors on reasonable request.

Abbreviations

ACLF:

Acute-on-chronic liver failure

BI:

Bacterial infection

SI:

Systemic inflammation

WBC:

White blood cell count

CLIF-C:

Chronic Liver Failure Consortium

NACSELD:

North American Consortium for the Study of End-Stage Liver Disease

HBV:

Hepatitis b virus

HE:

Hepatic encephalopathy

INR:

International normalized ratio

APASL:

Asian Pacific Society for the Study of the Liver

AARC:

APASL ACLF research consortium

HBV-ACLF:

HBV-related ACLF

NLR:

Neutrophil-to-lymphocyte ratio

CTP:

Child-Turcotte-Pugh

MELD:

Model of end-stage liver disease

IQR:

Interquartile range

AUROC:

Area under the receiver operating characteristic curves

HBeAg:

Hepatitis b envelope antigen

SBP:

Spontaneous bacterial peritonitis

LA:

Liver cirrhosis

mAARC ACLFs:

Modified AARC ACLF score

TNF:

Tumor necrosis factor

IL:

Interleukin

References

  1. Hernaez R, Solà E, Moreau R, Ginès P. Acute-on-chronic liver failure: an update. Gut. 2017;66(3):541–53.

    Article  CAS  Google Scholar 

  2. Arroyo V, Moreau R, Jalan R, Ginès P. Acute-on-chronic liver failure: a new syndrome that will re-classify cirrhosis. J Hepatol. 2015;62(1 Suppl):S131-143.

    Article  Google Scholar 

  3. Bajaj JS, O’Leary JG, Wong F, Reddy KR, Kamath PS. Bacterial infections in end-stage liver disease: current challenges and future directions. Gut. 2012;61(8):1219–25.

    Article  CAS  Google Scholar 

  4. Fernández J, Acevedo J, Wiest R, Gustot T, Amoros A, Deulofeu C, Reverter E, Martínez J, Saliba F, Jalan R, et al. Bacterial and fungal infections in acute-on-chronic liver failure: prevalence, characteristics and impact on prognosis. Gut. 2018;67(10):1870–80.

    Article  Google Scholar 

  5. Bajaj JS, O’Leary JG, Reddy KR, Wong F, Biggins SW, Patton H, Fallon MB, Garcia-Tsao G, Maliakkal B, Malik R, et al. Survival in infection-related acute-on-chronic liver failure is defined by extrahepatic organ failures. Hepatology. 2014;60(1):250–6.

    Article  Google Scholar 

  6. Jalan R, Fernandez J, Wiest R, Schnabl B, Moreau R, Angeli P, Stadlbauer V, Gustot T, Bernardi M, Canton R, et al. Bacterial infections in cirrhosis: a position statement based on the EASL Special Conference 2013. J Hepatol. 2014;60(6):1310–24.

    Article  Google Scholar 

  7. Jalan R, Saliba F, Pavesi M, Amoros A, Moreau R, Ginès P, Levesque E, Durand F, Angeli P, Caraceni P, et al. Development and validation of a prognostic score to predict mortality in patients with acute-on-chronic liver failure. J Hepatol. 2014;61(5):1038–47.

    Article  Google Scholar 

  8. O’Leary J, Reddy K, Garcia-Tsao G, Biggins S, Wong F, Fallon M, Subramanian R, Kamath P, Thuluvath P, Vargas H, et al. NACSELD acute-on-chronic liver failure (NACSELD-ACLF) score predicts 30-day survival in hospitalized patients with cirrhosis. Hepatology. 2018;67(6):2367–74.

    Article  CAS  Google Scholar 

  9. Sarin S, Kedarisetty C, Abbas Z, Amarapurkar D, Bihari C, Chan A, Chawla Y, Dokmeci A, Garg H, Ghazinyan H, et al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific Association for the Study of the Liver (APASL) 2014. Hepatol Int. 2014;8(4):453–71.

    Article  Google Scholar 

  10. Sarin SK, Choudhury A, Sharma MK, Maiwall R, Al Mahtab M, Rahman S, Saigal S, Saraf N, Soin AS, Devarbhavi H, et al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific association for the study of the liver (APASL): an update. Hepatol Int. 2019;13(4):353–90.

    Article  Google Scholar 

  11. Choudhury A, Jindal A, Maiwall R, Sharma M, Sharma B, Pamecha V, Mahtab M, Rahman S, Chawla Y, Taneja S, et al. Liver failure determines the outcome in patients of acute-on-chronic liver failure (ACLF): comparison of APASL ACLF research consortium (AARC) and CLIF-SOFA models. Hepatol Int. 2017;11(5):461–71.

    Article  CAS  Google Scholar 

  12. Lu C, Chen C, Ho C, Hsiao C, Wu Y, Ho M, Lee P, Hu R. Dynamic prognostication in transplant candidates with acute-on-chronic liver failure. J Pers Med 2020, 10(4).

  13. de Jager CP, van Wijk PT, Mathoera RB, de Jongh-Leuvenink J, van der Poll T, Wever PC. Lymphocytopenia and neutrophil-lymphocyte count ratio predict bacteremia better than conventional infection markers in an emergency care unit. Crit Care. 2010;14(5):R192.

    Article  Google Scholar 

  14. Lowsby R, Gomes C, Jarman I, Lisboa P, Nee PA, Vardhan M, Eckersley T, Saleh R, Mills H. Neutrophil to lymphocyte count ratio as an early indicator of blood stream infection in the emergency department. Emerg Med J. 2015;32(7):531–4.

    Article  Google Scholar 

  15. Motomura T, Shirabe K, Mano Y, Muto J, Toshima T, Umemoto Y, Fukuhara T, Uchiyama H, Ikegami T, Yoshizumi T, et al. Neutrophil-lymphocyte ratio reflects hepatocellular carcinoma recurrence after liver transplantation via inflammatory microenvironment. J Hepatol. 2013;58(1):58–64.

    Article  CAS  Google Scholar 

  16. Lai Q, Castro Santa E, Rico Juri JM, Pinheiro RS, Lerut J. Neutrophil and platelet-to-lymphocyte ratio as new predictors of dropout and recurrence after liver transplantation for hepatocellular cancer. Transpl Int. 2014;27(1):32–41.

    Article  CAS  Google Scholar 

  17. Leithead JA, Rajoriya N, Gunson BK, Ferguson JW. Neutrophil-to-lymphocyte ratio predicts mortality in patients listed for liver transplantation. Liver Int. 2015;35(2):502–9.

    Article  CAS  Google Scholar 

  18. Moreau N, Wittebole X, Fleury Y, Forget P, Laterre PF, Castanares-Zapatero D. Neutrophil-to-lymphocyte ratio predicts death in acute-on-chronic liver failure patients admitted to the intensive care unit: a retrospective cohort study. Shock. 2018;49(4):385–92.

    Article  Google Scholar 

  19. Bernsmeier C, Cavazza A, Fatourou EM, Theocharidou E, Akintimehin A, Baumgartner B, Dhar A, Auzinger G, Thursz M, Bernal W, et al. Leucocyte ratios are biomarkers of mortality in patients with acute decompensation of cirrhosis and acute-on-chronic liver failure. Aliment Pharmacol Ther. 2020;52(5):855–65.

    Article  CAS  Google Scholar 

  20. Chiriac S, Stanciu C, Singeap AM, Sfarti CV, Cuciureanu T, Trifan A. Prognostic value of neutrophil-to-lymphocyte ratio in cirrhotic patients with acute-on-chronic liver failure. Turk J Gastroenterol. 2020;31(12):868–76.

    Article  Google Scholar 

  21. Wu W, Yan H, Zhao H, Sun W, Yang Q, Sheng J, Shi Y. Characteristics of systemic inflammation in hepatitis B-precipitated ACLF: differentiate it from No-ACLF. Liver Int. 2018;38(2):248–57.

    Article  CAS  Google Scholar 

  22. Cai J, Wang K, Han T, Jiang H. Evaluation of prognostic values of inflammation-based makers in patients with HBV-related acute-on-chronic liver failure. Medicine 2018, 97(46):e13324.

  23. Qiang L, Qin J, Sun C, Sheng Y, Chen W, Qiu B, Chen X, Chen Y, Liu F, Wu G. A novel predictive model based on inflammatory markers to assess the prognosis of patients with HBV-related acute-on-chronic liver failure: a retrospective cohort study. BMC Gastroenterol. 2020;20(1):301.

    Article  CAS  Google Scholar 

  24. Liver Failure and Artificial Liver Group, Branch of Infectious Diseases, Chinese Medical Association. Guideline for non-bioartificial liver support systems in treatment of liver failure: 2016 update. Chin J Clin Infect Dis 2016, 9(2):97–103.

  25. Abad-Lacruz A, Cabré E, González-Huix F, Fernández-Bañares F, Esteve M, Planas R, Llovet JM, Quer JC, Gassull MA. Routine tests of renal function, alcoholism, and nutrition improve the prognostic accuracy of Child-Pugh score in nonbleeding advanced cirrhotics. Am J Gastroenterol. 1993;88(3):382–7.

    CAS  PubMed  Google Scholar 

  26. Kamath PS, Wiesner RH, Malinchoc M, Kremers W, Therneau TM, Kosberg CL, D’Amico G, Dickson ER, Kim WR. A model to predict survival in patients with end-stage liver disease. Hepatology. 2001;33(2):464–70.

    Article  CAS  Google Scholar 

  27. Kim WR, Biggins SW, Kremers WK, Wiesner RH, Kamath PS, Benson JT, Edwards E, Therneau TM. Hyponatremia and mortality among patients on the liver-transplant waiting list. N Engl J Med. 2008;359(10):1018–26.

    Article  CAS  Google Scholar 

  28. Bajaj JS, O’Leary JG, Reddy KR, Wong F, Olson JC, Subramanian RM, Brown G, Noble NA, Thacker LR, Kamath PS. Second infections independently increase mortality in hospitalized patients with cirrhosis: the North American consortium for the study of end-stage liver disease (NACSELD) experience. Hepatology. 2012;56(6):2328–35.

    Article  CAS  Google Scholar 

  29. Yang L, Wu T, Li J, Li J. Bacterial infections in acute-on-chronic liver failure. Semin Liver Dis. 2018;38(2):121–33.

    Article  Google Scholar 

  30. Martin-Mateos R, Alvarez-Mon M, Albillos A. Dysfunctional immune response in acute-on-chronic liver failure: it takes two to tango. Front Immunol. 2019;10:973.

    Article  CAS  Google Scholar 

  31. Bernsmeier C, Pop OT, Singanayagam A, Triantafyllou E, Patel VC, Weston CJ, Curbishley S, Sadiq F, Vergis N, Khamri W, et al. Patients with acute-on-chronic liver failure have increased numbers of regulatory immune cells expressing the receptor tyrosine kinase MERTK. Gastroenterology. 2015;148(3):603-615.e614.

    Article  CAS  Google Scholar 

  32. Moreau R. The pathogenesis of ACLF: the inflammatory response and immune function. Semin Liver Dis. 2016;36(2):133–40.

    Article  CAS  Google Scholar 

  33. Cao D, Xu H, Guo G, Ruan Z, Fei L, Xie Z, Wu Y, Chen Y. Intrahepatic expression of programmed death-1 and its ligands in patients with HBV-related acute-on-chronic liver failure. Inflammation. 2013;36(1):110–20.

    Article  CAS  Google Scholar 

  34. Bernsmeier C, Triantafyllou E, Brenig R, Lebosse FJ, Singanayagam A, Patel VC, Pop OT, Khamri W, Nathwani R, Tidswell R, et al. CD14(+) CD15(−) HLA-DR(−) myeloid-derived suppressor cells impair antimicrobial responses in patients with acute-on-chronic liver failure. Gut. 2018;67(6):1155–67.

    Article  CAS  Google Scholar 

  35. Wu W, Sun S, Wang Y, Zhao R, Ren H, Li Z, Zhao H, Zhang Y, Sheng J, Chen Z, et al. Circulating neutrophil dysfunction in HBV-related acute-on-chronic liver failure. Front Immunol 2021, 12:620365.

  36. Zeng Y, Li Y, Xu Z, Gan W, Lu L, Huang X, Lin C. Myeloid-derived suppressor cells expansion is closely associated with disease severity and progression in HBV-related acute-on-chronic liver failure. J Med Virol. 2019;91(8):1510–8.

    Article  CAS  Google Scholar 

  37. Edmark C, McPhail M, Bell M, Whitehouse T, Wendon J, Christopher K. LiFe: a liver injury score to predict outcome in critically ill patients. Intensive Care Med. 2016;42(3):361–9.

    Article  Google Scholar 

  38. Sarmast N, Ogola G, Kouznetsova M, Leise M, Bahirwani R, Maiwall R, Tapper E, Trotter J, Bajaj J, Thacker L, et al. Model for end-stage liver disease-lactate and prediction of inpatient mortality in patients with chronic liver disease. Hepatology. 2020;72(5):1747–57.

    Article  Google Scholar 

Download references

Acknowledgements

The authors acknowledge all the participating clinical staff from the Department of Infectious Diseases or Severe Hepatopathy at the four enrolled centres. We thank LetPub (www.letpub.com) for its linguistic assistance during the preparation of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (No. 81670528 and No. 81871640) and the Shanghai Shen Kang Hospital Development Center (SHDC12019116). The recipients of the fund, Richeng Mao and Jiming Zhang designed the study, constructed the framework and revised the manuscript.

Author information

Author notes

  1. Jian Sun, Hongying Guo, and Xueping Yu have contributed equally to this work

Authors and Affiliations

  1. Department of Infectious Diseases, Huashan Hospital, Fudan University, Shanghai, 200040, China

    Jian Sun, Haoxiang Zhu, Xueyun Zhang, Zhongliang Shen, Richeng Mao & Jiming Zhang

  2. Department of Infectious Diseases, First Affiliated Hospital of Wannan Medical College, Wuhu, 241000, China

    Jian Sun & Jianghua Yang

  3. Department of Severe Hepatopathy, Shanghai Public Health Clinical Centre, Fudan University, Shanghai, 201508, China

    Hongying Guo, Jiefei Wang & Zhiping Qian

  4. Department of Infectious Diseases, First Hospital of Quanzhou, Affiliated to Fujian Medical University, Quanzhou, 362000, China

    Xueping Yu

  5. Shanghai Key Laboratory of Infectious Diseases and Biosafety Emergency Response, Shanghai, 200040, China

    Zhongliang Shen, Richeng Mao & Jiming Zhang

Authors
  1. Jian Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hongying Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xueping Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Haoxiang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xueyun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jianghua Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jiefei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Zhiping Qian
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Zhongliang Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Richeng Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jiming Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JMZ and RCM: designed the study, constructed the framework and revised each edition of the manuscript. JS, HYG, XPY, HXZ, XYZ, JHY, JFW, and ZPQ: performed data collection and patient follow-up. JS, HYG, and ZLS: performed data interpretation and analysis. JS, HYG, and XPY: wrote the first draft of the manuscript. All authors have read and approved the final version of the manuscript.

Corresponding author

Correspondence to Jiming Zhang.

Ethics declarations

Ethics approval and consent to participate

This study was conducted in accordance with the ethical guidelines of the Helsinki Declaration. The study protocol was approved by the Institutional Ethics Review Committee of Huashan Hospital. Written informed consent was waived owing to its retrospective study design.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Table S1–S3.

Additional file 2

. Fig. S1: Prognostic performance of the accepted ACLF scores and the mAARC ACLFs was compared within the non-cirrhotic (n = 67) or cirrhotic subgroup (n = 223) in the derivation cohort, and was stratified for the area under the receiver operating curve (AUROC) comparisons of 28-day mortality risk using (a); for AUROC comparisons of 90-day mortality risk using (b). The Hanley & McNeil method was used for AUROC comparisons. Abbreviations: ACLF, acute-on-chronic liver failure; CTP, Child-Turcotte-Pugh; MELD, model of end-stage liver disease; AARC ACLFs, Asian Pacific Society for the Study of the Liver ACLF research consortium ACLF score; mAARC ACLFs, modified AARC ACLFs.

Additional file 3

. Fig. S2: Performance of NLR and lactate in predicting short-term mortality risk was compared in 204 patients with HBV-ACLF in the validation cohort, and was stratified for the area under the receiver operating curve (AUROC) comparisons for 28-day and 90-day mortality using (a) and (b); for the performance of lactate and NLR in the Kaplan-Meier (K-M) curve analysis of 90-day mortality using (c) and (d). Lactate was graded into three risk levels (<1.5 mmol/L, 1.5–2.5 mmol/L, and >2.5 mmol/L) according to the AARC ACLF score. NLR was divided into three risk levels (<3.10, 3.10–4.78, and >4.78) based on the upper limit of normal and the optimal cut-off value evaluated in the sensitivity analyses in the derivation cohort. The Hanley & McNeil method was used for AUROC comparisons. Abbreviations: NLR, neutrophil-to-lymphocyte ratio; ACLF, acute-on-chronic liver failure; HBV-ACLF, hepatitis b related ACLF; AARC, Asian Pacific Society for the Study of the Liver ACLF research consortium.

Additional file 4

. Fig. S3: Prognostic performance of the AARC ACLFs and the mAARC ACLFs was compared using Kaplan-Meier (K-M) analysis in 204 patients with HBV-ACLF in the validation cohort, and was stratified for the performance of the AARC ACLFs using (a); for the performance of the mAARC ACLFs using (b). The mAARC ACLF score was calculated using three risk levels of baseline NLR (<3.10, 3.10–4.78, and >4.78) instead of corresponding levels of lactate (<1.5 mmol/L, 1.5–2.5 mmol/L, and >2.5 mmol/L). Abbreviations: ACLF, acute-on-chronic liver failure; HBV-ACLF, hepatitis b related ACLF; AARC ACLFs, Asian Pacific Society for the Study of the Liver ACLF research consortium ACLF score; mAARC ACLFs, modified AARC ACLFs.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, J., Guo, H., Yu, X. et al. A neutrophil-to-lymphocyte ratio-based prognostic model to predict mortality in patients with HBV-related acute-on-chronic liver failure. BMC Gastroenterol 21, 422 (2021). https://doi.org/10.1186/s12876-021-02007-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12876-021-02007-w

Keywords

BMC Gastroenterology

ISSN: 1471-230X

Contact us