Skip to main content
Download PDF

Quality assessment of Clinical Practice Guidelines (CPG) for the diagnosis and treatment of inflammatory bowel disease using the AGREE II instrument: a systematic review

BMC Gastroenterology volume 22, Article number: 447 (2022) Cite this article

Abstract

Background

The incidence and diagnosis of inflammatory bowel disease (IBD) has increased considerably in recent years. Many clinical practice guidelines (CPG) have been developed for the management of this disease across different clinical contexts, however, little evidence exists on their methodological quality. Therefore, we aimed to systematically evaluate the quality of CPGs for the diagnosis and treatment of IBD using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.

Methods

We identified CPGs by searching databases (MEDLINE - PubMed, EMBASE, CINAHL, LILACS) and other sources of gray literature on January 2022. We included guidelines with specific recommendations for the diagnosis and treatment of IBD and evaluated them with the AGREE II instrument to assess their methodological quality. Six independent reviewers assessed the quality of the guidelines and resolved conflicts by consensus. We assessed the degree of agreement using the intraclass correlation coefficient (ICC) and change in quality over time was appraised in two periods: from 2012 to 2017 and from 2018 to 2022.

Results

We analyzed and evaluated 26 CPGs that met the inclusion criteria. The overall agreement among reviewers was moderate (ICC: 0.74; 95% CI 0.36 - 0.89). The mean scores of the AGREE II domains were: “Scope and purpose” 84.51%, “Stakeholder involvement” 60.90%, “Rigor of development” 69.95%, “Clarity of presentation” 85.58%, “Applicability” 26.60%, and “Editorial independence” 62.02%. No changes in quality were found over time.

Conclusions

The quality of the CPGs evaluated was generally good, with a large majority of the assessed guidelines being “recommended” and “recommended with modifications”; despite this, there is still room for improvement, especially in terms of stakeholder involvement and applicability. Efforts to develop high quality CPGs for IBD need to be further optimized.

Peer Review reports

Introduction

Ulcerative colitis and Crohn’s disease are the main forms of inflammatory bowel disease (IBD). Both pathologies involve chronic inflammation of the gastrointestinal tract and show heterogeneity in terms of symptoms, which mainly include abdominal pain and diarrhea associated with malabsorption, weight loss and fever [1]. IBD involves periods of relapse and remission [2]. Although its etiology is unknown, it has been considered a multifactorial disease due to its association to genetic factors [3], immune mediators [4], changes in the intestinal microbiome [5] and exposure to various environmental agents [6].

The onset of IBD generally occurs around the third decade of life, but 25% of cases begin during childhood and adolescence [7]. The peak age of onset for Crohn’s disease is generally between 20 and 30 years of age, while Ulcerative Colitis usually begins at around 30 and 40 years of age [8].

The incidence and prevalence of IBD vary according to the geographic location, environment and ethnicity [9]. The latest reported data on the incidence of Ulcerative Colitis in North America and Europe ranged from 0 to 19.2 per 100,000 and 0.6 to 24.3 per 100,000, respectively [10]; whereas the prevalence of Ulcerative Colitis was 37.5 to 248.6 per 100,000 in North America and 4.9 to 505 per 100,000 in Europe [11]. For Crohn’s disease, the incidence varied from 0 to 20.2 per 100,000 in North America and from 0.3 to 12.7 per 100,000 in Europe [10]. In Latin America these data have considerable differences, however, in the last decades there has been a progressive increase with a prevalence of 0.99 to 44.3 per 100,000 inhabitants for Ulcerative Colitis and 0.24 to 16.7 per 100,000 inhabitants for Crohn’s disease [12, 13]. Epidemiological data suggest that the global incidence of IBD presents a marked increase, implying that the health systems of developing countries do not have the resources, health staff and infrastructure necessary for the diagnosis and treatment of the pathology.

Considering the increasing prevalence of IBD and its impacts in terms of health, society and economy (direct and indirect costs for the health systems and out-of-pocket expenses) [13], it is important to ensure high quality tools that facilitate its systematized treatment. For this reason, in the last decade, there have been important advances in terms of therapies for the management of IBD through pharmacological, non-pharmacological and surgical interventions [14, 15], these advances have been translated into several Clinical Practice Guidelines (CPG), which quality has not yet been assessed.

CPGs are systematically developed statements intended to help physicians and patients to make decisions about appropriate medical care in specific circumstances based on high-quality scientific evidence [16]. Their recommendations are intended to improve the quality of patient care by encouraging interventions of proven benefit and discouraging ineffective or potentially harmful interventions [16]. Several tools currently exist to assess the quality of a CPG and its implementation [17]; the AGREE (Appraisal of Guidelines, Research, and Evaluation) collaboration developed the AGREE II tool which is the most validated and widely used tool [18, 19]. This tool is helpful to assess the transparency in guidelines development and their quality, it provides a methodological strategy for guidelines development, and establishes a scheme for their reporting [20]. The AGREE II tool can be applied in Clinical Practice Guidelines (CPG) for diagnosis and medical interventions as well as for the evaluation of guidelines on health promotion, public health, among others [20].

Therefore, the main objective of this study is to systematically evaluate CPG for the diagnosis and treatment of IBD using the AGREE II tool, to provide evidence on their methodological quality and to assess changes in guideline quality over time.

Methods

Data Search

A systematic search was performed up to January 2022 to look for CPG on the diagnosis and treatment of IBD. CPGs were searched on databases (MEDLINE - PubMed, EMBASE, CINAHL, LILACS), professional societies (CAG, British Society of Gastroenterology, AGA, Brazilian Society of Gastroenterology), registries and guideline developers’ websites (NICE, SIGN). The full search strategy is detailed in Additional file 1.

Inclusion and exclusion criteria

We included: 1.- CPGs with specific recommendations for the diagnosis and treatment of IBD, both for Crohn’s disease (CD) and ulcerative colitis (UC); 2.- CPGs on IBD that included pediatric, young, adult, and elderly populations; 3. - CPGs that provide the full search strategy that was conducted; 4.- CPGs that mentioned the process how they reached recommendations; 6.- CPGs published without date restriction until January 2022; and 6.- Last published available version of CPGs. The following documents were excluded: 1.- CPGs exclusively dealing with other clinical scenarios such as diagnostics (e.g. endoscopic, imaging), nutrition, immunological or surgical interventions for IBD; 2.- secondary publications (e.g., systematic reviews and meta-analyses) and 3.- abstracts from CPGs.

Data Collection

Five reviewers working in pairs (DH, CMG, PA, RZ, RV) independently peer-screened the guidelines by title and abstract following the above inclusion and exclusion criteria. If the inclusion criteria were met, the full-text article were retrieved and screened by pairs for eligibility. All the screening process was performed using Rayyan (Rayyan Systems Inc) [21]. Two reviewers independently extracted the following data for each CPG: title, year of publication, submitting organization, type of funding, method used to collect evidence, number of sources documented, methods used to assess the quality and validity of the evidence, methods used to formulate the recommendations, country, and language. In case of disagreement, a third reviewer (VA, DSR) was involved.

Quality assessment

The AGREE II instrument [18,19,20, 22] was used to evaluate the quality of the included CPGs. This instrument provides criteria for assessing the quality of the clinical practice guidelines through 23 items or questions, divided into 6 domains or categories; including: 1.- scope and purpose, 2.- stakeholder involvement, 3.- rigor of development, 4.- clarity of presentation, 5.- applicability, and 6.- editorial independence. The first domain evaluates the general objective of the CPG, specific health aspects and the target population; the second domain refers to the degree to which the guideline has been developed by the appropriate stakeholders and represents the views of intended users; the third domain refers to the process used to gather and synthesize evidence, the methods used to formulate and update recommendations; the fourth domain focuses on the language, structure and format of the guideline; the fifth domain refers to barriers and facilitators to CPG implementation, strategies for its adoption and resource considerations; and finally, the sixth domain is about the formulation of recommendations, to understand whether they are biased by conflicts of interest [19].

Each of the 23 items or questions is classified on a 7-point Likert-type scale, 7 being the maximum score corresponding to “strongly agree” and 1 the minimum score corresponding to “strongly disagree”.

For the global guideline evaluation, we used a 3-point scale: 1 “not recommended”, 2 “recommended with modifications” and 3 “recommended”. Six reviewers (DH, CMG, PA, RZ, JAF, RV), with clinical and methodological expertise, independently peer-scored each of the 23 items of the 6 domains of the AGREE II instrument for each CPG that was included. In case of disagreements with the assessment, a consensus was reached with the support of a third reviewer (AV, DSR).

Statistical analysis

A descriptive analysis of the CPGs was performed using the general characteristics of each CPG from the extracted data. To calculate the score for each domain of the AGREE II tool, all item scores were summed up and the total value was standardized as a percentage of the maximum possible score for that domain, using the following formula:

$$\textrm{Standardized}\kern0.5em \textrm{score}\kern0.5em \left(\textrm{SP}\right)=\frac{\textrm{score}\kern0.5em \textrm{obtained}\kern0.5em \hbox{-} \kern0.5em \textrm{lowest}\kern0.5em \textrm{possible}\kern0.5em \textrm{score}}{\textrm{highest}\kern0.5em \textrm{possible}\kern0.5em \textrm{score}\kern0.5em \hbox{-} \kern0.5em \textrm{lowest}\kern0.5em \textrm{possible}\kern0.5em \textrm{score}}\times 100$$

With this method, the standardized score for each domain ranged from 0 to 100%. The result of the standardized score for each domain for all the guidelines is presented through the mean, median, first quartile (Q1), third quartile (Q3), interquartile range (IQR) and a boxplot. The degree of agreement between reviewers was assessed through the intraclass correlation coefficient (ICC) with a 95% confidence interval (CI). To visualize and compare the mean AGREE II scores obtained by the 26 CPGs assessed in this study, we generated a hexagonal radar graph where each domain is represented on a radial axis centered at 0 and the maximum score of each domain corresponds to each vertex of the hexagon. Finally, for the analysis of quality change over time, Student’s t-test was used to compare the means and categorize the CPGs into two periods: 2012 to 2017 and 2018 to 2022. Data analysis was performed in the statistical software RStudio v.1.4 [23] using the libraries ggplot2 [24], irr [25], tidyverse [26] and Table 1 [27].

Table 1 General characteristics of the CPGs
Full size table

Results

Guideline characteristics

Eight thousand seven hundred twenty-three records were retrieved from the search strategy and 8165 remained after deduplication. 203 records were subsequently screened by full-text, of which 26 CPGs were included for data extraction after meeting the inclusion criteria (Fig. 1). Details on the characteristics of the included CPGs are shown in Table 1 [28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53].

Fig. 1
figure 1

PRISMA flow diagram showing the flow of records that were obtained and reviewed throughout the different phases of the quality assessment

Full size image

Of the 26 included CPGs, four were from the United States (15.38%) and four were developed by an international collaboration (15.38%); three were from the United Kingdom, three from Canada and three from Japan (11.53% each), two were from Brazil and two from Mexico (7.69% each); one was from Germany, Israel, South Korea, the Netherlands and Poland (3.84% each). Included guidelines were published between 2012 and 2021 (see Table 1).

Three of the 26 guidelines focused exclusively on the pediatric population while the others were mainly focused on adults [29, 33, 51]. In terms of the scope of the CPGs, 22 dealt with diagnosis and clinical management [28,29,30, 32,33,34,35,36,37,38,39,40,41, 43,44,45, 47,48,49, 51,52,53], two with the use of biologic drugs only [42, 46], one with surgical management in the emergency setting [50] and one with the surgical management of ulcerative colitis [31]. All guidelines were considered evidence-based according to our a priori criteria.

Eighteen guidelines (69.23%) used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology to assess the quality of evidence and grade the strength of recommendations. Seven guidelines (26.92%) used the Oxford Centre for Evidence-Based Medicine criteria, and one guideline (3.84%) used a self-grading system to assess the quality of evidence (Table 1).

Quality assessment

The agreement between the 6 reviewers was moderate with an ICC of 0.74 (95% CI: 0.36-0.89, p-value = 6.83e−4). A summary of the ICCs achieved by each pair of reviewers is shown in Table 2.

Table 2 Intraclass correlation coefficients (ICC) by peer reviewers
Full size table

Figure 2 shows a boxplot summarizing the statistical analysis of the standardized scores for each domain assessed with the AGREE II tool. In addition, Table 3 shows the standardized scores for all domain assessed in each clinical practice guideline.

Fig. 2
figure 2

Distribution of standardized scores by domain for the 26 CPGs

Full size image
Table 3 Standardized scores by domains of AGREE II
Full size table

Domain 1: Scope and purpose

This domain evaluates the general objective of the CPG, specific health aspects and the target population [19]. The mean score was 84.51% (median: 90.27%, Q1: 78.47%, Q3: 94.44% and IQR = 15.97%; Fig. 2). Twenty-four CPGs (92.30%) scored above 60% in this domain [28, 29, 31,32,33,34,35,36, 38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53]. See Table 3 for details on domain 1.

Domain 2: Stakeholder involvement

This domain refers to the degree to which the guideline has been developed by the appropriate stakeholders and represents the views of intended users [19]. The mean score was 60.90% (median: 66.67%, Q1: 36.11%, Q3: 83.33% and IQR = 47.22%; Fig. 2). Fourteen CPGs (53.84%) scored above 60% in this domain [32, 38, 40, 41, 43,44,45, 47,48,49,50,51,52,53]. See Table 3 for details on domain 2.

Domain 3: Rigor of development

This domain refers to the process used to gather and synthesize evidence, the methods used to formulate and update recommendations [19]. The mean score was 69.95% (median: 69.79%, Q1: 58.07%, Q3: 86.20% and IQR = 28.12%; Fig. 2). Nineteen CPGs (73.07%) scored above 60% in this domain [28, 32,33,34, 36, 38,39,40,41, 43,44,45, 47,48,49,50,51,52,53]. See Table 3 for details on domain 3.

Domain 4: Clarity of presentation

This domain focuses on the language, structure and format of the guideline [19]. The mean score was 85.58% (median: 91.67%, Q1: 75.00%, Q3: 100.00% and IQR = 25%; Fig. 2). Twenty-four CPGs (92.30%) scored above 60% in this domain [28,29,30,31,32,33,34,35,36,37,38,39,40,41, 43,44,45, 47,48,49,50,51,52,53]. See Table 3 for details on domain 4.

Domain 5: Applicability

This domain refers to barriers and facilitators to CPG implementation, strategies for its adoption and resource considerations [19]. The mean score was 26.60% (median: 20.83%, Q1: 12.50%, Q3: 39.06% and IQR = 26.56%; Fig. 2). Only one CPG (3.84%) scored above 60% in this domain [38]. See Table 3 for details on domain 5.

Domain 6: Editorial Independence

This domain is about the formulation of recommendations, understand whether they are biased by conflicts of interest [19]. The mean score was 62.02% (median: 75.00%, Q1: 30.21%, Q3: 91.67% and IQR = 61.45%; Fig. 2). Sixteen CPGs (61.53%) scored above 60% in this domain [28, 32, 34, 35, 37, 38, 40, 41, 43,44,45, 47,48,49, 51, 53]. See Table 3 for details on domain 6.

Overall assessment

Seven out of the 26 evaluated CPGs (26.9%) were “recommended” by the independent reviewers [38, 40, 43, 44, 47, 49, 53]. Most of the CPGs, 15 guidelines (57.7%), were “recommended with modifications” [28, 29, 31,32,33,34,35,36, 39, 41, 45, 48, 50,51,52]. Finally, 4 CPGs (15.4%) were “not recommended” (see Table 3) [30, 37, 42, 46].

Combined assessment

Finally, in the radar plot analysis we observe that domains “scope and purpose”, “stakeholder involvement”, “rigor of development”, “clarity of presentation” and “editorial independence” show similar areas in the scores achieved; however, the domain “applicability” is notoriously deficient in all the evaluated guidelines (Fig. 3).

Fig. 3
figure 3

Radar chart of the mean standardized scores by domains of the 26 IBD CPGs assessed

Full size image

Quality assessment over time

With respect to quality change over time, no statistically significant differences were found for the means of the standardized scores for each AGREE II domain between the guidelines published during the 2012-2017 period and those published between 2018 and 2022 (Table 4).

Table 4 Quality changes over time
Full size table

Discussion

What do the findings of this study mean?

This review showed that the evaluated IBD CPGs had an acceptable quality based on the AGREE II instrument since 7 out of the 26 evaluated guidelines were “recommended”, 15 were “recommended with modifications” and only 4 were “not recommended”. The domains with the highest scores were “clarity of presentation” and “scope and purpose”, which reached values over 60%, indicating that most of the assessed guidelines had well-defined general and specific objectives, the population to which the guideline was intended to apply was well defined, and the recommendations were clearly described and identifiable. Rigor of development was the domain that received the third best score with 69.95%; this domain could be argued to have the greatest effect on the quality of a clinical practice guideline, since it has to do with the entire process used to formulate and construct the recommendations and it is the one that comprises the most items within AGREE II for its evaluation [54]. We consider that a score over 60% is more than acceptable for “rigor of development”, which achieved this score due to most guidelines were partly penalized for being unclear with the description of external experts’ assessment and for not having an explicit updating statement.

The domains “stakeholder involvement” and “editorial independence” obtained scores slightly over 60% (60.90 and 62.02%, respectively; Fig. 3), which indicates that the views and preferences of patients still need to be considered when the CPG is drafted and that an expert methodologist/epidemiologist should be included in the guideline drafting group. In addition, both domains achieved low scores due to the limited information most guidelines provided in terms of funding and its influence on the guidelines’ content, as well as the lack of detail they included regarding conflicts of interest and how these conflicts were dealt. Considering these limitations on the development of CPGs could contribute to their improvement.

The “applicability” domain was the worst scored domain in this review with an average score of 26.60% (Fig. 3), well below the 60% cut-off point for this domain. The main reason for this is that most guideline developers do not fully consider guideline’s implementation in terms of facilitators and barriers for guidelines’ applicability or they do not fully consider the resources and tools that are available in a specific context. We also noted that most of the guidelines did not consider the economic impact of their recommendations on resources and health budgets, for example, most guidelines did not include health economists in the guideline development group or did not perform cost-benefit analysis. The limitations and omissions that have been observed in the included guidelines restraint the translation of these documents into clinical practice, thus hindering its operability.

Regarding quality change over time, this study failed to demonstrate statistically significant differences between guidelines published during the 2012-2017 period versus guidelines published between 2018 and 2022 (see Table 4) for any domain covered by AGREE II. This finding may be due to the small sample size in this study, which is associated to the specific inclusion criteria applied in the selection of CPGs as well as the large variety of CPGs for IBD (clinical, surgical, preventive, etc.) we encountered when screening. In addition, the time ranges we compared were too short since guidelines’ development in terms of IBD and our study’s criteria has been an early activity. However, one point to highlight is the implementation and dissemination of the GRADE methodology in the development of guidelines, especially in those produced in the last 4 years; our study found that 17 out of the 26 included CPGs had used this methodology as a framework for grading the evidence and formulating their recommendations.

The context of this review with other literature

While this review is not the first to evaluate clinical practice guidelines on inflammatory bowel disease, it is the first to evaluate a large sample of CPGs as there was no date restriction in its search, which gave us a much broader picture of what has been produced in the past and current time. Thus, in line with other reviews of CPG for IBD conducted by other investigators, and addressing different contexts of inflammatory bowel disease, the domains with the highest scores were “clarity of presentation” and “scope and purpose” and the domains with the lowest scores were “stakeholder involvement” and “applicability” [55,56,57]. These results are also similar to previous CPG evaluations for other clinical-surgical areas such as interventional radiology, pediatrics or dermatology [58,59,60].

In addition, other studies that investigated quality changes over time for clinical practice guidelines in other specialties did not find evidence of significant changes in quality in the different evaluated periods of time [61,62,63]. These results are consistent with the findings of this study. However, studies by Bhatt et al. [64] for pediatric type II diabetes CPG and Acuña-Izcaray et al. [65] for asthma CPG, found statistically significant differences in quality over time for the selected periods for each individual domain, while a statistical significance has not been found for all domains at the same time.

Strengths and limitations

Although a strength of our systematic review was the broad and exhaustive approach of our search – carried out in databases, compiling entities and guideline developers, with a sensitive strategy designed for this purpose – it is possible that our review may have missed some CPGs that were not adequately indexed or that dealt with other contexts related to inflammatory bowel disease. Likewise, our study only included CPGs published in English or Spanish, factors that could have contributed to a potential selection bias.

Likewise, having chosen CPGs with well-defined inclusion criteria, it is likely that our results have overestimated the score obtained by selecting guidelines that would score higher than the entire possible universe of CPGs for IBD. Therefore, our conclusions acquire more relevance when evaluating this type of guidelines.

On the other hand, although the degree of agreement reached by the reviewers was moderate (ICC = 0.74), this may be due to the fact that the AGREE II instrument weights each item with a 7-point Likert-type scale, where only the extreme values of this scale are well defined, but it is prone to subjectivity for intermediate values 3, 4 and 5 on the scale. As our research had a large number of reviewers (six), reaching a higher value for the intraclass correlation coefficient (ICC) to improve reliability was difficult. However, we consider that the value achieved does provide adequate reliability [66].

In addition, since the implementation of the AGREE II tool in 2010, it has become the most widely used and popular resource for assessing the quality of CPGs, choosing a cut-off point above which a guideline can be defined as having good quality is subjective and this selection will depend on the context in which the review is being performed. As Brouwers et al. [67] noted, “there is no evidence that if a guideline exceeds a certain score, the recommendations are easier to adopt, or improve processes of care, or lead to better patient outcomes than guidelines that do not achieve that score”.( [67], p.195) That is, the validity of the overall assessment may be limited, as there are no clear rules yet on how to weigh the different domain scores to make a decision on whether or not to recommend guidelines.

What is new and conclusion

Overall, this study determined that the quality of clinical practice guidelines for the diagnosis and treatment of inflammatory bowel disease is acceptable and that there is still room for improvement, especially in terms of stakeholder participation (inclusion of patients, expert methodologists/epidemiologists) and applicability (enablers, barriers, optimization of resources, external review). It is desirable that guideline developers consider these shortcomings in the future for the overall improvement of guidelines’ quality to reduce clinical practice heterogeneity in IBD.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CPG:

Clinical practice guideline

AGREE:

Appraisal of Guidelines, Research, and Evaluation

GRADE:

Grading of Recommendations, Assessment, Development and Evaluation

NPRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

IBD:

Inflammatory bowel disease

CD:

Crohn’s disease

UC:

Ulcerative colitis

ICC:

Intraclass correlation coefficient

IQR:

Interquartile range

SD:

Standard deviation

Qi:

Quartile

CI:

Confidence interval

References

  1. Lamb CA, Kennedy NA, Raine T, Hendy PA, Smith PJ, Limdi JK, et al. British Society of Gastroenterology consensus guidelines on the management of inflammatory bowel disease in adults. Disponible en. 2019;68(3):1–106. https://doi.org/10.1136/gutjnl-2019-318484.

    Article  Google Scholar 

  2. Yamamoto-Furushoa K, Bosques-Padilla B, de-Paula J, Galiano MT, P. Ibañez P, Juliao F, et al. Diagnosis and treatment of inflammatory bowel disease: First Latin American Consensus of the Pan American Crohn's sand Colitis Organisation. Rev Mex Med. 2017;82(1):46–84. Available at:. https://doi.org/10.1016/j.rgmx.2016.07.003.

    Article  Google Scholar 

  3. Turpin W, Goethel A, Bedrani L, Croitoru K. Determinants of IBD Heritability: Genes, Bugs, and More. Inflamm Bowel Dis. 2018;24(6):1133–48.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Ahluwalia B, Moraes L, Magnusson MK, Öhman L. Immunopathogenesis of inflammatory bowel disease and mechanisms of biological therapies. Scand J Gastroenterol. 2018;53(4):379–89. Available from:. https://doi.org/10.1080/00365521.2018.1447597.

    Article  PubMed  Google Scholar 

  5. Glassner KL, Abraham BP. Current perspectives The microbiome and inflammatory bowel disease. J Allergy Clin Immunol. 2019;145(1):16–27. Available from:. https://doi.org/10.1016/j.jaci.2019.11.003.

    Article  CAS  Google Scholar 

  6. Preda CM, Manuc T, Istratescu D, Louis E, Baicus C, Sandra I, et al. Environmental Factors in Romanian and Belgian Patients with Inflammatory Bowel Disease - a Retrospective Comparative Study. Maedica (Buchar). 2019;14(3):233–9.

    Google Scholar 

  7. Colonnello V, Agostini A. Disease course, stress, attachment, and mentalization in patients with inflammatory bowel disease. Medical Hypotheses Rev Med Elsevier. 2020:140. Disponible en:. https://doi.org/10.1016/j.mehy.2020.109665.

  8. Malik TA. Inflammatory Bowel Disease Historical Perspective, Epidemiology, and Risk Factors. Rev Med Elsevier. 2015;95:1105–22. Disponible en:. https://doi.org/10.1016/j.suc.2015.07.006.

    Article  Google Scholar 

  9. Sambuelli A, Negreira S, Gil A, Goncalves S, Chavero P, Tirado P, et al. Management of inflammatory bowel disease. review and treatment algorithms. Acta Gastroenterol Latinoam. 2019;48(4):263–70.

    Google Scholar 

  10. Ananthakrishnan AN. Epidemiology and risk factors for IBD.Rev. Gastroenterol Hepatol. 2015;12:205–17.

    Google Scholar 

  11. Molodecky N, Shian S, Doreen M, Ghali W, Ferris M, Chernoff G, et al. Increasing Incidence and Prevalence of the Inflammatory Bowel Diseases with Time. Based Syst Rev Gastroenterol. 2012;142:46–54.

    Google Scholar 

  12. Calderón M, Minckas N, Nuñez S, Ciapponi A. Inflammatory Bowel Disease in Latin America: A Systematic Review. Value Health Reg Issues. 2018;17:126–34.

    Article  PubMed  Google Scholar 

  13. Kotze PG. Research in inflammatory bowel diseases in Latin America: a challenge ahead. Arq Gastroenterol. 2014;51:269–70.

    Article  PubMed  Google Scholar 

  14. Jeong D, Seung K, Min J, Chei Y, Jong K, Kronbichler A, et al. Induction and maintenance treatment of inflammatory bowel disease: a comprehensive review. Rev Elsevier. 2019;T8:439–54.

    Google Scholar 

  15. Michel A, Bonovas S, Raine T, Spinelli A, Warusavitarne J, Armuzzi A, etal. ECCO guidelines on therapeutics in Crohn's disease: surgical treatment.2020; 14 (2): 155-168.

  16. Murad MH. Clinical Practice Guidelines: A Primer on Development and Dissemination. Mayo Clin Proc. 2017;92(3):423–33. Available from:. https://doi.org/10.1016/j.mayocp.2017.01.001.

    Article  PubMed  Google Scholar 

  17. Haile ZT. Critical Appraisal Tools and Reporting Guidelines for Evidence-Based Practice. J Hum Lact. 2021;1–10.

  18. AGREE Next Steps Consortium (2009). The AGREE II Instrument Electronic version. Retrieved "August 18, 2021," from https://www.agreetrust.org/wp-content/uploads/2013/06/AGREE_II_Spanish.pdf.

  19. AGREE tools. Agreetrust.org. 2013 [citado el 18 de agosto de 2021]. Disponible en: https://www.agreetrust.org/resource-centre/.

  20. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: Advancing guideline development, reporting, and evaluation in health care. Prev Med (Baltim). 2010;51(5):421–4.

    Article  Google Scholar 

  21. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan — a web and mobile app for systematic reviews. Systematic Reviews. 2016;5:210. https://doi.org/10.1186/s13643-016-0384-4.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Brouwers MC, Kerkvliet K. Spithof K. The AGREE reporting checklist: A tool to improve reporting of clinical practice guidelines. BMJ; 2016. p. 352.

    Google Scholar 

  23. Allaire J. RStudio: Integrated Development Environment for R: RStudio; 2021. Disponible en: https://www.rstudio.com. citado 17 enero 2022.

    Google Scholar 

  24. Kassambara A. ggpubr: 'ggplot2' Based Publication Ready Plots: Cran R project.org; 2020. Disponible en: https://cran.r- project.org/web/packages/ggpubr/index.html. citado 17 enero 2022.

    Google Scholar 

  25. Gamer M, Lemon J, Fellows I, Singh P. Package ‘irr’. Various Coefficients of Interrater Reliability and Agreement. 2012. Disponible en: https://cran.r-project.org/web/packages/irr/irr.pdf. citado 18 marzo 2022.

    Google Scholar 

  26. Wickham H. tidyverse: Easily Install and Load the 'Tidyverse': cran.r-project; 2021. Disponible en: https://cran.r-project.org/web/packages/tidyverse/index.html. citado 18 marzo 2022.

    Google Scholar 

  27. Rich B. Using the table 1 Package to Create HTML Tables of Descriptive Statistics. cran.r-project. 2021 [citado 14 marzo 2022]. Disponible en: https://cran.r-project.org/web/packages/table1/vignettes/table1-examples.html.

  28. Ko CW, Singh S, Feuerstein JD, Falck-Ytter C, Falck-Ytter Y, Cross RK, et al. AGA Clinical Practice Guidelines on the Management of Mild-to-Moderate Ulcerative Colitis. Gastroenterology. 2019;156(3):748–64.

    Article  PubMed  Google Scholar 

  29. Levine A, Koletzko S, Turner D, Escher JC, Cucchiara S, De Ridder L, et al. ESPGHAN revised porto criteria for the diagnosis of inflammatory bowel disease in children and adolescents. J Pediatr Gastroenterol Nutr. 2014;58(6):795–806.

    Article  CAS  PubMed  Google Scholar 

  30. Lichtenstein GR, Loftus EV, Isaacs KL, Regueiro MD, Gerson LB, Sands BE. ACG Clinical Guideline: Management of Crohn’s Disease in Adults. Am J Gastroenterol. 2018;113(4):481–517.

    Article  PubMed  Google Scholar 

  31. Adamina M, Angriman I, Bemelman WA, Biancone L, D’Hoore A, van Overstraeten A d B, et al. European evidence based consensus on surgery for ulcerative colitis. J Crohn’s Colitis. 2015;9(1):4–25. Available from:. https://doi.org/10.1016/j.crohns.2014.08.012.

    Article  Google Scholar 

  32. Preiß JC, Bokemeyer B, Buhr HJ, Dignaß A, Häuser W, Hartmann F, et al. Updated German clinical practice guideline on Diagnosis and treatment of Crohn disease. Gastroenterol. 2014;52(12):1431–84. Available from:. https://doi.org/10.1055/s-0034-1385199.

    Article  Google Scholar 

  33. Ruemmele FM, Veres G, Kolho KL, Griffiths A, Levine A, Escher JC, et al. Consensus guidelines of ECCO/ESPGHAN on the medical management of pediatric Crohn’s disease. J Crohn’s Colitis. 2014;8(10):1179–207. Available from:. https://doi.org/10.1016/j.crohns.2014.04.005.

    Article  CAS  Google Scholar 

  34. Turner D, Ruemmele FM, Orlanski-Meyer E, Griffiths AM, De Carpi JM, Bronsky J, et al. Management of paediatric ulcerative colitis, part 1: Ambulatory Care-An Evidence-based Guideline From European Crohn’s and Colitis Organization and European Society of Paediatric Gastroenterology, Hepatology and Nutrition. J Pediatr Gastroenter Nutr. 2018;67:257–91.

  35. Ueno F, Matsui T, Matsumoto T, Matsuoka K, Watanabe M, Hibi T. Evidence-based clinical practice guidelines for Crohn’s disease, integrated with formal consensus of experts in Japan. J Gastroenterol. 2013;48(1):31–72.

    Article  PubMed  Google Scholar 

  36. Yamamoto-Furusho JK, Bosques-Padilla F, de-Paula J, Galiano MT, Ibañez P, Juliao F, et al. Diagnosis and treatment of inflammatory bowel disease: First Latin American Consensus of the Pan American Crohn's and Colitis Organisation. Rev Gastroenterol Mex. 2017;82(1):46–84.

    CAS  PubMed  Google Scholar 

  37. Yamamoto-Furusho JK, Gutiérrez-Grobe Y, López-Gómez JG, Bosques-Padilla F, Rocha-Ramírez JL. The Mexican consensus on the diagnosis and treatment of ulcerative colitis. Rev Gastroenterol Mex. 2018;83(2):144–67. Available from:. https://doi.org/10.1016/j.rgmx.2017.08.006.

    Article  CAS  Google Scholar 

  38. National Institute for Health and Clinical Excellence. Crohn’s disease - NICE clinical guideline 152. 2012;(October):34.

  39. Choi CH, Moon W, Kim YS, Kim ES, Lee BI, Jung Y, et al. Second Korean Guideline for the Management of Ulcerative Colitis. Korean J Gastroenterol. 2017;69(1):1–28.

    Article  PubMed  Google Scholar 

  40. Feuerstein JD, Isaacs KL, Schneider Y, Siddique SM, Falck-Ytter Y, Singh S, et al. AGA Clinical Practice Guidelines on the Management of Moderate to Severe Ulcerative Colitis. Gastroenterology. 2020;158(5):1450–61.

    Article  PubMed  Google Scholar 

  41. Matsuoka K, Kobayashi T, Ueno F, Matsui T, Hirai F, Inoue N, et al. Evidence-based clinical practice guidelines for inflammatory bowel disease. J Gastroenterol. 2018;53(3):305–53. Available from:. https://doi.org/10.1007/s00535-018-1439-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Vieira Teixeira F, Garcia Vilela E, Mourão Cintra Damião AO, Vieira A, De Albuquerque IC, Luz Parente JM, et al. Ulcerative colitis - treatment with biologicals. Rev Assoc Med Bras. 2019;65(4):547–53.

    Article  Google Scholar 

  43. Lamb CA, Kennedy NA, Raine T, Hendy PA, Smith PJ, Limdi JK, et al. British Society of Gastroenterology consensus guidelines on the management of inflammatory bowel disease in adults. Gut. 2019;68:s1–106.

    Article  PubMed  Google Scholar 

  44. Mack DR, Benchimol EI, Critch J, deBruyn J, Tse F, Moayyedi P, et al. Canadian Association of Gastroenterology Clinical Practice Guideline for the Medical Management of Pediatric Luminal Crohn’s Disease. Gastroenterology. 2019;157(2):320–48.

    Article  PubMed  Google Scholar 

  45. Steinhart AH, Panaccione R, Targownik L, Bressler B, Khanna R, Marshall JK, et al. Clinical practice guideline for the medical management of perianal fistulizing Crohn’s disease: The Toronto consensus. Inflamm Bowel Dis. 2019;25(1):1–13.

    Article  PubMed  Google Scholar 

  46. Zaltman C, Amarante H, Brenner MM, Magalhaes Costa MH, Flores C, Franco Leal R, et al. Crohn’s disease - treatment with biological medication. Rev Assoc Med Bras. 2019;65(4):554–67.

    Article  PubMed  Google Scholar 

  47. Panaccione R, Steinhart AH, Bressler B, Khanna R, Marshall JK, Targownik L, et al. Canadian Association of Gastroenterology Clinical Practice Guideline for the Management of Luminal Crohn’s Disease. Clin Gastroenterol Hepatol. 2019;17(9):1680–713.

    Article  PubMed  Google Scholar 

  48. Nakase H, Uchino M, Shinzaki S, Matsuura M, Matsuoka K, Kobayashi T, et al. Evidence-based clinical practice guidelines for inflammatory bowel disease 2020. J Gastroenterol. 2021;56(6):489–526. Available from:. https://doi.org/10.1007/s00535-021-01784-1.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Feuerstein JD, Ho EY, Shmidt E, Singh H, Falck-Ytter Y, Sultan S, et al. AGA Clinical Practice Guidelines on the Medical Management of Moderate to Severe Luminal and Perianal Fistulizing Crohn’s Disease. Gastroenterology. 2021;160(7):2496–508.

    Article  PubMed  Google Scholar 

  50. De Simone B, Davies J, Chouillard E, Di Saverio S, Hoentjen F, Tarasconi A, et al. WSES-AAST guidelines: management of inflammatory bowel disease in the emergency setting. World J Emerg Surg. 2021;16(1):1–27.

    Article  Google Scholar 

  51. Van Rheenen PF, Aloi M, Assa A, Bronsky J, Escher JC, Fagerberg UL, et al. The Medical Management of Paediatric Crohn’s Disease: An ECCO-ESPGHAN Guideline Update. J Crohn's Colitis. 2021;15(2):171–94.

    Article  Google Scholar 

  52. Łodyga M, Eder P, Gawron-Kiszka M, Dobrowolska A, Gonciarz M, Hartleb M, et al. Guidelines for the management of patients with Crohn’s disease. Recommendations of the Polish Society of Gastroenterology and the Polish National Consultant in Gastroenterology. Prz Gastroenterol. 2021;16(4):257–96.

    PubMed  PubMed Central  Google Scholar 

  53. Torres J, Bonovas S, Doherty G, Kucharzik T, Gisbert JP, Raine T, et al. ECCO guidelines on therapeutics in Crohn’s disease: Medical treatment. J Crohn's Colitis. 2020;14(1):4–22.

    Article  Google Scholar 

  54. Hoffmann-Eßer W, Siering U, Neugebauer EAM, Brockhaus AC, McGauran N, Eikermann M. Guideline appraisal with AGREE II: Online survey of the potential influence of AGREE II items on overall assessment of guideline quality and recommendation for use. BMC Health Serv Res. 2018;18(1):1–9.

    Article  Google Scholar 

  55. Cheng H, Ma Z, Yu B, Liu X, Tian C, Zhong X, et al. Quality assessment of clinical guidelines on probiotics therapy in children with IBD using the AGREE II instrument. J Clin Pharm Ther. 2021;46(4):1155–65.

    Article  PubMed  Google Scholar 

  56. Wang X, Yang YM, Yang T, An LY, Chen XZ, Qi YX, et al. Evaluation of pharmacotherapy recommendations in guidelines for inflammatory bowel disease. J Clin Pharm Ther. 2021;46(3):599–609.

    Article  PubMed  Google Scholar 

  57. Xiao BH, Ma XD, Lv JJ, Yang T, Liu XJ, An LY, et al. Systematic evaluation of the diagnostic approach of inflammatory bowel disease guidelines. Int J Clin Pract 2021;75(10):0–1.

  58. Zanardo M, Gerasia R, Giovannelli L, Scurto G, Cornacchione P, Cozzi A, et al. A critical appraisal of the quality of guidelines for radiation protection in interventional radiology using the AGREE II tool: A EuroAIM initiative. Eur J Radiol. 2021;143(May):109906. Available from:. https://doi.org/10.1016/j.ejrad.2021.109906.

    Article  PubMed  Google Scholar 

  59. Chiappini E, Bortone B, Galli L, De MM. Guidelines for the symptomatic management of fever in children: Systematic review of the literature and quality appraisal with AGREE II. BMJ Open. 2017;7(7):1–10.

    Article  Google Scholar 

  60. Werner RN, Marinovic B, Rosumeck S, Strohal R, Haering NS, Weberschock T, et al. The quality of European dermatological guidelines: Critical appraisal of the quality of EDF guidelines using the AGREE II instrument. J Eur Acad Dermatology Venereol. 2016;30(3):395–403.

    Article  CAS  Google Scholar 

  61. Simancas-Racines D, Montero-Oleas N, Vernooij R, Arevalo-Rodriguez I, Fuentes P, Gich I, et al. Quality of clinical practice guidelines about red blood cell transfusion. J Evid Based Med. 2018;12(2):113–24.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Barajas-Nava L, Solà I, Delgado-Noguera M, Gich I, Villagran CO, Bonfill X, et al. Quality assessment of clinical practice guidelines in perioperative care: A systematic appraisal. Qual Saf Heal Care. 2010;19(6).

  63. Hayawi LM, Graham ID, Tugwell P, Yousef S. Screening for osteoporosis: A systematic assessment of the quality and content of clinical practice guidelines, using the AGREE II instrument and the IOM Standards for Trustworthy Guidelines. PLoS ONE. 2018;13:12.e0208251. https://doi.org/10.1371/journal.pone.0208251 PLoS One 2019;14(4):1–24.

    Article  Google Scholar 

  64. Bhatt M, Nahari A, Wang PW, Kearsley E, Falzone N, Chen S, et al. The quality of clinical practice guidelines for management of pediatric type 2 diabetes mellitus: A systematic review using the AGREE II instrument 11 Medical and Health Sciences 1117 Public Health and Health Services. Syst Rev. 2018;7(1):1–27.

    Google Scholar 

  65. Acuña-Izcaray A, Sánchez-Angarita E, Plaza V, Rodrigo G, De Oca MM, Gich I, et al. Quality assessment of asthma clinical practice guidelines: A systematic appraisal. Chest. 2013;144(2):390–7.

    Article  PubMed  Google Scholar 

  66. Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15(2):155–63. Available from:. https://doi.org/10.1016/j.jcm.2016.02.012.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Brouwers MC, Spithoff K, Lavis J, Kho ME, Makarski J, Florez ID. What to do with all the AGREEs? The AGREE portfolio of tools to support the guideline enterprise. J Clin Epidemiol. 2020;125:191–7. Available from:  https://doi.org/10.1016/j.jclinepi.2020.05.025.

Download references

Acknowledgements

We thank the University UTE and the Center for Research in Public Health and Epidemiology (CISPEC) for their support, collaboration and work in the editorial process of this publication.

Funding

This research study has not received any funding from the public or private sector or from any non-profit entity.

Author information

Authors and Affiliations

  1. Maestría en Epidemiología con mención en Investigación Clínica Aplicada. Facultad de Ciencias de la Salud Eugenio Espejo, Universidad UTE, Quito, Ecuador

    R. Zambrano-Sánchez & P. Alvarez-Mena

  2. Internal medicine service, NMMC Hamilton, Hamilton, AL, USA

    D. Hidalgo

  3. Research Department. Instituto Universitario Hospital Italiano de Buenos Aires, Buenos Aires, Argentina

    C. M. Escobar Liquitay

  4. Institute of General Practice, Heinrich-Heine-University Düsseldorf, Düsseldorf, Germany

    J. V. A. Franco

  5. Department of Nephrology and Hypertension, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands. Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands

    R. W. M. Vernooij

  6. Centro de Investigación en Salud Pública y Epidemiologia Clínica (CISPEC), Facultad de Ciencias de la Salud Eugenio Espejo. Universidad UTE, Rumipamba and Bourgeois, Universidad UTE, 170147, Quito, Ecuador

    D. Simancas-Racines, A. Viteri-García & C. Montesinos-Guevara

Authors
  1. R. Zambrano-Sánchez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. Alvarez-Mena
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. D. Hidalgo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. C. M. Escobar Liquitay
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. J. V. A. Franco
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. R. W. M. Vernooij
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. D. Simancas-Racines
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. A. Viteri-García
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. C. Montesinos-Guevara
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

DH, AV-G and CM-G conceived the idea for this research and designed the study. RZ-S, PA-M, CM-G and CME-L searched the literature. DH, CM-G, RZ-S, PA-M and RV screened and selected the guidelines according to the inclusion criteria. DH, CM-G, RZ-S, PA-M, JAF and RV rated and evaluated the guidelines with the AGREE II tool. RZ-S and PA-M conducted the statistical analysis and interpreted the results. RZ-S, PA-M and CM-G wrote the first draft of the report. CM-G, JAF, DS-R, CME-L, RV, AV-G contributed to the review and approved the final manuscript. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to C. Montesinos-Guevara.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zambrano-Sánchez, R., Alvarez-Mena, P., Hidalgo, D. et al. Quality assessment of Clinical Practice Guidelines (CPG) for the diagnosis and treatment of inflammatory bowel disease using the AGREE II instrument: a systematic review. BMC Gastroenterol 22, 447 (2022). https://doi.org/10.1186/s12876-022-02539-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12876-022-02539-9

Keywords

BMC Gastroenterology

ISSN: 1471-230X

Contact us