- Research article
- Open Access
- Open Peer Review
An appraisal of clinical practice guidelines for constipation: a right attitude towards to guidelines
BMC Gastroenterologyvolume 16, Article number: 52 (2016)
Clinical practice guidelines (CPGs) are formally developed statements that assist users to provide proper health care for a kind of disease and play a significant contribution in healthcare system. This study report the methodological quality of CPGs on constipation.
The “Appraisal of Guidelines and Research and Evaluation” (AGREEII) instrument was developed to determine the quality of CPGs. A comprehensive search was developed using five databases and three guideline websites until/up to December, 2015. Four independent authors evaluated the methodological issues of the CPGs by the AGREEII instrument.
We identified 22 relevant guidelines on constipation from 1234 citations. The overall agreement among evaluators was 0.84 using the intra-class correlation coefficient. The mean AGREEII scores for the domains “scope and purpose” (51.77) and “rigor of development” (56.73) were moderate; afterward, three domains “stakeholder involvement” (32.23), “editorial independence” (29.59) and “applicability” (29.14) were low scores. The “clarity and presentation” (23.73) had the lowest scores.
Although existing constipation guidelines may accurately reflect current clinical practices, many guidelines’ methodological quality is low. Therefore, more emphasis and attentions should be taken to the development of high-quality guidelines.
Constipation is a disorder defined by incomplete defecation, and/or infrequent bowel movements which associated with persistent difficult and/or painful defecation, fecal incontinence, and abdominal pain . It is a common clinical functional diseases. The worldwide constipation surveys show a wide range of prevalence rates between 1 % and >20 % in western populations, although, a recent epidemiological reports found 16 % general adult populations were constipation . Constipation may be found for up to 20 % of community-dwelling elderly individuals. Moreover the incidence of functional constipation in childhood estimated 3 % .
Because of its high disease burden, the treatment of constipation has become an important issue for clinicians and patients. During the last two decade there were more than 20 developed clinical practice guidelines (CPGs) to manage the constipation. The main role of the CPGs is to give clear recommendations to help clinicians make appropriate clinical decision for specific clinical circumstance [4, 5].
However, not all guidelines are developed with the same methodologically rigorous approaches, there is no research for evaluating the quality of CPGs on constipation so far. With the above in mind, the objectives of the present study was to systematically review guidelines using the appraisal of guidelines for research and evaluation (AGREEII) instrument related to constipation .
An electronic literature search using multiple databases (PubMed, EMBASE, The China Journal Full-text Database, Chinese Biomedical Literature Database, Chinese Scientific Journals Full-text Database), and guideline website or databases—including the Guidelines International Network (GIN) Database, the National Guideline Clearinghouse (NGC), National Institute for Health and Care Excellence (NICE), Scottish Intercollegiate Guidelines Network (SIGN), National Comprehensive Cancer Network (NCCN) was conducted limited to Chinese and English from the inception to May 2015. MeSH terms and text words “guideline, consensus, recommendation, criteria, statement, constipation” for constipation and guidelines were used within the MEDLINE database. The same search strategy was made applicable for the other databases or websites.
Guideline selection and data extraction
Four reviewers (THL,DC,LN,GJF) independently extracted the guidelines which met the characteristics (for example, a clear guideline definition as proposed by the institute of Medicine , focused exclusively on constipation disease). We constructed a standard form table to extract the data of guidelines. Four reviewers extracted data separately, disagreements were discussed or by a fifth reviewer (GXL) if no consensus was reached.
Quality appraisal and recommendation
We evaluated the twenty-two included CPGs quality by AGREEII instrument . The instrument includes a 23-item tool comprising six quality domains. The four authors read the entire AGREEII handbook and then independently rated all included guidelines using formula as follows:
According to the handbook for use of the AGREEII instrument, the six domain scores were considered independently. Finally, a guideline is labelled as “strongly recommended” if most domain scores are greater than 60 %. Guideline is “recommended” when most scores are between 30 % and 60 %. A guideline is labelled as “not recommended” when most domain scores are less than 30 % .
A descriptive study of item frequency was carried out and the AGREEII domain scores calculated as means. Intra-class correlation coefficients (ICCs) is a measure of the reliability of measurements or ratings within each domain . Statistically significant was considered if p value less than 0.05.
Results and discussion
Figure 1 shows how we screened the guidelines, we preliminary search found 1234 citations, 35 were excluded because they were duplicate citations. By screening their titles and abstracts and 1,146 citations were ineligible as they didn’t meet the characteristics of constipation CPGs, 31 articles were excluded from the left 53 studies as following: eight were duplicates, seven were not in English or Chinese, 14 were guidelines not related to constipation, and 2 guidelines were the old version. Finally, a total of 22 guidelines were included [9–31].
The summary of CPGs baseline data were shown in Table 1. The twenty-two CPGs published between 2000 and 2014. Of the 22 selected CPGs, half of were from north America (America and Canada), six from European (UK, Ireland, Italy, Sweden) and the remaining five were from Asia (two from China, one from Korea, one from Indonesia and one multi-national),respectively. The scope of the CPRs varied: one guideline topic covered prevention, diagnosis and treatment of constipation ; two focused only on prevention and treatment [14, 16]; 16 covered diagnosis and treatment [9, 12, 13, 15, 17–19, 21–29]; three only focused on treatment [10, 20, 30] and one focused on prevention . CPGs cited a range of number of references (range: 0–364, mean: 78) and were of varying length (mean number of pages = 25, range: 5–255). Each of the domains being evaluated using the AGREEII appraisal (Table 2). The ICCs score was moderate among raters (0.84; 95 % CI, 0.56–0.86).
Appraisal of guidelines
Scope and purpose is concerned with the overall aim of the guideline, the specific health questions, and the target population (items 1–3) . This domain’s mean score was 51.77 %, and nine of the guidelines (47.62 %) scored below 50 % [9, 10, 12, 21, 22, 25, 26, 29, 31].
Stakeholder involvement focuses on the extent to which the guideline was developed by the appropriate stakeholders and represents the views of its intended users (items 4–6) . Of all AGREEII domains, this domain received the lowest scores (23.73 %) with only one CPG scoring over 50 %. Eighteen CPGs had been developed by a multi-disciplinary organization (81.82 %) [9, 11, 13–30].
Rigor of development criteria relates to the process used to gather and synthesize the evidence, the methods to formulate the recommendations, and to update those (items 7–14) . Overall, the mean score for this domain was only 32.23 % (range, 3 % to 66 %), with 18 CPGs scoring < 50 %. Meanwhile, only five CPGs reported systematic evidence searching [12, 16, 18, 27, 30], and Just 40.90 %(9/22) guidelines provided the methods for formulating the recommendations [11–16, 26, 27, 29]. Moreover, an explicit link between the recommendations and the evidence were explicit in 20/22 of the guidelines and only five guidelines described a procedure about updating [11, 13, 21, 27, 29].
Clarity of presentation deals with the language, structure, and format of the guideline (items 15–17) . The mean score for this domain was 56.73 % (range, 36 % to 83 %). Most CPGs provided a concrete and precise description of key recommendations with only eight guidelines scoring less than 50 % [9, 10, 14, 22, 25, 26, 30, 31].
Applicability pertains to the likely barriers and facilitators to implementation, strategies to improve uptake, and resource implications of applying the guideline (items 18–21) . This domain’s score was 29.14 % (range, 10 % to 58 %) and only three CPGs scored > 50 % [11, 18, 20]. A total of 10 CPGs discussed barriers to implementing the guideline’s recommendations [11, 13, 14, 16, 18, 20, 21, 29–31] and 7 guideline provides advice and/or tools on how the recommendations can be put into practice [11, 16, 18, 20, 29–31]. Resource implications were not explicitly discussed, only five CPGs offered cost implications [11, 18, 20, 29, 30].
Editorial independence is concerned with the formulation of recommendations not being unduly biased with competing interests (items 22–23) . The mean score for this domain was 29.59 %. Fifteen guidelines scored below 50 %. Most (63.64 %) guidelines did not provide the information whether they received funding or not [9–11, 13, 14, 16–18, 20–22, 25, 26, 29].
Guidelines were graded by the overall assessment. Only two CPGs can be strongly recommended [11, 18]. Eight can be recommended with provisions or alterations because of the most domains scoring between 30 % and 60 % [13, 14, 16, 19, 20, 27, 28, 30]. The remaining 12 CPGs were labelled as ‘not recommended’ due to the poor domain scores [9, 10, 12, 15, 17, 21–26, 31] (Table 2).
Stratification of CPG quality
In order to examine which factors may have impacted quality scores in the six domains, we stratified the data on the following variables (guideline area, AGREEII publication date, publication type, working group, comprehensive search or not, fund support or not, and evidence-based or not) in Table 3. We didn’t find the difference in six domains quality related to publication year of AGREEII (before or after 2010). Meanwhile, guidelines published in guideline databases were significantly have a higher scores than that in journals. The scores from CPGs developed by medical societies were higher when compared with individuals for the following items: Scope &Purpose, Stakeholders, Rigour, and Applicability. If CPGs were evidence-based, those three domains (Rigour, Applicability and Editorial independence) would have a higher scores. Apart from above, we found no differences in the rest of the comparisons.
We conducted a comprehensive assessment of the quality of CPGs for constipation. In general, these guidelines existed many deficits. Most of the guidelines had a low score in the following (domain 2, domain 3, domain 5 and domain 6). Table 4 showed that the scores results when compared with international CPGs level .
According to the results, the mean score of domain 3 received only 32.23 %. Methods of the search and the criteria for choose evidence must be clearly described. Meanwhile, the contents of health benefits and risks, externally reviewed by experts should be provided. In order to improve the score of domain 3, particular attention should be paid in above shortcomings.
There were only 2 CPGs included guideline developing experts in the panel [11, 18]. What’s more, no patients was invited to participate in the development term. The domain 5 “applicability” have an important role in the CPGs promotion, it should provide advice and/or tools on how the recommendations can be put into practice. These low scores reflect that CPG producers remain have much work to be done to improve guideline applicability.
Lastly, the scores in the domain 6 were less than 30 %. Many guidelines are developed with external funding, the name of the funding body and a statement that the funding body did not influence the content of the guideline should be explicit consideration . What’s more, there should be a clearly declaration that competing interests of guideline development group members have been recorded and addressed. Therefore, conflict of interests need to be clearly stated.
There are two guidelines which we want to recommend strongly due to their high overall quality developed by Registered Nurses Association of Ontario-Professional Association (RNAOPA)  and an Italian guideline by the National Collaborating Centre for Women‘s and Children‘s Health (NCC-WCH) . The detailed recommendations were listed in Table 5. Eight of twenty-two guidelines can be reported with provisos and alterations [13, 14, 16, 19, 20, 27, 28, 30], while the remaining 12 CPGs could not be recommended because most domain scores below 30 % [9, 10, 12, 15, 17, 21–26, 29–31].
However, our evaluation has several limitations. First, AGREEII rarely suggest how guidelines should select topics. To be useful, guidelines should address the challenges that clinicians face in practice, but developers may exclude clinically important topics when available evidence does not meet minimum standards. Second, inclusion criteria have a language restriction (English and Chinese), language search bias might happen. Third, we used only the AGREEII instrument evaluated the CPGs other than instruments may bring some selection bias . AGREEII instrument have been introduced from 2010, frankly speaking, guidelines published before 2010 did not have access to AGREEII to comply with it. Unfortunately, there is no difference when we compare the six domains quality before and after 2010. We can find even if methodological requirements for CPGs are reported comply with these remains unsatisfactory. What’s more, how to spread the CPGs preferable is essential for clinical practice . Through above specific methodological quality analysis, which can effectively promote the development of future constipation CPGs.
The results find that the quality of CPGs for constipation is poor. Guideline quality may be improved if we comply with the AGREEII instrument.
Liem O, Harman J, Benninga M, Kelleher K, Mousa H, Di Lorenzo C. Health utilization and cost impact of childhood constipation in the United States. J Pediatr. 2009;154:258–62.
Wong SW, Lubowski DZ. Slow-transit constipation: evaluation and treatment. ANZ J Surg. 2007;77:320–8.
van den Berg MM, Benninga MA, Di Lorenzo C. Epidemiology of childhood constipation: a systematic review. Am J Gastroenterol. 2006;101:2401–9.
Field MJ, Lohr LK. Clinical practice guidelines; directions for a new program. Washington: National Academy Press; 1990.
Lo Vecchio A, Giannattasio A, Duggan C, De Masi S, Ortisi MT, Parola L, et al. Evaluation of the quality of guidelines for acute gastroenteritis in children with the AGREE instrument. J Pediatr Gastroenterol Nutr. 2011;52:183–9.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G; AGREE Next Steps Consortium. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010;18:E839–42.
Schmidt S, Follmann M, Malek N, Manns MP, Greten TF. Critical appraisal of clinical practice guidelines for diagnosis and treatment of hepatocellular carcinoma. J Gastroenterol Hepatol. 2011;26:1779–86.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;2:420–8.
Locke 3rd GR, Pemberton JH, Phillips SF. American Gastroenterological Association Medical Position Statement: guidelines on constipation. Gastroenterol. 2000;119:1761–6.
Folden SL. Practice guidelines for the management of constipation in adults. Rehabil Nurs. 2002;27:169–75.
Registered Nurses’ Association of Ontario. Prevention of Constipation in the Older Adult Population. (Revised). Toronto, Canada: Registered Nurses’ Association of Ontario; 2005. www.rnao.org/bestpractices. Accessed 24 May 2014.
Bleser S, Brunton S, Carmichael B, Olden K, Rasch R, Steege J. Management of chronic constipation: recommendations from a consensus panel. J Fam Pract. 2005;54:691–8.
Constipation Guideline Committee of the North American Society for Pediatric Gastroenterology, Hepatology and Nutrition. Evaluation and treatment of constipation in infants and children: recommendations of the North American Society for Pediatric Gastroenterology, Hepatology and Nutrition. J Pediatr Gastroenterol Nutr. 2006;43:e1–13.
Woolery M, Bisanz A, Lyons HF, Gaido L, Yenulevich M, Fulton S, et al. Putting evidence into practice: evidence-based interventions for the prevention and management of constipation in patients with cancer. Clin J Oncol Nurs. 2008;12:317–37.
Larkin PJ, Sykes NP, Centeno C, Ellershaw JE, Elsner F, Eugene B; European Consensus Group on Constipation in Palliative Care. The management of constipation in palliative care: clinical practice recommendations. Palliat Med. 2008;22:796–807.
McKay SL, Fravel M, Scanlon C. Management of constipation. Iowa City: University of Iowa Gerontological Nursing Interventions Research Center, Research Translation and Dissemination Core; 2009. p. 10.51.
Indonesian Society of Gastroenterology (ISG). National consensus on the management of constipation in Indonesia. Acta Med Indones. 2010;43:267–74.
National Collaborating Centre for Women’s and Children’s Health (UK). Constipation in children and young people: diagnosis and management of idiopathic childhood constipation in primary and secondary care. London: RCOG; 2010. National Institute for Health and Clinical Excellence: Guidance.
Librach SL, Bouvette M, De Angelis C, Farley J, Oneschuk D, Pereira JL; Canadian Consensus Development Group for Constipation in Patients with Advanced Progressive Illness. Consensus recommendations for the management of constipation in patients with advanced, progressive illness. J Pain Symptom Manage. 2010;40:761–73.
Prucalopride for the treatment of chronic constipation in women. NICE technology appraisal guidance 211. https://www.nice.org.uk/guidance/ta211.
China Association of Chinese Medicine. Common views on diagnosis and treatment of chronic constipation with Chinese medicine. Beijing J Tradit Chin Med. 2011;30:3–7.
Lindberg G, Hamid SS, Malfertheiner P, Thomsen OO, Fernandez LB, Garisch J; World Gastroenterology Organisation. World Gastroenterology Organisation global guideline: constipation--a global perspective. J Clin Gastroenterol. 2011;45:483–7.
Bove A, Pucciani F, Bellini M, Battaglia E, Bocchini R, Altomare DF, et al. Consensus statement AIGO/SICCR: diagnosis and treatment of chronic constipation andobstructed defecation (part I: diagnosis). World J Gastroenterol. 2012;18:1555–64.
Bove A, Bellini M, Battaglia E, Bocchini R, Gambaccini D, Bove V, et al. Consensus statement AIGO/SICCR diagnosis and treatment of chronic constipation andobstructed defecation (part II: treatment). World J Gastroenterol. 2012;36:4994–5013.
Park KS, Choi SC, Park MI, Shin JE, Jung KW, Kim SE, et al. Practical treatments for constipation in Korea. Constipation Study Group in Korean Society of Neurogastroenterology and Motility. Korean J Intern Med. 2012;27:262–70.
Chinese Medical Association of Gastroenterology Branch and Chinese Medical Association of Surgery Branch. Diagnosis and treatment guideline of chronic constipation in china. Chin J Gastroenterol. 2013;18:605–12.
Tabbers MM, DiLorenzo C, Berger MY, Faure C, Langendam MW, Nurko S; European Society for Pediatric Gastroenterology, Hepatology, and Nutrition; North American Society for Pediatric Gastroenterology. Evaluation and treatment of functional constipation in infants and children: evidence-based recommendations from ESPGHAN and NASPGHAN. J Pediatr Gastroenterol Nutr. 2014;58:258–74.
Gwee KA, Ghoshal UC, Gonlachanvit S, Chua AS, Myung SJ, Rajindrajith S, et al. Primary care management of chronic constipation in Asia: the ANMA chronic constipation tool. J Neurogastroenterol Motil. 2013;19:149–60.
American Gastroenterological Association, Bharucha AE, Dorn SD, Lembo A, Pressman A. American Gastroenterological Association medical position statement on constipation. Gastroenterology. 2013;144:211–7.
Lubiprostone for treating chronic idiopathic constipation. NICE technology appraisal guidance 318. www.nice.org.uk/guidance/ta318.
Camilleri M, Drossman DA, Becker G, Webster LR, Davies AN, Mawe GM. Emerging treatments in neurogastroenterology:a multidisciplinary working group consensus statement onopioid-induced constipation. Neurogastroenterol Motil. 2014;26:1386–95.
Makarski J, Brouwers MC, AGREE Enterprise. The AGREE Enterprise: a decade of advancing clinical practice guidelines. Implement Sci. 2014;9:103.
Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010;19:e58.
Choudhry NK, Stelfox HT, Detsky AS. Relationships between authors of clinical practice guidelines and the pharmaceutical industry. JAMA. 2002;287:612–7.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. The Global Rating Scale complements the AGREE II in advancing the quality of practice guidelines. J Clin Epidemiol. 2012;65:526–34.
Ebben RH, Vloet LC, Verhofstad MH, Meijer S, Mintjes-de Groot JA, van Achterberg T. Adherence to guidelines and protocols in the prehospital and emergency care setting: a systematic review. Scand J Trauma Resusc Emerg Med. 2013;21:9.
This work was funded by National Natural Science Foundation of China (81270006) and 12th Five-Year Major Program of Army Research (AWS12J001). We would like to thank Nadeem Anjum from Nanjing University for the language modifications.
The authors declare that they have no competing interests.
THL, DC, GJF, LN, MCL: study concept, data extraction and wrote the manuscript; GLL, CQY, GXL, LVM: statistical analysis and critical revisions of the manuscript; LN, ZWM, LJS: study concept and design study supervision; All authors have approved the final manuscript.
Tian Hongliang and Ding Chao are joint first authors.