- Research article
- Open Access
- Open Peer Review
Cost-effectiveness of acupuncture for irritable bowel syndrome: findings from an economic evaluation conducted alongside a pragmatic randomised controlled trial in primary care
BMC Gastroenterology volume 12, Article number: 149 (2012)
There is insufficient evidence to determine whether acupuncture is a cost-effective treatment for irritable bowel syndrome. The objective of this study is to assess the cost-effectiveness of acupuncture as an adjunct to usual care versus usual care alone for the treatment of Irritable Bowel Syndrome (IBS).
Cost-utility analysis conducted alongside a pragmatic, multicentre, randomised controlled trial. 233 patients with irritable bowel syndrome were randomly allocated to either acupuncture plus usual care, or usual care alone. Cost-effectiveness outcomes are expressed in terms of incremental cost per quality adjusted life year (QALY) at one year after randomisation. Costs were estimated from the UK National Health Service perspective for a time horizon of one year. Cost-utility ratios were estimated based on complete case analysis for the base case analysis, where only patients with available EQ-5D and cost data were included. Sensitivity analyses comprised a multiple imputation approach for missing data and a subgroup analysis for the more severe cases of IBS.
The base case analysis showed acupuncture to be marginally more effective than usual care (gain of 0.0035 QALYs, 95% CI: -0.00395 to 0.0465) and more expensive (incremental cost of £218 per patient (95% CI: 55.87 to 492.87) resulting in an incremental cost-effectiveness ratio of approximately £62,500. Sensitivity analysis using multiple imputation for missing data resulted in acupuncture appearing less effective and more costly than usual care, so usual care is dominant. Subgroup analysis selecting the most severe cases of IBS (Symptom Severity Score of over 300) suggested that acupuncture may be a cost-effective treatment option for this group, with a cost-per-QALY of £6,500.
Acupuncture as an adjunct to usual care is not a cost-effective option for the whole IBS population; however it may be cost-effective for those with more severe irritable bowel syndrome.
Current Controlled Trials ISRCTN08827905
Population-based studies have demonstrated that the prevalence rates of irritable bowel syndrome range from 2.1% to 22% . The main symptoms are abdominal pain or discomfort, altered form, frequency and passage of stools, and abdominal distension. IBS affects all age groups and it is believed that factors such as familial aggregation, early life events, diet and psychosocial conditions might drive the development of the disease .
The disease is not life-threatening, but leads to significant impairment of health related quality of life, which reflects physical role limitations as well as pain and a lower perception of general health . As a consequence, patients with IBS are more likely than those without to have impaired daily routines, relationships, social lives and emotional status . IBS causes high level of absenteeism and impairs workplace functioning; the magnitude of impairment is directly related to severity and frequency of bowel symptoms .
In the UK, patients with gastrointestinal symptoms are primarily seen by a GP. Of those diagnosed with IBS, approximately 20% are referred to a gastroenterologist or general physician and 9% to a surgeon . Several studies have estimated the NHS costs associated with IBS [3, 5]. They have concluded that the direct and indirect costs associated with IBS are substantial. The cost driver is usually higher hospital inpatient episodes experienced by patients with IBS. The loss due to impaired productivity in the UK has also been estimated to be significant  mainly due to missed days of work which have been estimated to be between 1.53  and 1.7 days per month .
A Cochrane review supports the finding that conventional treatments for IBS are rarely effective in managing all of the symptoms associated with IBS . Hence, there is a tendency of patients increasingly turning to complementary and alternative medicine , one of them being acupuncture. There is insufficient evidence to determine whether acupuncture is an effective treatment for IBS , and no evidence of cost-effectiveness from an NHS perspective. This paper reports the relative cost-effectiveness of acupuncture for IBS, assessed as part of a pragmatic randomized controlled trial undertaken in the UK [11, 12].
Study design, setting, participants and interventions
Details and clinical results of this trial are reported elsewhere (clinical paper – under submission). Briefly, 233 participants were recruited from primary care in the English NHS into a pragmatic randomised controlled trial of acupuncture for IBS. 116 were randomised to receive a short course of traditional acupuncture plus usual GP care and 117 to receive usual GP care alone. The treatment course of the acupuncture arm included up to 10 sessions over a three month period.
The economic analysis assesses the relative cost-effectiveness of adding acupuncture sessions to usual care compared with usual care alone for the treatment of IBS. A cost-utility analysis approach was adopted, where utility data are based on the EQ-5D questionnaire collected at three-monthly intervals from baseline to 12 months. The UK NHS perspective was taken , where only costs directly linked to the NHS budget were included. The time frame of the analysis was one year; hence, no discounting was applied to costs or outcomes.
The outcomes of the analysis are presented as incremental costs per quality adjusted life year (QALY). Uncertainty around the estimates is presented as the probability that acupuncture added to usual care is cost-effective for a range of values that decision makers are willing to pay for gaining one additional QALY, illustrated using as cost-effectiveness acceptability curves (CEACs).
Resource use data and outcome measures
NHS costs (GP and nurse visits, emergency and elective hospitalisations, outpatient attendances and contact with other NHS professionals) were included. Resource use data were collected from GP records. Data were collected for 15 months, which included three months before randomisation and the one year follow-up period of the trial. The prior period was used to assess the baseline consumption of health care resources. All contacts with health care professionals were recorded, not just those relating to IBS, but where IBS was documented in the patient notes this was recorded by the researcher. This allows the estimation of cost-effectiveness based on the disease specific resource consumption in addition to the overall consumption during the trial period. In addition, data were collected on the total number of acupuncture sessions attended by each patient allocated to the intervention arm.
For the outcome data, the EQ-5D instrument  was used to measure and value patients’ health states. This was collected at baseline (at the point of enrolment of the participants in the trial) and at three, six, nine and 12 months post-randomisation. Patients completed the EQ-5D instrument via a postal questionnaire. EQ-5D captures health on five three-level domains: no problems, moderate problems or severe problems in mobility, self care, usual activities, pain-discomfort, and anxiety-depression, resulting in 243 possible health states.
EQ-5D scores were converted to utility scores by using the social tariff based on preferences of the UK general population . To calculate QALYs, the utility scores at each of the five time points were plotted and the area under the curve was estimated. This approach takes into account both the utility score at each time point and the duration of time between them, assuming that utility changes are linear from one time point to the next.
Unit costs were identified for four types of activities: those provided in primary care (GP and practice nurse), hospital based activity (outpatient clinics, emergency and elective admissions), other NHS professionals (hospital or community based) and acupuncture sessions. Information on unit costs was extracted from three sources: Unit costs of health and social care , NHS reference costs  and NHS choices website . Unit costs (at 2010 prices) are illustrated in Table 1.
EQ-5D scores and resource use data were missing for some patients. The base case analysis was conducted as a “complete case analysis” where only patients with available utility scores at all points and available costs were included.
An additional analysis was conducted by including all the patients that returned EQ-5D questionnaires for at least one time-point and had at least partial information on resource use. Missing EQ-5D scores were imputed based on a group of variables (age, treatment allocation and the utility scores of the patients at any time-point). The cost data for the patients who had partial information (e.g. they had left the GP surgery), were inflated based on the time for which the information was available. This was done in a linear fashion, assuming the cumulative costs would increase proportionally for the rest of the trial duration. For each of the scenarios, two analyses were conducted; first by including all costs irrespective of their nature, and second by including only the IBS-related costs.
The differences in cost data are presented unadjusted and adjusted for baseline costs; the latter being either total or only IBS-related costs, depending on the nature of the analysis. QALY data were adjusted for baseline EQ-5D scores as recommended by Manca et al .
For the cost-effectiveness analysis, the mean differences in costs and effects were estimated by using seemingly unrelated regressions and the 95% confidence intervals around those were estimated using bias corrected and accelerated (BCA) bootstrap methods. Analyses were conducted using STATA Version 10.1.
A pre-specified subgroup analysis was conducted based on baseline Symptom Severity Scores (SSS) . Patients were grouped as mild (SSS = 75–175), moderate (SSS = 175-300) and severe (SSS =300+). Subgroup analysis was conducted using only complete cases and only for the total health care resource usage (not on the IBS-only costs).
Data were completely missing for 6 patients randomized in the acupuncture and 20 in the usual care arm. Of those, GP records could not be traced for 3 patients as they had left the surgery and no further information was available for them. 9 patients withdrew from the trial; hence their GP records were not accessed. The records of 14 patients were not available from the GP registry.
There was partial information on resource use for three patients (two in acupuncture and one in the usual care arm) as they left the GP surgery at some point after the trial initiation. This was at 8 and 11 months after the randomization date for two patients allocated in the acupuncture and one month after in the usual care arm.
There were missing utility scores for both arms of the trial. The number of missing utility scores, due to either missing questionnaires or missing domains in the EQ-5D questionnaire, was higher for the usual care arm for all the time-points. For the acupuncture, the range of missing utility scores was 2.6% at baseline to 18.1% at month nine. For the usual care arm, the rates of missing utility scores ranged from 2.6% at baseline to 30.8% at month six.
Table 2 presents levels of resource use based on the available trial data. During the trial, participants in the acupuncture arm had a higher mean number of GP visits (6.7 vs. 5.9) and nurse visits (2.5 vs. 2) compared with usual care. Usual care patients had a higher number of emergency admissions but a lower number of outpatient clinic contacts compared with the acupuncture arm.
A summary of costs based on the available trial data is presented in Table 3.
Acupuncture patients had higher baseline costs compared to the usual care patients (£144 vs. £123) as well as during the trial (£600 vs. £574). The latter does not include the cost of acupuncture sessions. IBS related costs during the trial were also higher for the acupuncture patients (£91 vs. £61), again without including the cost of acupuncture sessions. Total costs during the trial (acupuncture sessions plus health care costs) were higher for the acupuncture group compared with usual care patients (£940 vs. £574), a difference of £366.
Mean utility scores by time point are presented in Table 4. The baseline scores were lower for the acupuncture arm. At month 3, utility scores were higher for the usual care patients compared to those receiving acupuncture (0.78 vs. 0.74, difference adjusted for baseline scores of 0.0351) while at months 6 and 9 acupuncture was marginally better or no different from the usual care arm. At month 12, utility scores for the acupuncture patients were marginally worse than those for the usual care group. None of the differences reached conventional levels of statistical significance.
Base case analysis
The complete case analysis, based on all costs (IBS and non IBS related) demonstrated that acupuncture results in a QALY gain at 12 months of 0.0035 (BCA 95% CI: -0.0395 to 0.0465) for unadjusted and 0.0033 (BCA 95% CI: -0.0398 to 0.0462) adjusted for baseline costs (see Table 5). Acupuncture is more expensive than usual care resulting in incremental costs of £218.50 per patient (BCA 95% CI: 55.87 to 492.87) for unadjusted and £230.78 (BCA 95% CI:-34.52 to 496.08) for adjusted results. This leads to an incremental cost-effectiveness ratio of £62,429 (£69,933) per QALY gained based on unadjusted (adjusted) estimates.
Figure 1 shows the incremental costs and QALYs. Figure 2 presents the probability that acupuncture is cost-effective for a range of maximum values that decision makers may be willing to pay for an additional QALY gained. At a value of £30,000 per QALY gained, often stated to be the borderline for the NHS , acupuncture has a 40% probability of being cost effective. The analysis based on IBS-related costs only led to similar conclusions i.e. acupuncture is associated with higher costs and marginally better outcomes. The ICER in this case is around £137,000 per QALY for both adjusted and unadjusted results.
Multiple imputation analysis
The analysis based on the multiple imputation of missing outcome and cost data demonstrated that acupuncture is less effective and more costly (including all IBS and non-IBS related costs). Acupuncture costs £365.75 (BCA 95% CI: 362.91 to 368.60) for unadjusted for baseline values costs and £341.52 (BCA 95% CI: 339.00 to 344.03) for the adjusted costs, more than usual care. The difference in outcomes (acupuncture – usual care) is −0.0064 (BCA 95% CI: -0.0069 to −0.0059), leading to usual care being a dominant option. The same conclusion is reached when the analysis is based on only IBS-related costs.
The subgroup analysis demonstrated that usual care is dominant for mild and moderate cases of IBS patients, as acupuncture appears more costly and less effective than usual care. For severe cases of IBS (with an SSS symptom score of over 300), acupuncture appears more effective, although also more costly. The QALY gain is approximately 0.031 (−0.0588 to 0.1206) and incremental costs are between £198 and £232 (−34.52 to 496.08) (unadjusted and adjusted results). These lead to an incremental cost-effectiveness ratio of £6,377 (£7,504) based on unadjusted (adjusted) results. The probability that acupuncture is cost-effective is slightly over 60% for willingness-to-pay values of £20,000 to £30,000 per QALY gained. This reflects the uncertainty around this result.
Our base case analysis demonstrated that acupuncture is more costly and marginally more beneficial than the usual care alone. Incremental cost effectiveness ratios were within a range of £60,000 to £70,000 per QALY.
Sensitivity analysis resulted in usual care being dominant for mild and moderate cases, but a subgroup analysis suggested acupuncture could be a cost-effective option for the patients with more severe IBS, as defined by the IBS SSS score.
Strengths and limitations
This study is the first economic evaluation of acupuncture for IBS patients based on a randomized controlled trial. The trial was pragmatic and the results have strong external validity and applicability to everyday clinical practice in the UK setting.
Missing data limits slightly the validity of the results. However, the analysis was based on two different scenarios of handling missing data to test the robustness of the conclusions. The sensitivity analysis did reverse the direction of difference in outcomes, making the case that acupuncture is not a cost-effective option to be adopted in everyday practice even stronger.
Another potential limitation of the study arises from the exclusion of medication costs in the economic analysis. As data on health resources consumption was extracted from the GP records, tracking down the medication usage was problematic. However, previous research has shown that the cost drivers are usually high inpatient episodes and consultations with the GP [3, 5]; hence, the exclusion of medication costs is very unlikely to have changed the conclusions of this study.
Subgroup analysis, suggesting the possibility of acupuncture being cost-effective in more severe IBS patients, is informative but preliminary. The uncertainty around this result reflects the low sample size. There is a 60 per cent probability that treatment of this subgroup would meet NICE thresholds for cost-effectiveness.
Implications for clinical practice
The lack of notable benefit in terms of health utility from the treatment drives the main conclusions of this analysis. This trial does not support the use of acupuncture for IBS patients as an appropriate use of NHS resources. It is possible that acupuncture may be a cost-effective treatment option for patients with severe IBS, a group that is difficult to treat, with poor quality of life [21, 22].
Recommendations for future research
The subgroup analysis suggested that acupuncture may be cost-effective for patients with severe IBS. This finding can assist in hypothesis building for further examination and analysis. For example, a trial which is powered to detect differences in outcomes for this subgroup of patients might be pertinent.
In addition, an economic model to extrapolate long term costs and effects would also be helpful in more clearly demonstrating the cost effectiveness or otherwise of acupuncture for this group of severe IBS patients, since the utilisation of health care resources over the long term could then be incorporated directly into the economic modelling approach and accounted for in the economic analysis.
Our principal finding is that acupuncture as an adjunct to usual care is not a cost-effective option for the whole IBS population. Preliminary analysis suggests that it it may be a cost-effective option for those with more severe irritable bowel syndrome.
We received ethics approval from the York NHS Research Ethics Committee (08/H1311/66) in 2008.
This article presents independent research commissioned by the UK National Institute for Health Research (NIHR)’s Research for Patient Benefit programme (PB-PG-0407-13241). The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the UK Department of Health.
The University of York, in its role as sponsor for the study, had no input into study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication.
Rey E, Talley NJ: Irritable bowel syndrome: novel views on the epidemiology and potential risk factors. Digestive and Liver Disease. 2009, 41: 772-780.
Lea R, Whorwell PJ: Quality of life in irritable bowel syndrome. Pharmacoeconomics. 2001, 19: 643-653.
Akehurst RL, Brazier JE, Mathers N, O’Keefe C, Kaltenthaler E, et al: Health-related quality of life and cost impact of irritable bowel syndrom in a UK primary care setting. Pharmacoeconomics. 2002, 20: 455-462.
Hahn BA, Kirchdoerfer LJ, Fullerton S, Mayer E: Patient-perceived severity of irritable bowel syndrome in relation to symptoms, health resource utilization and quality of life. Aliment Pharmacol Ther. 1997, 11:
Wells NEJ, Hahn BA, Whorwell PJ: Clinical economics review: irritable bowel syndrome. Aliment Pharmacol Ther. 1997, 11: 10119-11030.
Creed F, Ratcliffe J, Fernandez L, Tomenson B, Palmer S, et al: Health-Related Quality of Life and Health Care Costs in Severe, Refractory Irritable Bowel Syndrome. Ann Intern Med. 2001, 134: 860-868.
Hahn B, Yan S, Strassels S: Impact of irritable bowel syndrome on quality of life and resource us in the United States and United Kingdom. Digestion. 1999, 60: 77-81.
Akehurst R, Kaltenthaler E: Treatment of irritable bowel syndrome: a review of randomised controlled trials. Gut. 2001, 48: 272-282.
Drossman DA, Whitehead WE, Camilleri M: Irritable bowel syndrome: a technical review for practice guideline development. Gastroenterology. 1997, 112: 2120-2137.
Lim B, Manheimer E, Lao L, Ziea E, Wisniewski J, Liu J, et al: Acupuncture for treatment of irritable bowel syndrome. Cochrane Database Syst Rev. 2006, 4: CD005111-
MacPherson H, Bland M, Bloor K, Cox H, Geddes D, Kang’ombe A, Reynolds J, Stamuli E, Stuardi T, Tilbrook H, et al: Acupuncture for irritable bowel syndrome: a protocol for a pragmatic randomised controlled trial. BMC Gastroenterol. 2010, 10: 63-
MacPherson H, Tilbrook H, Bland JM, Bloor K, Brabyn S, Cox H, Kang’ombe AR, Man MS, Stuardi T, Torgerson D, Watt I, Whorwell P: Acupuncture for irritable bowel syndrome: primary care based pragmatic randomised controlled trial. BMC Gastroenterology. 2012, 12: 139-
MacPherson H, et al: Acupuncture for irritable bowel syndrome: primary care based pragmatic randomised controlled trial. BMC Gastroenterology. 2012, 12: 150-
National Institute for Health and Clinical Excellence: Guide to the methods of technology appraisal. http://wwwniceorguk/media/B52/A7/TAMethodsGuideUpdatedJune2008pdf 2008
Kind P: EuroQol instrument: an index of health-related quality of life. Quality of life and pharmacoeconomics in clinical trials. Edited by: Spilker B. 1996, Philadelphia: Lippincott-Raven
Dolan P, Gudex C, Kind P, Williams A: Discussion Paper No 138, Centre for Health Economics. A social tarif for EuroQol: Results from a UK general population survey. 1995, University of York: York
Curtis L: Unit Costs of Health and Social Care. 2010, -http://wwwpssruacuk/pdf/uc/uc2010/uc2010pdf 2010
NHS reference cost 2009–2010: NHS trust and PCT combined reference costs schedules. . -http://wwwdhgovuk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_123459,
NHS choices website: . -http://wwwnhsuk/Conditions/Acupuncture/Pages/Introductionaspx Accessed February 2011
Manca A, Hawkins N, Sculpher MJ: Estimating mean QALYs in trial-based cost-effectivenessanalysis: the importance of controlling for baseline utility. Health Econ. 2005, 14: 487-496.
Francis CY, Morris J, Whorwell PJ: The irritable bowel severity scoring system: a simple method of monitoring irritable bowel syndrome and its progress. Aliment Pharmacol Ther. 1997, 11: 395-402.
Gralnek IM, Hays RD, Kilbourne A, Naliboff B, Mayer EA: The impact of irritable bowel syndrome on health-related quality of life. Gastroenterology. 2000, 119: 654-660.
Miller V, Hopkins L, Whorwell PJ: Suicidal ideation in patients with irritable bowel syndrome. Clin Gastroenterol Hepatol. 2004, 2: 1064-1068.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-230X/12/149/prepub
Support for this project came from Dr David Geddes, the Medical Director of the NHS North Yorkshire and York PCT, who was a co-applicant in the bid for funding. Thanks are due to Julie Osborne and Shelagh Grey who contributed to the study as lay representatives. Julie Reynolds contributed her experience of conducting the pilot study, and was a co-applicant for funding and advised on the full-scale trial. Ann Hopton provided additional support in the administration of the trial. We would like to acknowledge Greg Rubin, Professor of General Practice and Primary Care at Durham University, in his role as Chair of the Independent Steering Committee.
HM has a part-time clinical practice that includes acupuncture.
ES was the trial health economist who conducted the cost effectiveness analyses. KB provided advice on all aspects of the economic analysis and its interpretation. HM conceived the study and was the lead applicant and principal investigator for the trial. HT was the Trial Co-ordinator. TS and SB contributed to the trial management. DT provided support and advice in his role as Director of the York Trials Unit. All authors have had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis, and have read and approved the final manuscript.
About this article
Cite this article
Stamuli, E., Bloor, K., MacPherson, H. et al. Cost-effectiveness of acupuncture for irritable bowel syndrome: findings from an economic evaluation conducted alongside a pragmatic randomised controlled trial in primary care. BMC Gastroenterol 12, 149 (2012) doi:10.1186/1471-230X-12-149
- Irritable bowel syndrome
- Economic evaluation
- Health technology assessment
- Quality of life