- Research article
- Open Access
- Open Peer Review
Evaluation of the Birmingham IBS symptom questionnaire
© Roalfe et al; licensee BioMed Central Ltd. 2008
- Received: 27 February 2008
- Accepted: 23 July 2008
- Published: 23 July 2008
Irritable Bowel Syndrome (IBS) is a chronic/common condition that causes a significant effect on the individual (reduced quality of life), society (time lost off work) and health services. Comparison of studies evaluating the management of IBS has been hindered by the lack of a widely adopted validated symptom score. The aim of this study was to develop and validate a disease specific score to measure the symptoms of patients with IBS.
A self-administered 14-item symptom questionnaire (based on Rome II criteria) was mailed to 533 persons included in a prevalence study of IBS. The reliability of each underlying dimension identified was measured by Cronbach's α. Validity was assessed by comparing symptom scores with concurrent IBS specific quality of life (QoL) scores. Reproducibility was measured by the test-retest method and responsiveness measured by effect size.
379 (71%) questionnaires were returned. The underlying dimensions identified were pain, diarrhoea and constipation. Cronbach's α was 0.74 for pain, 0.90 for diarrhoea and 0.79 for constipation. Pain and diarrhoea dimensions had good external validity (r = -0.3 to -0.6), constipation dimension had moderate external validity (r = -0.2 to -0.3). All dimensions were reproducible (ICCs 0.75 to 0.81). Effect sizes of 0.27 to 0.53 were calculated for those with a reported improvement in symptoms.
The Birmingham IBS Symptom Questionnaire has been developed and tested. It has been shown to be suitable for self-completion and acceptable to patients. The questionnaire has 3 internal dimensions which have good reliability, external validity and are responsive to a change in health status.
- Irritable Bowel Syndrome
- Symptom Score
- Symptom Questionnaire
- Irritable Bowel Syndrome Symptom
- Adequate Relief
Irritable Bowel Syndrome (IBS) affects large numbers of the population (prevalence estimates ranging from 12% to 30%) [1–7] and accounts for a significant proportion of the workload of both primary care practitioners and gastroenterologists . Treatment options are wide ranging and include symptomatic prescribing, dietary management and a range of psychotherapeutic and complementary therapies. The breadth of the problem and the range of treatment options make this a potential area for much research activity.
The diversity of symptom types and profiles in IBS means that there is no agreement on appropriate determination of efficacy in trials. Researchers have therefore used a range of techniques and measures, which are largely arbitrary and unvalidated.
Three large systematic reviews completed in the UK, Europe and the USA [9–11] demonstrated large variety in the primary outcome measures adopted by trialists, with many trials reporting individual symptoms, such as pain or urgency or more arbitrary outcomes such as percentage of unformed stools. A review of randomised controlled trials of pharmacological treatments , noted that symptom data were most commonly collected by daily diary (56% of trials), or during consultation. Only 4/70 included trials reported use of a symptom questionnaire and only 2 of these reported validation of the chosen measure [13, 14].
Selection of a suitable outcome measure is further complicated by the fluctuating nature of IBS. It has been suggested , that due to the variance of symptoms over time, clinical trials in this area should have a minimum duration of 2–3 months. The increase in psychotherapeutic and complementary therapies such as hypnotherapy for the management of IBS, would suggest that follow-up should be even longer, as such therapies may prove to be effective (and cost-effective) over extended periods by dealing with root causes or the learning of self-management techniques. The use of daily diary data collection strategies over long periods may be unfeasible or may increase drop-out rates leading to a biased sample.
The ROME I, II and III trial committees have consistently agreed that the main assessment of outcome in IBS trials should be patient centred [16–18] and over a decade ago Tally et al , strongly proposed the need to develop sensitive outcome measures with multiple domains as a priority in this area. A recent move towards global assessment, led to the adoption of 'adequate relief' as a primary endpoint in some trials [19–21] and a literature review of outcome measures identified a dichotomous 'adequate relief' question as the measure of first choice in assessing global symptomatology . The ROME III committee now indicate that 'adequate' or 'satisfactory' relief are the current standards for primary outcome assessment in treatment trials in IBS  and this was supported by a recent review of primary endpoints in IBS trials . It is however generally indicated that integrative symptom questionnaires are also acceptable endpoints subject to appropriate validation .
There is the risk that exclusive use of dichotomous or 'adequate relief' endpoints in a disease with such differing symptom profiles may result in the failure to identify therapies of benefit to sub-groups of patients or effective on specific symptoms. The GSRS-IBS symptom score , based on Rome I criteria has been shown to discriminate by severity and frequency of disease symptoms. However this tool has not been widely used in practice and its generalisability across all age groups has yet to be demonstrated. A recent visual analogue scale for IBS (VAS-IBS) has been developed , however this tool was validated on a sample of women only and requires further testing in clinical practice to establish responsiveness.
Therefore the continuing need for a symptom measure suitable for use in a range of clinical and management trials in the area of IBS remains. The principle characteristics of this tool were determined to be 1) patient reported, 2) suitable for repeated testing over extended time periods, 3) acceptable to patients for ongoing completion, and 4) containing multiple dimensions covering relevant symptoms. This paper therefore describes the development and validation of a tool which meets these requirements, is suitable for self-completion and postal return and fulfils the recommendations of the ROME working group regarding validation of a primary outcome measure . Identification of a well validated and increasingly adopted IBS specific quality of life measure [26, 27], limited the development of this new tool to a symptom only score which would be used to complement this.
The aim of this study was to develop a symptom score suitable for use in a range of therapeutic trials in IBS and establish its acceptability, reliability, validity and sensitivity to a change in health.
Ethical approval for the study, in which this symptom score validation was embedded, was obtained from North and West Birmingham Local Research Ethics Committees before commencement of the project.
A computer generated random sample (stratified by deprivation quartile) of 8646 patients, aged 18 and over, registered with participating practices, were mailed in a study estimating the prevalence of IBS in the West Midlands . This mailing contained a general health questionnaire which asked about previous diagnosis of IBS and also questions based on the ROME II , diagnostic criteria for IBS. Five hundred and thirty three people were identified who met the Rome II criteria (n = 398) or who had an existing diagnosis of IBS with some current symptoms or the need for medication during the last 6 months (n = 135). This population formed the target population for the validation of the IBS-specific symptom score. Patients with other pre-existing GI conditions were excluded.
The Birmingham IBS symptom score
The Birmingham IBS symptom score comprised a self-completed questionnaire which consisted of 14 questions based on the frequency of IBS related symptoms and was derived from Rome II: Functional intestinal disorders (see Additional file 1). Each question had a standard response scale with symptoms all being measured on a 6-point Likert scale ranging from 0 = none of the time to 5 = all of the time. Several authors have suggested measuring symptoms with visual analogue scales (VAS) [30, 31], however there is no firm evidence of the superiority of VAS over Likert scales [32, 33], therefore the latter were adopted as they were felt to be more familiar to patients and also less labour intensive to analyse.
The Birmingham IBS symptom score was sent to persons within 1 to 2 working days of their response to the General Health Questionnaire, which identified them as eligible. To examine construct validity, participants were also sent the IBS-QOL , a previously validated disease specific quality of life measure. A freepost envelope was supplied for the return of questionnaires. Individuals who did not return a questionnaire within 21 days were re-mailed on one occasion.
Seven days after the return of the Birmingham IBS symptom questionnaire the participants were sent a repeat symptom questionnaire which was identical except for the addition of a single question to provide data on change of disease status. This asked about changes between completing the first and second symptom score (Since completing the last questionnaire my abdominal and bowel symptoms have improved/got worse/remained the same). At the time of completing the first questionnaire participants were unaware that they would be asked to repeat the score. Responsiveness to change was assessed by these data and reproducibility was determined by data relating to persons who reported no change in symptoms.
Acceptability was explored by consideration of the overall response rate (percentage of questionnaires returned) and the completeness of each question (proportion of each individual question with a valid response).
The percentages of subjects selecting either the lowest response (floor) or highest response (ceiling) for each question were examined to evaluate floor and ceiling effects, because a large ceiling or floor effect would limit the ability of the questionnaire to detect change over time.
Factor analysis with varimax rotation was carried out to identify underlying dimensions within the questionnaire. The number of dimensions was determined with Scree plots and eigenvalues (> 1). The items within each dimension were confirmed by a cross-validation analysis, whereby questionnaires were randomly allocated into two subgroups of equal size and factor analysis repeated on each subgroup. To allow comparison with other symptom scores, the items within each dimension were summed and transformed to a scale ranging from 0 (no symptoms) to 100 (all symptoms).
The reliability of each identified dimension was assessed by examination of internal consistency and reproducibility. Internal consistency was measured by Cronbach's α coefficient . Reproducibility was assessed using data from the second mailing (test-retest) and measured with the intra-class correlation coefficient (ICC). The ICC was obtained from analysis of variance  and identifies how much variation in scores is due to true difference between individuals and how much is attributable to variability in the measurement.
Construct validity, assessing whether dimensions measure what they say they do, was examined by the relationship of persons' symptom dimension scores with their QoL scores. The associations were measured using Spearman's rank correlation coefficients.
The responsiveness of the tool was measured by the effect size [36, 37], for reported changes in symptoms between the first and second mailings. Effect size for each dimension and total score was calculated from the mean change in scores between first and second mailing divided by the standard deviation of scores at baseline.
The questionnaire was mailed to 533 persons. The average age was 50 years (range 18–89); 73% were female (mean age 49 years) and 27% male (mean age 54 years). Eighty-eight percent of the sample was white and 59% had left school by age 16. Thirty-nine percent were in full-time employment; 9% worked part-time; 24% retired, 15% unable to work for health reasons and 3% were unemployed.
379 (71%) of the 533 eligible population returned the initial Birmingham IBS symptom score questionnaire. The age, sex, ethnicity, education and employment status distributions of the responders were similar to the non-responders.
Question completion rates and maximum response frequencies
Maximum % response at extremes
Loose, watery stools
Hard bowel motions
Pain after eating
Leaked or soiled
Mucus or slime
Unfinished bowel movement
Back and shoulder pain
Factor coefficients after varimax rotation
Hard bowel motions
Loose, watery stools
Leaked or soiled
Mucus or slime
Pain after eating
Cronbach's α coefficients were 0.79 for constipation, 0.90 for diarrhoea, 0.74 for pain and 0.75 for overall score.
329/379 (87%) questionnaires were returned from the repeat mailing to those who returned symptom scores. Seventy-five percent (248) patients reported no change in symptoms over the 7–10 day period since completion of the initial score. The ICCs calculated were 0.78 for constipation, 0.81 for diarrhoea, 0.75 for pain and 0.78 for overall score.
Construct validity measured by Spearman correlation coefficients
Responsiveness measured by effect size
Health status at 7/10 days
Change at 7/10 days
Worse (n = 30)
Same (n = 245)
Improved (n = 47)
Worse (n = 30)
Same (n = 242)
Improved (n = 48)
Worse (n = 29)
Same (n = 236)
Improved (n = 46)
Worse (n = 29)
Same (n = 230)
Improved (n = 46)
The final Birmingham IBS symptom questionnaire is shown in the attached file (see Additional file 2).
Unlike other symptom scores validated using referral-based populations, the validation of this questionnaire was carried out on a large representative community based cohort. Our primary aim was to create a patient reported score for repeated use in trials – in this setting patient interpretation of symptoms is not an issue and could be beneficial, allowing patients to self-define symptoms within tight parameters. Translation to a clinical setting will require further testing especially in light of known differences in the way patients and doctors define key symptoms such as constipation .
The high response rate and the high completion rates of all questions demonstrate the questionnaire's acceptability and suitability for self-completion. The possibility of a response bias due to 15% of responders not working because of health problems may exist. However the prevalence of a range of conditions such as diabetes (5%), hypertension (31%) and cancer (4%) are similar to UK figures and thus our responders reflect the general morbidity of a community population. Patients with other pre-existing GI conditions were excluded from the study.
Three underlying dimensions were identified within the questionnaire with Cronbach's alpha coefficients of between 0.7 and 0.9. These are consistent with recommendations of internal reliability [34, 39, 40] and provide evidence that the items within each dimension are measuring the same characteristic.
The stability of the responses was demonstrated by the high intra-class correlation coefficients of between 0.75 and 0.81. Consequently we can be confident that changes measured by this tool will be due to the effect of treatment and not due to measurement errors of the tool.
Increases in pain, diarrhoea and constipation scores were associated with decreasing quality of life confirming construct validity thus providing evidence that they measure what they purport to. As anticipated, the Qol scores correlated more highly with the pain scale .
The decrease in all scores, and corresponding small to medium effect sizes following an improvement in symptoms, indicate the tool's sensitivity to detect a change in health. The small effect sizes found for those with worse symptoms are most probably due to a ceiling or regression to the mean effect. In these cases, baseline scores, with the exception of constipation, were from subjects with greater symptoms than an average IBS sufferer and therefore scores were unlikely to increase. These changes were observed after a short duration of time (7–10 days); however differences at 3 months have also been shown. A randomised controlled trial of gut-directed hypnotherapy demonstrated an improvement in the Birmingham IBS pain, diarrhoea and overall symptom scores at 3 months compared to usual management . An ongoing randomised controlled trial of a dietary product will provide further estimates of responsiveness over time to supplement these results.
The questionnaire performed well for both genders with similar results for reliability, validity and reproducibility being found for men and women. However, gender specific effect sizes could not be reliably estimated due to the small sample of males reporting a change in symptoms.
Whilst the instrument meets validation criteria, it is acknowledged that it may not query the full and diverse range of symptoms experienced by IBS sufferers. The inclusion of additional questions, or the opportunity for patient nomination of personal outcomes (as in MYMOP ), may further enhance the tool.
This IBS specific symptom questionnaire has been appropriately developed and tested. It is patient-centred, suitable for self-completion and is acceptable. The score includes multiple dimensions that cover representative and relevant questions. The dimension and summary scores provide reliable and valid outcome measures of IBS symptoms. High levels of reproducibility indicate that the score is suitable for use in therapeutic trials where it is important to establish that measured changes reflect a real change in status, not just variability in measurement. The increase in effect size, with improvement in symptoms confirms the instrument's ability to measure a clinically meaningful change in health. It is particularly important that a symptom questionnaire is responsive to a change in health if it is to be used as an outcome in a clinical trial.
The severity of symptoms experienced by populations recruited to treatment trials should be reported if generalisability is to be established. The lack of an acceptable and validated disease specific symptom score has hampered the comparison of the efficacy of different management strategies or attempts to synthesise the results of existing studies in the area of IBS. We recommend that future studies of IBS utilise the Birmingham IBS symptom score, together with the previously well validated IBS-QoL questionnaire, to facilitate the production of high quality patient centred research and to enable future comparisons between published studies and meta-analysis of data.
We wish to thank members of the Birmingham IBS Research Group for their advice during the design stage of this project. Members of the Birmingham IBS Research Group were: Pam Bridge, Sheila Greenfield, Elisabeth Rawson, Tina Maddison, Charlotte Mann, Sukhdev Singh and Kate Thomas, as well as the authors of this paper. We are also grateful for the help and support provided by MidRec (Midlands GP Research Consortium) and the eight practices in the Birmingham area that collaborated with this study. This study was funded by a grant from the Primary Care Research Trust, Birmingham. Sue Wilson is funded by a National Primary Care Career Scientist Award. Lesley Roberts was in receipt of an NHS R&D New Blood Fellowship during the period that this work was completed.
- Agreus L, Svardsudd K, Nyren O, Tibblin G: Irritable bowel syndrome and dyspepsia in the general population: overlap and lack of stability over time. Gastroenterology. 1995, 109: 671-680. 10.1016/0016-5085(95)90373-9.View ArticlePubMedGoogle Scholar
- Thompson WG, Heaton KW: Functional bowel disorders in apparently healthy people. Gastroenterology. 1980, 79: 283-288.PubMedGoogle Scholar
- Kennedy TM, Jones RH, Hungin AP, O'Flanagan H, Kelly P: Irritable bowel syndrome, gastro-oesophageal reflux, and bronchial hyper-responsiveness in the general population. Gut. 1998, 43: 770-774.View ArticlePubMedPubMed CentralGoogle Scholar
- Drossman DA, Li Z, Andruzzi E, Temple RD, Talley NJ, Thompson WG, et al: U.S. householder survey of functional gastrointestinal disorders. Prevalence, sociodemography, and health impact. Dig Dis Sci. 1993, 38: 1569-1580. 10.1007/BF01303162.View ArticlePubMedGoogle Scholar
- Talley NJ, Gabriel SE, Harmsen WS, Zinsmeister AR, Evans RW: Medical costs in community subjects with irritable bowel syndrome. Gastroenterology. 1995, 109: 1736-1741. 10.1016/0016-5085(95)90738-6.View ArticlePubMedGoogle Scholar
- Hungin AP, Whorwell PJ, Tack J, Mearin F: The prevalence, patterns and impact of irritable bowel syndrome: an international survey of 40,000 subjects. Aliment Pharmacol Ther. 2003, 17: 643-650. 10.1046/j.1365-2036.2003.01456.x.View ArticlePubMedGoogle Scholar
- Jones R, Lydeard S: Irritable bowel syndrome in the general population. BMJ. 1992, 304: 87-90.View ArticlePubMedPubMed CentralGoogle Scholar
- Thompson WG, Heaton KW, Smyth GT, Smyth C: Irritable bowel syndrome in general practice: prevalence, characteristics, and referral. Gut. 2000, 46: 78-82. 10.1136/gut.46.1.78.View ArticlePubMedPubMed CentralGoogle Scholar
- Akehurst R, Kaltenthaler E: Treatment of irritable bowel syndrome: a review of randomised controlled trials. Gut. 2001, 48: 272-282. 10.1136/gut.48.2.272.View ArticlePubMedPubMed CentralGoogle Scholar
- Brandt LJ, Bjorkman D, Fennerty MB, Locke GR, Olden K, Peterson W, et al: Systematic review on the management of irritable bowel syndrome in North America. Am J Gastroenterol. 2002, 97: S7-26.PubMedGoogle Scholar
- Tack J, Fried M, Houghton LA, Spicak J, Fisher G: Systematic review: The efficacy of treatments for irritable bowel syndrome – A European perspective. Alimentary Pharmacology and Therapeutics. 2006, 24: 183-205. 10.1111/j.1365-2036.2006.02938.x.View ArticlePubMedGoogle Scholar
- Jailwala J, Imperiale TF, Kroenke K: Pharmacologic treatment of the irritable bowel syndrome: a systematic review of randomized, controlled trials. Ann Intern Med. 2000, 133: 136-147.View ArticlePubMedGoogle Scholar
- Bensoussan A, Talley NJ, Hing M, Menzies R, Guo A, Ngu M: Treatment of irritable bowel syndrome with Chinese herbal medicine: a randomized controlled trial. JAMA. 1998, 280: 1585-1589. 10.1001/jama.280.18.1585.View ArticlePubMedGoogle Scholar
- Cook IJ, Irvine EJ, Campbell D, Shannon S, Reddy SN, Collins SM: Effect of dietary fiber on symptoms and rectosigmoid motility in patients with irritable bowel syndrome. A controlled, crossover study. Gastroenterology. 1990, 98: 66-72.PubMedGoogle Scholar
- Klein KB: Controlled treatment trials in the irritable bowel syndrome: a critique. Gastroenterology. 1988, 95: 232-241.View ArticlePubMedGoogle Scholar
- Veldhuyzen van Zanten SJ, Talley NJ, Bytzer P, Klein KB, Whorwell PJ, Zinsmeister AR: Design of treatment trials for functional gastrointestinal disorders. Gut. 1999, 45 (Suppl 2): II69-77.PubMedGoogle Scholar
- Talley N, Nyren O, Drossman DA: The irritable bowel syndrome: toward optimal design of controlled treatment trials. Gastroenterol Int. 1993, 6: 189-211.Google Scholar
- Drossman DA, Corazziari E, Delvaux M, Spiller RC, Talley NJ, Thompson WG, et al: Rome III. The functional gastrointestinal disorders. 2006, Virginia, USA: Degnon Associates, 3Google Scholar
- Camilleri M, Mayer EA, Drossman DA, Heath A, Dukes GE, McSorley D, et al: Improvement in pain and bowel function in female irritable bowel patients with alosetron, a 5-HT3 receptor antagonist. Aliment Pharmacol Ther. 1999, 13: 1149-1159. 10.1046/j.1365-2036.1999.00610.x.View ArticlePubMedGoogle Scholar
- Mangel AW, Hahn BA, Heath AT, Northcutt AR, Kong S, Dukes GE, et al: Adequate relief as an endpoint in clinical trials in irritable bowel syndrome. J Int Med Res. 1998, 26: 76-81.PubMedGoogle Scholar
- Jones RH, Holtmann G, Rodrigo L, Ehsanullah RS, Crompton PM, Jacques LA, et al: Alosetron relieves pain and improves bowel function compared with mebeverine in female nonconstipated irritable bowel syndrome patients. Aliment Pharmacol Ther. 1999, 13: 1419-1427. 10.1046/j.1365-2036.1999.00678.x.View ArticlePubMedGoogle Scholar
- Bijkerk CJ, de Wit NJ, Muris JW, Jones RH, Knottnerus JA, Hoes AW: Outcome measures in irritable bowel syndrome: comparison of psychometric and methodological characteristics. Am J Gastroenterol. 2003, 98: 122-127. 10.1111/j.1572-0241.2003.07158.x.View ArticlePubMedGoogle Scholar
- Camilleri M, Mangel AW, Fehnel SE, Drossman DA, Mayer EA, Talley NJ: Primary Endpoints for Irritable Bowel Syndrome Trials: A Review of Performance of Endpoints. Clinical Gastroenterology and Hepatology. 2007, 5: 534-540. 10.1016/j.cgh.2007.03.004.View ArticlePubMedGoogle Scholar
- Wiklund IK, Fullerton S, Hawkey CJ, Jones RH, Longstreth GF, Mayer EA, et al: An irritable bowel syndrome-specific symptom questionnaire: development and validation. Scand J Gastroenterol. 2003, 38: 947-954. 10.1080/00365520310004209.View ArticlePubMedGoogle Scholar
- Bengtsson M, Ohlsson B, Ulander K: Development and psychometric testing of the Visual Analogue Scale for Irritable Bowel Syndrome (VAS-IBS). BMC Gastroenterol. 2007, 7: 16-10.1186/1471-230X-7-16.View ArticlePubMedPubMed CentralGoogle Scholar
- Patrick DL, Drossman DA, Frederick IO, DiCesare J, Puder KL: Quality of life in persons with irritable bowel syndrome: development and validation of a new measure. Dig Dis Sci. 1998, 43: 400-411. 10.1023/A:1018831127942.View ArticlePubMedGoogle Scholar
- Drossman DA, Patrick DL, Whitehead WE, Toner BB, Diamant NE, Hu Y, et al: Further validation of the IBS-QOL: a disease-specific quality-of-life questionnaire. Am J Gastroenterol. 2000, 95: 999-1007. 10.1111/j.1572-0241.2000.01941.x.View ArticlePubMedGoogle Scholar
- Wilson S, Roberts LM, Roalfe A, Bridge P, Singh S: Prevalence of irritable bowel syndrome: a community survey. British Journal of General Practice. 2004, 54: 495-502.PubMedPubMed CentralGoogle Scholar
- Drossman D, Corazziari E, Talley N, Thompson W, Whitehead W: Rome II: The Functional Gastrointestinal Disorders: diagnosis, pathophysiology and treatment: a multinational consensus. 2002, McLean VA USA: Degnon Associates, 2Google Scholar
- Francis CY, Morris J, Whorwell PJ: The irritable bowel severity scoring system: a simple method of monitoring irritable bowel syndrome and its progress. Aliment Pharmacol Ther. 1997, 11: 395-402. 10.1046/j.1365-2036.1997.142318000.x.View ArticlePubMedGoogle Scholar
- Drossman DA, Li Z, Toner BB, Diamant NE, Creed FH, Thompson D, et al: Functional bowel disorders. A multicenter comparison of health status and development of illness severity index. Dig Dis Sci. 1995, 40: 986-995. 10.1007/BF02064187.View ArticlePubMedGoogle Scholar
- Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2 (14):Google Scholar
- Remington M, Tyrer PJ, Newson-Smith J, Cicchetti DV: Comparative reliability of categorical and analogue rating scales in the assessment of psychiatric symptomatology. Psychol Med. 1979, 9: 765-770.View ArticlePubMedGoogle Scholar
- Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.View ArticleGoogle Scholar
- Kirshner B, Guyatt G: A methodological framework for assessing health indices. J Chronic Dis. 1985, 38: 27-36. 10.1016/0021-9681(85)90005-0.View ArticlePubMedGoogle Scholar
- Cohen J: Statistical Power Analysis for the Behavioural Sciences. 1988, New Jersey: LEAGoogle Scholar
- Kazis LE, Anderson JJ, Meenan RF: Effect sizes for interpreting changes in health status. Med Care. 1989, 27: S178-S189. 10.1097/00005650-198903001-00015.View ArticlePubMedGoogle Scholar
- Herz MJ, Kahan E, Zalevski S, Aframian R, Kuznitz D, Reichman S: Constipation:a different entity for patients and doctors. Family Practice. 1996, 13: 156-159. 10.1093/fampra/13.2.156.View ArticlePubMedGoogle Scholar
- Helmstadter GC: Principles of psychological measurement. 1964, New York: Appleton-Century-CroftsGoogle Scholar
- Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 1995, Oxford: Oxford University Press, 2Google Scholar
- Roberts L, Wilson S, Singh S, Roalfe A, Greenfield S: Gut-directed hypnotherapy for irritable bowel syndrome: piloting a primary care-based randomised controlled trial. Br J Gen Pract. 2006, 56: 115-121.PubMedPubMed CentralGoogle Scholar
- Paterson C: Measuring outcomes in primary care: a patient generated measure, MYMOP, compared with the SF-36 health survey. BMJ. 1996, 312: 1016-1020.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-230X/8/30/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.