Endoscopists attitudes on the publication of "quality" data for endoscopic procedures: a cross-sectional survey
© Hearnshaw et al; licensee BioMed Central Ltd. 2007
Received: 22 February 2007
Accepted: 24 July 2007
Published: 24 July 2007
Whilst the public now have access to mortality & morbidity data for cardiothoracic surgeons, such "quality" data for endoscopy are not generally available. We studied endoscopists' attitudes to and the practicality of this data being published.
We sent a questionnaire to all consultant gastrointestinal (GI) surgeons, physicians and medical GI specialist registrars in the Northern region who currently perform GI endoscopic procedures (n = 132). We recorded endoscopist demographics, experience and current data collection practice. We also assessed the acceptability and utility of nine items describing endoscopic "quality" (e.g. mortality, complication & completion rates).
103 (78%) doctors responded of whom 79 were consultants (77%). 61 (59%) respondents were physicians. 77 (75%) collect any "quality" data. The most frequently collected item was colonoscopic completion rate. Data were most commonly collected for appraisal, audit or clinical governance. The majority of doctors (54%) kept these data only available to themselves, and just one allowed the public to access this. The most acceptable data item was annual number of endoscopies and the least was crude upper GI bleeding mortality. Surgeons rated information less acceptable and less useful than physicians. Acceptability and utility scores were not related to gender, length of experience or current activity levels. Only two respondents thought all items totally unacceptable and useless.
The majority of endoscopists currently collect "quality" data for their practice although these are not widely available. The endoscopists in this study consider the publication of their outcome data to be "fairly unacceptable/not very useful" to "neutral" (score 2–3). If these data were made available to patients, consideration must be given to both its value and its acceptability.
Until recently, members of the public had virtually no access to data about the performance of individual doctors in the United Kingdom. Increased choice within healthcare systems and several high profile cases have lead to calls for such data to be more freely available . The inquiry into paediatric cardiac surgery at Bristol Royal Infirmary recommended "that patients must be able to see information about the relative performance of individual consultants" . In response to this Bridgewater reported adult mortality rates for named cardiac surgeons from Northwest England  and more recently the healthcare commission published further national cardiothoracic data . Even in the USA, the data, available for other surgical specialties, is limited in scope and of poor quality .
For endoscopy, Cotton has promoted the use of continuously updated "report cards" containing quality parameters provided either routinely or on request . An expert group suggested these should include individual endoscopist's experience and current case complexity, outcomes, and adverse events . However presently, with the exception of colon cancer screening, there are no statutory requirements in the UK for consultant endoscopists to collect endoscopy outcome data.
In light of the changing patient expectations and increasing public awareness of rights to information, we decided to find out the opinions of endoscopists on the usefulness and practicality of making endoscopist 'quality outcome data' available to the public in the UK.
We designed a questionnaire to perform this cross sectional survey of endoscopists. The questionnaire was not validated or piloted. The full questionnaire is available as Additional file 1.
Setting and participants
We posted the questionnaire (with a single reminder for non-responders) to all consultant gastroenterologists, surgeons and medical gastroenterology specialist registrars in the Northern Region of England who currently perform gastrointestinal endoscopy. Subjects were identified from a telephone survey of all endoscopy units.
We recorded basic demographics, level of experience, grade, and current activity levels including the range of procedures undertaken. Respondents answered questions about their current data collection practice including the type and purpose of any data collected. We also asked whether any data was made available to the public.
Respondents were asked to assess the utility and acceptability of nine items (see table 3 for details) describing endoscopic outcomes including mortality, success rates and complication rates. Attitudes were assessed using a five point Likert scale (higher scores corresponding to the data being perceived as more acceptable or more useful).
Methods of analysis
Analysis was performed on SPSS using non-parametric methods (Mann-Whitney U test).
Characteristics of respondents to survey
Registrar in gastroenterology
Time since qualification (years)
Median (Inter Quartile Range) (IQR)
Time in current post* (years)
Procedures currently performed (number of respondents performing)
Treatment of GI haemorrhage
Annual no. of procedures performed median (IQR)
Proportions of different professional groups that collect data
Professional Group (total number)
No collecting data
Consultant surgeons (40)
Consultant physicians (39)
P < 0.001
Registrars in gastroenterology (22)
Currently performing ERCP (22)
P = 0.008
Not currently performing ERCP (77)
Currently treating upper GI haemorrhage (82)
P = 0.130
Not currently treating upper GI haemorrhage (21)
The most frequently collected data were colonoscopy completion rates, collected by 57 endoscopists. ERCP cannulation rates (recorded by 7 respondents) and complication rates (2 respondents), sedation complications (6 respondents), and problems with bowel preparation (2 respondents) were the other most frequently collected data.
Data were collected for organised audit by 26 doctors (34% of those collecting data) for clinical governance by 30 doctors (39%) and for personal appraisal by 62 doctors (81%). 34 respondents said data were routinely accessible by other staff. Only one respondent reported that patients could currently access their data.
Acceptability and utility scores for nine items of endoscopic outcome data
Mean acceptability score (SD)
Mean utility score (SD)
1. 30-day mortality after all endoscopic procedures
2. Crude in patient mortality after OGD for upper GI haemorrhage
3. Rockall adjusted in patient mortality after OGD for upper GI haemorrhage
4. Crude colonoscopy caecal intubation rate
5. Colonoscopy caecal intubation rate adjusted for "unavoidable" failure – e.g. obstructive tumours etc
6. ERCP (intended duct) cannulation rate
7. ERCP completion rate
8. ERCP complication rate
9. Numbers of endoscopic procedures performed annually
Overall consultant surgeons rated information as being less acceptable and less useful than consultant physicians with a mean acceptability score of 2.1 vs 3.1 (p < 0.01), and a mean utility score of 2.0 vs 2.6 (p < 0.01). Specialist registrars thought data more useful than did consultants with a mean utility score of 3.0 vs 2.3 (p < 0.01). Acceptability and utility scores were not related to endoscopists gender, length of consultant experience or current activity levels (measured by either total number of procedures or numbers of individual procedures) (all p > 0.05). Only two respondents (both consultant surgeons) rated all items as being totally unacceptable and useless.
Data comparing the relative performance of individual doctors and hospitals is likely to be more easily accessible to colleagues and patients in the future. We aimed to investigate what information endoscopists currently collect and attitudes to the publication of such data. As a cross sectional regional survey it provides a snapshot of practice from both district and tertiary hospitals. The high response rate may reflect the relevance and importance of this issue to practising endoscopists. The high response rate minimised the potential for responder bias caused by those least in favour of data publication being less likely to respond.
Encouragingly, the majority of consultant endoscopists already collect some data on their practice. These data are frequently collected for governance or appraisal. However, very few respondents made this information available to colleagues and only one stated the public had access to it. The type of data collected was variable and although colonoscopy completion rates were the most frequently collected, these could be inconsistently assessed (for example whether or not correction is made for procedures that were not completed due to poor preparation). By comparison, virtually all registrars collected such data probably because it is routinely reviewed in annual training assessments.
To our knowledge this study is the first to address endoscopists' attitudes to such data being published. The acceptability and utility questionnaire used here is not a previously validated tool. The data items were selected to reflect areas where information might be easily collectable and possible to present in a numerical format. However, the information that is easiest to collect may not be the most important or relevant, as evidenced by comments regards mortality rate. Validation work is necessary to see which factors are truly the most reflective of the "quality" of the service. Cotton et al  published a large number of potential "metrics of excellence" after this study was undertaken, including activity levels, success rates, complication rates, and for colonoscopy – polypectomy rates and time spent in extubation. In the United Kingdom, more detailed process data for example departmental organisation, patient satisfaction scores, waiting time etc. have been audited using the endoscopy global rating scale . Further work is necessary to assess the value of publication of these data.
Very few respondents thought that publication of these data was totally unacceptable and useless although there were differences between scores for different data items. The items considered least acceptable and least useful data were mortality data. Endoscopists may feel these data least reflect their skill as an endoscopists because they reflect more general issues regarding organisation and provision of services . It is important that a framework for interpreting these data is thus provided to help non-specialists interpret the significance of any variation .
We did not attempt to identify what data patients actually want or how useful this would be. Whilst public surveys suggest that health provider data is rated as being important, it is not clear how useful this data is . Patients are still far more likely to rely on recommendations from the referring doctor than to use data made available on the internet . Patients undergoing surgery rate factors such as accessibility of the hospital, delays to treatment and nursing ratios as far more important than outcome data [12, 13].
In summary this study shows most endoscopists currently collect "quality" data for their practice although these are not currently available to referrers or the public. The endoscopists in this study consider the publication of their outcome data to be "fairly unacceptable/not very useful" to "neutral" (score 2–3). It is likely these data will soon be demanded by both patients and governance organisations. Clinicians need now to address how best to diseminate the most useful outcome data in a clear and meaningful way, and in a way that is acceptable to them. For the data to be interpretable by the public, they would need to be collected in a uniform way and further work is needed to assess what information patients and referring doctors want and would find useful. It is also important to assess the attitudes of nurse and GP endoscopists.
We wish to thank all the endoscopists in the northern region who spent time completing this questionnaire.
- Bridgewater B: Why doctors' outcomes should be publishedin the press. BMJ. 2005, 331: 1210-10.1136/bmj.331.7526.1210.View ArticlePubMed CentralGoogle Scholar
- Learning from Bristol: the report of the public inquiry into children's heart surgery at the Bristol Royal Infirmary 1984–1995. [http://www.bristol-inquiry.org.uk]
- Bridgewater B: Mortality data in adult cardiac surgery for named surgeons: retrospective examination of prospectively collected data on coronary artery surgery and aortic valve replacement. BMJ. 2005, 330: 506-510. 10.1136/bmj.330.7490.506.View ArticlePubMedPubMed CentralGoogle Scholar
- Heart Suregry in Great Britain. [http://heartsurgery.healthcarecommission.org.uk]
- Broder MS, Payne-Simon L, Brook RH: Measures of surgical quality: what will patients know by 2005?. J Eval Clin Pract. 2005, 11: 209-17. 10.1111/j.1365-2753.2005.00518.x.View ArticlePubMedGoogle Scholar
- Cotton PB: How many times have you done this procedure, doctor?. Am J Gastroenterol. 2002, 97 (3): 522-523. 10.1111/j.1572-0241.2002.05526.x.View ArticlePubMedGoogle Scholar
- Cotton PB, Hawes RH, Barkun A, Ginsberg GG, Amman S, Cohen J, Ponsky J, Rex DK, Schembre D, Wilcox CM: Excellence in endoscopy: toward practical metrics. Gastrointest endosc. 2006, 63 (2): 286-91. 10.1016/j.gie.2005.04.048.View ArticlePubMedGoogle Scholar
- Global Rating Scale. [http://www.grs.nhs.uk/]
- Sanders DS, Perry MJ, Jones SG, McFarlane E, Johnson AG, Gleeson DC, Lobo AJ: Effectiveness of an upper-gastrointestinal haemorrhage unit: a prospective analysis of 900 consecutive cases using the Rockall score as a method of risk standardisation. Eur J Gastroenterol Hepatol. 2004, 16 (5): 487-94. 10.1097/00042737-200405000-00009.View ArticlePubMedGoogle Scholar
- Michaels JA: Use of mortality rate after aortic surgery as a performance indicator. Br J Surg. 2003, 90 (7): 827-31. 10.1002/bjs.4310.View ArticlePubMedGoogle Scholar
- Schneider E, Epstein A: Use of public performance reports. A survey of patients undergoing cardiac surgery. JAMA. 1998, 279: 1638-42. 10.1001/jama.279.20.1638.View ArticlePubMedGoogle Scholar
- Schwartz LM, Woloshin S, Birkmeyer JD: How do elderly patients decide where to go for major surgery? Telephone interview survey. BMJ. 2005, 331: 821-10.1136/bmj.38614.449016.DE.View ArticlePubMedPubMed CentralGoogle Scholar
- Schneider EC, Lieberman T: Publicly disclosed information about the quality of healthcare: response of the US public. Qual Health Care. 2001, 10: 96-103. 10.1136/qhc.10.2.96.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-230X/7/30/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.