Systematic investigation of gastrointestinal diseases in China (SILC): validation of survey methodology

Setting

This study was conducted in five diverse regions of China, all of which are major population centres (Figure 1).

Sampling

In total, 18 000 adults aged 18-80 years were randomly selected from Shanghai, Beijing, Xi'an, Wuhan and Guangzhou, using a stratified, multi-stage sampling methodology. Given that urban and rural populations are widely divergent in terms of environment and socioeconomic status, and because approximately half of the residents of these centres live in rural areas (Shanghai: 54.2%; Beijing: 42.5%; Xi'an: 50.4%; Wuhan: 41.4%; Guangzhou: 55.7% [28–33]), urban and rural populations were treated as two separate strata and sampled in a ratio of 1:1 (n = 1800 for each stratum in each region). At the first sampling stage, one or more districts from the urban stratum and one or more counties from the rural stratum were randomly selected from each region. At the second stage, one or more blocks were randomly selected from the urban districts, and one or more townships from the rural counties. At the third stage, one or more residential areas were randomly sampled from the urban blocks, and one or more villages from the rural townships.

All residents of the selected residential areas or villages were stratified according to their age and sex, and individuals were randomly selected from these strata in proportion to the overall age and sex distribution of the population in that region, using data from recent government population surveys (The Fifth Population Census In China, 2000, or the 1% sample survey, 2005) [34–39]. Residents who were younger than 18 years, older than 80 years, illiterate, or who had major psychiatric illness or severe visual, hearing or learning disabilities, were excluded from the study.

Study design

All selected individuals were asked to complete a general information questionnaire, and Chinese versions of the Reflux Disease Questionnaire (RDQ) [40] and modified Rome II questionnaire (Figure 2) [41]. In addition, a random sub-sample of the total sample, 20% in each region, was asked to complete Chinese versions of the 36-item Short-Form Health Survey (SF-36) [42] and the Epworth Sleepiness Scale (ESS) [43] and to undergo a physical examination that included measurement of weight (kg), height (cm), and waist and hip circumference (cm). Measurements were made with individuals wearing indoor clothing without shoes. Weight was measured on an electronic scale to the nearest 0.1 kg, and height and circumference measurements were recorded to the nearest centimetre.

All participants from the Shanghai region were invited to undergo upper gastrointestinal endoscopy with esophageal biopsy. Endoscopic results were classified using the Los Angeles (LA) classification of reflux esophagitis [44] and the Prague C and M classification of endoscopically suspected esophageal metaplasia [45]. Markers of microscopic esophagitis from biopsies were classified using criteria developed by an international panel of expert pathologists [46]. Individuals in Shanghai were also asked to provide blood samples for H. pylori antibody serology using an immunoglobulin G enzyme-linked immunosorbent assay (ELISA) (Biohit, Helsinki, Finland).

Administration

The fieldwork period was from April 2007 to January 2008. Questionnaires were self-administered, with trained and supervised facilitators available to explain any questions that respondents found unclear. (Most queries were about the questionnaire formats, such as the skip rules in the modified Rome II questionnaire.) Participants completed the questionnaires at home or in local residential committee offices. Three attempts were made to contact a resident before he or she was considered to be a non-responder.

To encourage high response rates, local residential committee staff publicized the survey in the selected residential areas and villages using leaflets and posters. They also supported participation by setting up early morning and weekend sessions in local residential committee offices, where individuals could come to complete the questionnaires without this interfering with their daily routines. In addition, a small gift (such as shampoo or washing powder) was offered to reward participation. In the Shanghai region, the diagnostic benefits of a free blood test and endoscopy with biopsy were explained, along with the need to fast overnight. Breakfast was provided for those who underwent blood tests and/or endoscopy, and participants were transported to and from the hospital where endoscopy was performed. Individuals were subsequently provided with all test results.

The study was staffed by graduates from the Department of Health Statistics, Second Military Medical University in Shanghai, who received training centrally from gastrointestinal specialists and epidemiologists in Shanghai. Most had also taken part in the pilot survey in Shanghai and were familiar with the survey process. These study staff provided standardized training for facilitators, who were local university graduates or social workers at the sampled sites, before fieldwork commenced. After each questionnaire had been completed, it was checked for completeness and signed by the responsible member of the study staff before the participant received their gift.

Informed consent was obtained from study participants, who were free to discontinue their involvement in the study at any time. The study was approved by the Ethics Committee of the Second Military Medical University in Shanghai, China.

Questionnaires

The general information questionnaire collected data on age, height, weight, sex, marital status, education, income, occupation, lifestyle, self-reported health status, family history of gastrointestinal diseases, and medical history (current and previous medical problems and related treatment). Current smoking was defined as smoking at least one cigarette daily, and drinking alcohol was classified as alcohol consumption on four or more occasions per month. Current occupation was classified as white-collar worker (including government employees, professionals and technicians), manufacturing industry worker, agricultural or fisheries worker, and other (including service sector and students). Participants indicated their health status, total monthly family income and weekly level of recreational exercise by selecting an option from appropriate categories.

The Rome II questionnaire is designed to assess symptoms of upper and lower functional gastrointestinal disorders, including esophageal disorders, gastroduodenal disorders, bowel disorders, functional abdominal pain, biliary disorders and anorectal disorders, in a 3-month recall period [41]. The Rome II questionnaire is widely used in research and clinical practice, and there is evidence supporting its validity across various cultures in Asia and the West, including a Chinese version in China [51–53]. The version of the Rome II questionnaire used in this study was translated into Chinese through a process of forward- and back-translation and reconciliation, and then tested for linguistic validity through a process of cognitive debriefing with literate volunteers. It was also modified by removal of reflux items covered by the RDQ, to shorten the survey for participants and minimize repetition and possible confusion. Individuals answered yes or no to eight mandatory items, and a further 16 items covering gastroduodenal, bowel and biliary symptoms were completed only if relevant.

The SF-36 is a generic questionnaire that is widely used to assess health status and well-being during the previous 4 weeks. It contains 36 items, clustered into eight dimensions (physical functioning, role-physical, bodily pain, general health, vitality, social functioning, role-emotional and mental health), plus one item on health change during the previous year [42]. The score for each dimension is the sum of the scores of each item it contains, transformed to a value on a scale of 0 to 100, with high scores indicating good health-related quality of life. The reliability and validity of the SF-36 are well documented in a range of language versions, including Chinese [54–56]. The psychometric properties of the Chinese version of the SF-36 used in this study were assessed during the pilot study in Shanghai [27]. The questionnaire was found to have credible reliability and construct validity.

The ESS is an eight-item, self-administered questionnaire that is widely used to measure daytime sleepiness in adults [43]. The likelihood of dozing in various everyday situations is scored on a 4-point Likert scale, where a score of 3 indicates a high risk of dozing during the daytime and a score of 0 indicates no risk of dozing. Item scores are summed to produce a final score in the range 0-24. ESS scores above 12 suggest problems with excessive sleepiness, scores of 10-12 are borderline, and scores below 10 are considered normal. The reliability of the ESS has been demonstrated in English in Australia [57] and in Chinese in Hong Kong [58]. For use in the present study, it was translated into Chinese through a process of forward- and back-translation and reconciliation, and then tested for linguistic validity through a process of cognitive debriefing with literate volunteers.

Data collection and analysis

Coding and double entry of questionnaire responses were carried out by two independent professional data-entry staff from the Department of Health Statistics. EpiData software (EpiData Foundation, Odense, Denmark) [59] was used to check for consistency between the two sets of data entries to ensure data quality. SAS 9.1.3 software (SAS Institute, Cary, NC, USA) was used for the data analyses. The mean value of the completed items was used to impute missing values where at least 50% of the items in an RDQ or SF-36 dimension or in the overall ESS had been completed. When values were missing for more than 50% of items, the dimension score (or questionnaire score for the ESS) was excluded from the analysis [60–62]. For the modified Rome II questionnaire, imputation was not performed if an item score was missing.

The internal consistency of survey instruments was evaluated using Cronbach's alpha coefficient to determine the extent to which items within each questionnaire were interrelated [63]. Cronbach's alpha coefficients for each questionnaire were calculated by correlating all individual item scores with dimension scores and/or the overall score. An alpha coefficient above 0.70 suggested good internal consistency. Correlation and/or factor analyses were used to evaluate the construct validity of the RDQ, Rome II questionnaire and the SF-36 - in other words, whether each questionnaire actually measures the phenomena that it theoretically predicts. Factor analysis using principal component analysis and quartimax rotation was employed to explore the factor structure of each questionnaire. Factor loadings larger than 0.50 within one dimension were considered to support the factor construct, provided that the factor loadings were low across the other dimensions; cumulative rates were used to show the contributions of combinations of principal components [64]. Correlation analysis was used to measure the strength of association between dimension scores and the total score for the SF-36 questionnaire, and between item scores and dimension scores for the RDQ. A correlation coefficient of more than 0.6 was considered to indicate a strong correlation, 0.3-0.6 a moderate correlation, and less than 0.3 a weak correlation [65].

Body mass index (BMI) was calculated from self-reported height and weight measurements from the general information questionnaire and, in the 20% sub-sample, from measurements taken by study staff as part of the physical examination. Respondents were categorized on the basis of BMI as having a low risk of cardiovascular disease and type 2 diabetes (< 18.5 kg/m², underweight), an increasing but acceptable risk (18.5-22.9 kg/m², normal weight), an increased risk (23.0-27.4 kg/m², overweight) or a high risk (≥ 27.5 kg/m², obese) [66]. Agreement between participant-reported height and weight and the measurements made by study staff was assessed using the intraclass correlation coefficient (ICC).

Disease definitions

Based on the Montreal definition of GERD for population-based studies [3], the RDQ was used to define symptom-defined GERD as mild symptoms of heartburn ('burning behind the breastbone' and/or 'pain behind the breastbone') and/or regurgitation ('acid taste in the mouth' and/or 'unpleasant movement of materials upwards from the stomach') occurring on at least 2 days a week (RDQ item frequency score ≥ 3 for a severity score of ≥ 2), or moderate/severe symptoms of heartburn and/or regurgitation occurring on at least 1 day a week (RDQ item frequency score ≥ 2 for a severity score ≥ 3).

As described above, reflux esophagitis was graded using the LA classification system [44] and endoscopically suspected esophageal metaplasia (suspected Barrett's esophagus) was assessed using the Prague C and M criteria [45]. Hiatal hernia was defined as gastric folds extending at least 2 cm above the diaphragmatic hiatus during quiet respiration.

Peptic ulcer disease was defined as a defect in the gastric or duodenal wall that extended through the muscularis mucosae into the deeper layers of the wall (submucosa or the muscularis propria). H. pylori test results were classified as positive (≥ 38 enzyme immunoassay units [EIU]) or negative (< 38 EIU) [67].

Atrophic gastritis was defined on the basis of the more severely affected of the serum pepsinogen (PG) I concentration and the PGI/PGII ratio. Results were classified according to the manufacturer's recommendations for China. PGI levels < 30 μg/L and/or a PGI/PGII ratio < 3 indicated severe atrophy (achlorhydric or very hypochlorhydric conditions). PGI levels from 30 μg/L to < 50 μg/L and/or a PGI/PGII ratio from 3 to < 5 indicated moderate atrophy. PGI levels from 50 μg/L to < 70 μg/L and/or a PGI/PGII ratio from 5 to < 7 indicated mild atrophy (hypochlorhydric conditions). Levels above the cut-offs but in the presence of H. pylori antibodies indicated non-atrophic H. pylori gastritis.

IBS was defined according to the Rome II criteria as abdominal discomfort or pain that has at least two of the following three features: (1) relieved with defecation; (2) onset associated with a change in frequency of stool; and/or (3) onset associated with a change in form (appearance) of stool [68]. IBS was described as diarrhoea-predominant (IBS-D) if patients had one or more of the following: more than three bowel movements a day, loose (mushy) or watery stools, and/or urgency (having to rush to have a bowel movement); and none of the following: fewer than three bowel movements a week, hard or lumpy stools, and/or straining during a bowel movement. IBS was described as constipation-predominant (IBS-C) if patients had one or more of the following: fewer than three bowel movements a week, hard or lumpy stools, and/or straining during a bowel movement; and none of the following: more than three bowel movements a day, loose (mushy) or watery stools, and/or urgency (having to rush to have a bowel movement).

Dyspepsia was defined according to the Rome II criteria as persistent or recurrent pain or discomfort centred in the upper abdomen, with no evidence that symptoms are exclusively relieved by defecation or associated with the onset of a change in stool frequency or stool form [69]. Dyspepsia was described as ulcer-like if the predominant (most bothersome) symptom was pain centred in the upper abdomen. Dyspepsia was described as dysmotility-like if the predominant symptom was an unpleasant or troublesome nonpainful sensation (discomfort) centred in the upper abdomen; this sensation may be characterized by or associated with upper abdominal fullness, early satiety, bloating or nausea.

Response rate

In the 20% sub-sample, 3219 individuals responded, equating to a response rate of 89.4% overall (82.2-93.9% in the different regions), and data from 3214 individuals were suitable for analysis (Table 2). In the Shanghai sample, all 3153 participants (100%) provided blood samples, of which 3151 were suitable for inclusion in the analysis, and 1030 (32.7%) volunteered to undergo endoscopy with biopsy, of whom 1029 were suitable for inclusion in the analysis of endoscopic data. Six participants did not undergo biopsy because they met biopsy exclusion criteria (e.g. presence of esophageal varices or angioma), leaving 1022 individuals with biopsy results suitable for analysis.

Participants

Several demographic variables differed between those who did and those who did not volunteer for endoscopy in the Shanghai region. Greater proportions of participants who underwent endoscopy lived in a rural environment (63.1%, versus 43.8% of those who did not undergo endoscopy) or had a family history of gastrointestinal diseases (23.7% versus 11.5%), whereas the proportions of individuals who were in the youngest age range (18-29 years; 5.3% versus 13.9%), who were unmarried (3.8% versus 11.9%) or who were college graduates (8.9% versus 14.2%) were lower among the population who underwent endoscopy than the population that did not (all p ≤ 0.001). Sex, BMI, occupation, annual income, smoking status and alcohol consumption were similar among those who underwent endoscopy and those who did not.

Reliability

Internal consistency (indicated by Cronbach's alpha coefficient) was above 0.7 for all questionnaires, demonstrating good reliability. Cronbach's alpha coefficient was 0.89 for the RDQ, 0.89 for the modified Rome II questionnaire, 0.80 for the ESS, and 0.91 for the overall SF-36. For seven of the eight individual SF-36 dimensions, Cronbach's alpha coefficient was above 0.7 (0.75-0.92), but for social functioning it was 0.51.

Construct validity

Factor analysis of the modified Rome II questionnaire revealed that the 37 items distributed to seven factors with factor loadings that ranged from 0.57 to 0.94. The cumulative rate of the seven factors was 78.9%. These factors, representing dimensions of functional dyspepsia, IBS, an IBS subtype, biliary disorders, functional vomiting, aerophagia and an integrated dimension, provide empirical support for the validity of the Rome II classification system in China.

For the SF-36, all dimensions correlated most strongly with the items comprising it, except the physical functioning dimension. Spearman correlation coefficients for the association between an item score and its dimension score were greater than 0.6 (range 0.61-0.99) for all items except seven out of the ten physical functioning items (range 0.25-0.50). In factor analysis of the SF-36, the 36 items distributed to eight factors that generally supported the theoretical construct of the questionnaire (cumulative rate of 65.5%). Most items were distributed as expected from the theoretical construct (factor loadings 0.48-0.86), except for all mental health and vitality items, which were distributed to two factors (factor loadings 0.61-0.78); the social functioning items, which did not resolve into a distinct factor, but instead were distributed most strongly to role-emotional and mental health/vitality factors (factor loadings 0.45 and 0.43, respectively); and one general health item, which was also not clearly distributed to the expected factor.