The validation of the malay version of binge eating scale: a comparison with the structured clinical interview for the DSM-IV
© Robert et al.; licensee BioMed Central Ltd. 2013
Received: 20 February 2013
Accepted: 3 June 2013
Published: 9 August 2013
The Binge Eating Scale (BES) questionnaire is a self-administered instrument developed to identify binge eaters. The aim of this study was to assess the validity of the Malay language version of BES as a screening instrument for binge eating. A cut-off point of 17 is taken as comparable to the Structured Clinical Interview for the DSM-IV patient version (SCID-I/P), the gold standard for the diagnosis of Binge Eating Disorder.
The questionnaire was structured from the English version of the original scale which has 16 items. The sample was obtained from outpatients and healthy adult volunteers at a teaching hospital. After completion of BES, the participants were interviewed with the SCID-I/P. The interviewer was blinded to the BES score.
The Malay version of BES yielded a sensitivity of 84.6%, specificity of 94.9%, a positive predictive value of 81.8%, a negative predictive value of 95.7%. Area under the curve was 0.95 (95% confidence interval: 0.90-0.99). The results of factor analysis indicated a two factor structure of feelings/cognition and behavioural manifestation of binge eating. Internal consistency, Cronbach’s alpha was 0.89.
The BES performed satisfactorily as a valid instrument for screening of binge eating among Malay-speaking population.
Binge eating is currently increasing in recognition in association with higher body mass index (BMI), psychiatric symptoms, psychological disturbances, personality psychopathology and impaired quality of life [1, 2]. It is a condition where a person recurrently has out-of-control eating episodes but without inappropriate compensatory behaviour. Binge eating disorder has been recognised as a diagnostic entity and included in the 4th edition of Diagnostic and Statistical Manual of Mental Disorder (DSM-IV-TR). A binge episode is characterised by: (1) eating, in a discrete period of time (e.g. within any two hour period), an amount of food that is definitely larger than most people would eat during a similar period of time and under similar circumstances and (2) a sense of lack of control over eating during the episode (e.g. a feeling that one cannot stop eating or control what or how much one is eating) . Binge eating was found in 7.5% to 30% of obese individuals seeking treatment [4–9] whist in community studies conducted in the United States, a lower prevalence was found, ranging from 1.0%-4.6% [9–11].
Structured clinical interview is considered the gold standard to assess any psychological disorder including binge eating. However, it is time-consuming, requires training and can only be administered to one subject at any particular time [12, 13]. Therefore, self-administered questionnaires are useful alternatives used in studies on binge eating. The Binge Eating Scale (BES) is a 16-item self-administered questionnaire, designed specifically to identify the behavioural, emotional and cognitive characteristics of binge eating in individuals. Each item presents three or four differently weighted statements. Subjects would select the statement that best describes their perceptions and feelings about their eating behaviour. This questionnaire has been proven to be useful to identify binge eaters, to evaluate binge eating severity and also as a parameter of treatment outcome [14, 15]. This measure has been found to discriminate effectively among individuals with absent, moderate, and severe binge eating problems. The authors of this measure reported that it yields internally consistent scores (Cronbach’s alpha = 0.85) . Based on BES scores, the uncontrolled eating behaviour are graded into three different levels of severity: subjects scoring 17 and less were considered non-binge eaters, those scoring between 18 and 26 were moderate binge eaters and those scoring 27 and above were considered severe binge eaters [15, 16]. Among the different validated versions in the literature are the English, Portuguese, Italian, and Spanish versions [6, 12, 14, 17].
Due to the diversity of the Malaysian population and the use of the Malay language as the main language, we believed that it was necessary to have a validated Malay version of the BES to allow better understanding of the questions asked. The Malay version of the BES was obtained from a previous community survey study . To our knowledge, there has been no validation study of the Malay version of BES using a gold standard interview such as the SCID-I/P. The aim of this study was to assess the validity of the Malay version of BES against the SCID-I/P.
This was a cross sectional study carried out at a teaching hospital. We recruited 150 participants attending the medical outpatient clinic, medical students and staff members who were able to read and write in the Malay Language. Participants were excluded if they have serious medical illnesses that would affect their ability to answer the questionaire. Written informed consent was obtained from those who agreed to participate. Three ethnic groups were represented, the majority (76.7%) being Malay. The Malay Language ‘Bahasa Melayu’ is the national language for all ethnic groups to learn in school. It is the first language for the Malays. All our participants including the Chinese (17.3%) and Indians (6%) were fluent in the Malay Language.
Prior permission to use the questionnaire was obtained from the authors of the original English version of BES. Participants were initially asked to complete the Malay version of the BES. Participants were then interviewed with the Structured Clinical Interview for DSM-IV-patient version (SCID-I/P) by the investigator who was blinded to the BES scores. The investigator was trained by a senior psychiatrist familiar with the SCID-I/P. The BES questionnaire was then scored by an assistant who was blinded to the SCID-I/P results. The BES was scored by adding the values for the 16 individual items, with a final score varying from 0–46. The study protocol was approved by our Institutional Ethics and Clinical Research Committee (Approval number: FF-350-2012) and registered with the National Medical Research Registry (NMRR-12-825-13598). Participants received no compensation.
As discussed above, the BES is a questionnaire that addresses behavioural manifestations (e.g. eating large amounts of food) and feelings/cognitions surrounding a binge episode (e.g. guilt, fear of being unable to stop eating). It consists of 16 items, eight describing the behavior manifestations and eight describing feelings/cognition. Each question had 3 or 4 weighted statements that reflect a range of severity for each characteristic. Weights were 0–3, (0 = indicates no binge eating problems, 3 = reflects severe binge eating problems). Participants choose the statement that best describes their perceptions and feelings about their eating behavior. For example, item number six has three statements that read: (1) I don’t feel any guilt or self-hate after I overeat (weight = 0); (2) After I overeat, occasionally I feel guilt or self-hate (weight = 1); and (3) Almost all the time I experience strong guilt or self-hate after I overeat (weight = 1).
The BES is scored by adding the individual values for the 16 items with the possible range of scores from 0–46. A cut-off point of 17 is commonly used; a score of 18 and above indicates the presence of binge eating.
The Structured Clinical Interview for the DSM-IV-patient version SCID I/P is a widely used clinician-administered interview for diagnosing psychiatric disorders according to DSM-IV Axis I.
Data were analysed using IBM SPSS version 19. Concurrent validity was assessed in terms of sensitivity, specificity and predictive values. For these analyses, BES was compared to SCID-I/P, considered in this study the gold standard for diagnosis of BED. The Receiver Operator Characteristic curve (ROC curve) was used to describe the instrument’s performance. Construct validity was assessed using factor analysis. The internal consistency was evaluated by Cronbach’s alpha coefficient for the total score and score for each item.
The study included 150 participants: 47 (31.3%) males, and 103 (68.7%) females, with age range from 18 years to 68 years (mean = 31 ± 0.898). There were 115 (76.7%) Malays, 20 (17.3%) Chinese and 9 (6%) Indians. A majority were from the middle income group (89.8%) and completed tertiary education (75.5%).
BES score at a cut-off point of 17 and SCID-I/P diagnosis
Prevalence of BED according to SCID-I/P and BES
95% Confidence intervals
Positive predictive value
Negative predictive value
Results of factor analyses: varimax rotated factor loadings
Results of reliability analysis, using Cronbach’s alpha
Cronbach’s alpha if item deleted
Over the last decade, there has been a marked escalation of incidence of overweight and obesity worldwide. The World Health Organisation estimates that in 2008, 35% of adults and overweight and 11% are obese . A national survey in 2006 has revealed a high prevalence of overweight and obesity of 44% among the adult population in Malaysia . Binge eating is a recognised association with overweight and obesity, with a rate of 19% among healthy sedentary staff of a government institution  and 10.8% among patients attending a dietician clinic . This emphasises the importance of identifying this particular eating habit among our population. Our choice of BES was based on the simple scoring system and its widespread use as a screening tool in various studies in the literature.
To the best of our knowledge, this current study is the first to compare the Malay version of BES with the standard SCID-I/P. The results showed that the Malay version of BES is a good tool to discriminate between binge eaters and non-binge eaters in our population with an AUC = 0.95 (95% CI: 0.90-0.99). It also showed high level of sensitivity in identifying individuals with binge eating behaviour (84.6%) and considerable specificity in identifying individuals without binge eating behaviour (94.9%). The findings of this study were fairly consistent with the validation study that used the Italian language version of BES, which was conducted among patients attending an outpatient clinic, yielding a sensitivity of 84.8%, and specificity of 74.6% . However, a study that utilised the Portuguese language version  reported a higher sensitivity (97.8%) but lower specificity (47.7%) compared to ours and the Italian version. One reason for this variation could be the different recruitment strategies employed. The study that utilised the Portuguese version recruited participants through a newspaper advertisement to a eating disorder reference centre. Similarly, a higher sensitivity (94%) and lower specificity (76%) was also found in a recent study using the BES to screen patients seeking bariatric surgery in the United States of America .
Other studies that examines the validity of BES showed BES as a useful screening tool in identifying individuals with binge eating behaviour as well as being accurate in identifying individuals without binge eating behaviour. Two studies in the literature that compared BES with Eating Disorder Examination (EDE), another clinician directed interview showed that BES is an appropriate measure although with false positives being common. We did not use EDE in this study as it is too lengthy, taking as long as 60 minutes and we deemed this not practicable in an outpatient setting. The first study yielded sensitivity and specificity of 85% and 20% respectively  and second study yielded 93% and 49% . Both studies had sensitivity comparable with ours but lower specificity which may be due to false positives. Screening instruments however, tend to tolerate a greater false positive rate. Accepting some false positives and then ruling out a true case in a complete interview is preferred rather than missing true cases completely as a result of a false negative screen.
The use of factor analysis helped to evaluate the factorial structure of the Malay version. Consistent with the literature, there were two main factors obtained which measures feelings/cognition and behavioural manifestations .
Internal consistency, a quantitative measurement using Cronbach alpha coefficient is to assess the consistency of results across the items within a test. The internal consistency reliability study of the Malay version of BES showed a value of Cronbach’s alpha of 0.89. Alpha coefficient ranges in value from 0 to 1 where the higher score indicates a more reliable scale. A value above 0.7 is indicated to be an acceptable reliability coefficient and thus our value of 0.89 fulfils this criterion . This value is also consistent with the original BES which had a Cronbach’s alpha = 0.85  and the Portuguese version, Cronbach’s alpha = 0.89 . This demonstrates that the Malay version of the BES is a reliable screening tool for the Malay-speaking population.
This study has limitations. Although there was a good sample size, there was a low percentage of males and small representation from the lower socioeconomic group. This may limit the generalizability of these findings.
This study demonstrated high levels of sensitivity (84.6%) and specificity (94.9%) of the Malay version of BES in detecting binge eating behaviour within a Malay-speaking adult population, with a positive predictive value of 81.8%, negative predictive value of 95.7% and Cronbach’s alpha of 0.89. In light of the increasing prevalence of overweight and obesity, binge eating may very well be an important factor. Therefore, the Malay version of the BES is useful as it has been demonstrated to be a valid and reliable instrument that is easy to administer.
The authors wish to thank the Dean and Director of the Universiti Kebangsaan Malaysia Medical Centre (UKMMC) for the permission to publish these data. We are also grateful to the staffs of the Endocrine Unit for their assistance in data acquisition. We would like to thank Elsevier for permission to use the English version of the BES questionnaire in this study, and Dr Anilah Abdul Rahim for providing the Malay version of the questionnaire.
- Picot AK, Lilenfeld LRR: The Relationship Among Binge Severity, Personality Psychopathology and Body Mass Index. Int J Eat Disord. 2003, 34: 98-107. 10.1002/eat.10173.View ArticlePubMedGoogle Scholar
- Kolotkin RL, Westman EC, Ostbye T, Crosby RD, Eisenson HJ, Binks M: Does Binge Eating Disorder Impact Weight-Related Quality of Life. Obes Res. 2004, 12 (6): 999-1005. 10.1038/oby.2004.122.View ArticlePubMedGoogle Scholar
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, 4th edition (text revision). 2000, Washington, DC: American Psychiatric AssociationView ArticleGoogle Scholar
- Brody ML, Walsh BT, Devlin MJ: Binge Eating disorder:Reliability and validity of a new diagnostic category. J Consult Clin Psychol. 1994, 62: 381-386.View ArticlePubMedGoogle Scholar
- Yanovski SZ: Binge Eating Disorder:Current Knowledge and Future Directions. Obes Res. 1993, 1: 306-324. 10.1002/j.1550-8528.1993.tb00626.x.View ArticlePubMedGoogle Scholar
- Ricca V, Mannucci E, Moretti S, Bernardo MD, Zucchi T, Cabras PL, Rotella CM: Screening for binge eating disorder in obese outpatients. Comprehesive Psychiatry. 2000, 41: 111-115. 10.1016/S0010-440X(00)90143-3.View ArticleGoogle Scholar
- Spitzer RL, Devlin M, Walsh BT, Hasin D, Wing R, Marcus M: Binge eating disorder: A multisite field trial of the diagnostic criteria. Int J Eat Disord. 1992, 11 (Suppl 3): 191-203.View ArticleGoogle Scholar
- Spitzer RL, Yanovski S, Wadden T, Wing R, Marcus M, Stunkard A: Binge eating disorder: Its further validation in a multisite study. Int J Eat Disord. 1993, 13 (Suppl 2): 137-153.PubMedGoogle Scholar
- Grucza RA, Przybeck TR, Cloninger CR: Prevalence and Correlates of Binge Eating Disorder in a Community Sample. Compr Psychiatry. 2007, 48 (Suppl 2): 124-131.PubMed CentralView ArticlePubMedGoogle Scholar
- Bruce B, Formally RD, Agras WS: Binge eating in females: A population-based investigation. Int J Eat Disord. 1992, 12: 365-373. 10.1002/1098-108X(199212)12:4<365::AID-EAT2260120404>3.0.CO;2-M.View ArticleGoogle Scholar
- Stunkard A, Berkowitz R, Tanrikut C, Reiss E, Young L: D-fenflufamine treatment of binge eating disorder. Am J Psychiatry. 1996, 153: 1455-1459.View ArticlePubMedGoogle Scholar
- Freitas SR, Lopes CS, Appolinario JC, Coutinho W: The assessment of binge eating disorder in obese women: A comparison of the binge eating scale with the structured clinical interview for the DSM-IV. Eating Behaviours. 2006, 7: 282-289. 10.1016/j.eatbeh.2005.09.002.View ArticleGoogle Scholar
- Welch E, Birgegard A, Parling T, Ghaderi A: Eating disorder examination questionnaire and clinical impairment assessment questionnaire: General population and clinical norms for young adult women in Sweden. Behav Res Ther. 2011, 49: 85-91. 10.1016/j.brat.2010.10.010.View ArticlePubMedGoogle Scholar
- Gormally J, Black S, Daston S, Rardin D: The Assessment of Binge Eating Severity Among Obese Persons. Addict Behav. 1982, 7: 47-55. 10.1016/0306-4603(82)90024-7.View ArticlePubMedGoogle Scholar
- Marcus MD, Wing RR, Hopkins J: Obese binge eaters: Affect, cognition and response to behavioral weight control. J Consult Clin Psychol. 1988, 3: 433-439.View ArticleGoogle Scholar
- Timmerman GM: Binge Eating Scale: Further Assessment of Validity and Reliability. Journal of Applied Biobehavioural Research. 1999, 4 (1): 1-12. 10.1111/j.1751-9861.1999.tb00051.x.View ArticleGoogle Scholar
- Partida OZ, Garcia RR, Cardenas AR: Evaluation of the binge eating scale in Mexican population: translation and psychometric properties of the Spanish version. Psiquiatria. 2006, 22: 30-6.Google Scholar
- Anilah AR, Rohana AG, Norasyikin AW, Badrulnizam LB, Suehazlyn Z, Noorlita A, Norhaliza A, Wong M, Norlaila M, Rizal AM, Nor Azmi K, NisakBarakhatun: Prevalence of binge eating and obesity among civil servants of the Ministry of Health Putrajaya. In Proceedings 14th Congress of the ASEAN Federation of Endocrine Societies (AFES). Challenges of Endocrinology in Asia. 2007, 24 (1): 172-29th Nov -2nd Dec 2007; Kuala Lumpur Convention CentreGoogle Scholar
- World Health Organization: Overweight and Obesity Factsheet no 311. 2008, Geneva (Switzerland),http://www.who.int/mediacentre/factsheets/fs311/en,Google Scholar
- Institute for Public Health (IPH) 2008: The Third National Healthy and Morbidity Survey (NHMS III). 2006, Malaysia: Ministry of Health, 2:Google Scholar
- Loo TH, Maniam T, Ainshah O: Psychiatric Morbidity, Personality Profile and Saliva Cortisol Levels in Overweight and Obese Patients Referred to Dietician Clinics in UKMMC. Malaysian Journal of Psychiatry E-Journal. 2011, 20: 1-Google Scholar
- Fitzpatrick SL, Corsica JA, Azarbad L, Hall BJ, Grupski AE, Hood MM: Examining the Binge Eating Scale in Screening for Binge Eating Disorder in Bariatric Surgery Candidates. The Journal of Metabolic Surgery and Allied Care Clinical Research. 2012, Published online 28 October 2012Google Scholar
- Celio AA, Wilfley DE, Crow SJ: A comparison of the binge eating scale, questionnaire for eating and weight patterns-revised, and eating disorder examindation questionnaire with instructions with the eating disorder examination in the assessment of binge eating disorder and its symptoms. Int Eat Disord. 2004, 36: 434-44. 10.1002/eat.20057.View ArticleGoogle Scholar
- Hood MM, Grupski AE, Hall BJ, Ivan I, Corsica J: Factor structure and predictive utility of the Binge Eating Scale in bariatric surgery candidates. Surg Obes Relat Dis. 2012, Published online 14 July 2012Google Scholar
- Santos JR: Cronbach’s Alpha: A tool for Assessing the Reliability of Scales. J Ext. 1999, 37 (2): 1-5.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.