Research article | Open | Published:
Evaluation of an online training program in eating disorders for health professionals in Australia
Journal of Eating Disordersvolume 3, Article number: 37 (2015)
The Erratum to this article has been published in Journal of Eating Disorders 2016 4:8
Early detection and treatment of eating disorders is instrumental in positive health outcomes for this serious public health concern. As such, workforce development in screening, diagnosis and early treatment of eating disorders is needed. Research has demonstrated both high rates of failure to accurately diagnose and treat cases early and low levels of perceived access to training in eating disorders by health professionals–representing an urgent need for clinician training in this area. However, significant barriers to the access of evidence-based training programs exist, including availability, cost and time, particularly when large geographic distances are involved. Online learning presents a solution to workforce challenges, as it can be delivered anywhere, at a fraction of the cost of traditional training, timing is user controlled, and a growing body of research is demonstrating it as effective as face-to-face training. The Centre for Eating and Dieting Disorders in Australia has developed an Online Training Program In Eating Disorders, to educate health professionals in the nature, identification, assessment and management of eating disorders. The aim of the current study was to evaluate the ability of this online learning course to improve clinician levels of knowledge, skill and confidence to treat eating disorders. As well as its effect on stigmatised beliefs about eating disorders known to effect treatment delivery.
One-hundred-eighty-seven health professionals participated in the program. A pre training questionnaire and a post training evaluation examined participants’ levels of knowledge, skill and confidence to treat eating disorders, as well attitudes and beliefs about people with eating disorders.
Significant improvements in knowledge, skill, and confidence to treat eating disorders was found between pre and post program assessment in health professionals who completed the course, along with a significant decrease in stigmatised beliefs about eating disorders.
The results of this study demonstrated that the online training program was an effective tool in increasing health professionals’ level of knowledge, skill and confidence to treat people with eating disorders. The results also demonstrated that online training reduced health professionals’ personal bias towards people with eating disorders. Limitations of this study include the use of self-report measures rather than observation of the health professional in clinical practice. As a result, it is not possible to make determinations regarding the translation of these results to clinical settings.
The findings of this study suggest that online training programs may present an innovative solution to the considerable workforce development challenges faced by clinicians needing training in eating disorders.
Eating disorders (EDs) are biologically based serious mental illnesses  which multiple medical and psychological sequelae . The impact of an ED is often on young women as they enter adolescence and young adulthood, with considerable implications for their immediate and long-term development. As such they represent a significant cost for the individual, their family members and society . EDs are the leading cause of disability due to mental health disorder amongst females aged from 10 to 24 years . Mortality rates are substantially higher than in the wider population, and higher than for any other psychiatric illness . Two recent studies [6, 7] have shown suicide contributes significantly to the mortality rate and there are high levels of self-harm evident in this illness group . Comorbidity is the norm rather than the exception, with anxiety (>50 %), depressive disorders (20–80 %) and substance abuse all common and adding significantly to the overall burden of disease [9–11]. The research literature suggests that eating disorders occur at similar rates across Western countries. For example, in the Australian community, lifetime prevalence of an eating disorder is as high as 15 % in females and 3 % in males . The estimated financial cost in Australia associated with disability-adjusted life years attributable to eating disorders is greater than that for anxiety and depression combined , rendering it a significant public health concern.
Early diagnosis and treatment are essential to a good outcome, but barriers presently exist across the health system. Even though the spectrum of health professionals dealing with EDs has increased in recent years, specific training in or experience with ED patients is still lacking . In their early stages, before physical symptoms arise, psychological symptoms of an eating disorder can be well hidden. Patients may present with other complaints such as fatigue, abdominal pain and constipation, so that up to 50 % of cases can go undetected in the primary care setting . In the emergency department the picture is similar, lack of training combined with atypical presentations has been demonstrated to result in the majority of eating disorders remaining undiagnosed for some years . Another study of family physicians in the UK  found that females were more likely to receive a diagnosis than males, even when symptoms were identical, and overall there was a reluctance to diagnose AN, even in patients with very low weight status. The authors also concluded that there were major discrepancies between primary care decision-making and recommended guidelines for ED patients. A study in UK pediatric hospitals  to determine the training needs of doctors found a large proportion (73 %) perceived eating disorders to be of high importance, but rated knowledge, skill base and confidence to treat as low. A national US survey  found a lack of essential treatment skills for eating disorders in resident doctors and an associated reduction in empathy for these patients.
Lack of empathy combined with negative stereotypical images of patients with eating disorders and their families are not uncommon . Stigmatisation remains a significant barrier to receiving effective treatment. One study  found elevated levels of stigmatisation towards patients with AN based on beliefs about personal blame for the illness, and that these were higher than for obese patients. Another study investigating stigmatisation  reported perceptions that AN was caused by poor parenting and a lack of self-discipline with little involvement of biological factors, and perhaps most importantly that stigma-induced shame caused by these perceptions discouraged AN sufferers from seeking treatment.
In Australia, and elsewhere in the world, workforce education poses a particular set of problems. Australia has a generalist mental health model, so that care for EDs is delivered for the most part by clinicians in general practice, community clinics, general medicine, emergency departments and psychiatric wards. Funding for specialist services is limited, which means that training of health professionals at all places where contact with individuals with EDs arise becomes a priority if adequate evidence-based care is to be provided. Further, there is a tyranny of distance with communities being spread across large geographic areas, with relatively few metropolitan hubs of expertise. Like many countries, most health infrastructure in Australia is located in large urban centres, leaving rural and regional areas under-serviced. This means that many health care professionals working in regional and rural locations, and the clients with eating disorders that present to them, are disadvantaged in terms of access high quality care and training.
Online training presents a potential solution as it can be delivered anywhere, at any time, and at a fraction of the costs of traditional training methods. There is growing body of research [22, 23] suggesting that internet-based medical education is just as effective as the more traditional forms. Internet-based training revealed equivalent effectiveness in imparting knowledge [22, 24, 25], with similar–and sometimes greater–levels of satisfaction  than traditional learning, and can produce changes in behaviour and sustained knowledge gains over time . A systematic review and meta-analysis of internet-based learning modules, identified certain basic principles such as interactivity, practice exercises, repetition and feedback to the user as being most important to ensure user satisfaction and to achieve real learning outcomes .
While several internet-based programs targeting self-help and support in eating disorders [29–33], exist there are few reported in the literature that target health professionals. A Canadian group  evaluated a web-based ED prevention program designed for school teachers and health practitioners, orientated around the factors that influence body image and dieting and the inherent risk of disordered eating patterns. They found the program increased both knowledge and efficacy in the cohort.
Recently Fairburn and Wilson  have argued that evidence based therapies are poorly propagated across the health system and as such “internet-enhanced training” , is required to disseminate evidence based training across the health workforce. Support for using internet-based approaches to solve the issues of workforce training in eating disorders has now earnt a wider audience .
To address the issues of workforce competencies and skill to detect, diagnose and manage eating disorders in the Australian health workforce, The Centre for Eating and Dieting Disorders (CEDD) has developed an online learning program for health professionals in the nature, identification, assessment and management of eating disorders. This comprehensive, interactive core competencies based training is the first of its kind internationally, the result of a collaborative project spanning a number of care settings and institutions, and draws on the extensive clinical and research experience of internationally renowned specialists in the field. This interactive program provides comprehensive training in diagnosis along with the medical, psychological and dietetic management of these mental illnesses.
The current study examined the impact of the above program on the knowledge, skills, willingness, confidence and stigma levels of health professionals treating eating disorders within the Australian health workforce.
The study was reviewed and approved by the Royal Prince Alfred Hospital. The program was advertised globally via online advertisements on mental health related institute websites and the CEDD website and email list serve. Health professionals from Australia and other countries (Indonesia, United Kingdom and USA) provided informed consent to participate in the study and had 6 months to complete the online training program. Health professionals registered progressively from July 2012 to October 2013. During this 6-month period, 187 health professionals completed the program.
Training modules and topics were designed and written by both expert and novice panels of health professionals inclusive of nurses, dietitians, psychologists, psychiatrists and general practitioners (GPs), and curriculum development was based on literature reviews and expert consensus building. The program comprises five modules–understanding eating disorders, diagnosis, preparation for treatment, treatment and management–each 3.5 h in length, and combines text-based psycho-education, role-plays, interactive exercises and quizzes, as well as video footage of sufferers and their families. Each of the five learning modules contains a core curriculum, required to pass the quiz, an ‘in practice’ section with additional clinical tools and role-plays, and a resources section with key readings and resources.
Pre and post questionnaires
Program participants were required to complete a pre training questionnaire prior and a post training evaluation upon completion of the program. Pre and post training self-report questionnaires were developed by the authors and are available over the Internet for the purpose of evaluating the effectiveness of the online training program. Participants were asked 10 questions rating their current level of knowledge (e.g. the risk factors associated with the development of an ED), and 9 questions rating their skill level for assessment and treatment of EDs (e.g. ability to conduct ED screening) on a 5-point Likert scale (1. Very low; 2. Low; 3. Moderate; 4. High; 5. Very High). Participants were asked 6 questions regarding their personal attitudes and beliefs about people with an ED to assess stigma (e.g. they are to blame for their condition) and asked to rate on a 5-point Likert scale (1. Strongly Disagree; 2. Disagree; 3. Neutral; 4. Agree; 5. Strongly agree). Participants rated their willingness and confidence in treating each of the eating disorder subtypes on a 5-point Likert scale ranging from 1 (Not at all willing/Not at all confident) to 5 (WillingIncrease in current knowledge of eating disorders and skill level[Para, ID = Par21]/Confident). Additional items assessing demographic data including gender, age, primary professional discipline, work setting, length of time in practice and prior experience treating EDs were included at baseline. Participants also rated their experience of the online training program.
Data were analysed using SPSS Version 20.0. Wilcoxon signed ranked test was used to investigate changes between pre and post training evaluation scores for items and subscales (knowledge, skill and bias) as appropriate for nonparametric data.
The mean age bracket of the 187 participants was 31 to 40 years and the vast majority were females (91.4 %). All of these participants completed the program in its entirety, and all of the questionnaires at pre and post. Half of the participants (49.2 %) reported having been in practice for less than 5 years. Of those who completed the online learning program, 34.6 % were psychologists, 22.7 % nurses, 19.5 % dietitians and 9.2 % social workers. The majority of respondents indicated they worked in a community health or mental health centre (40.2 %). More than half of the respondents (62.2 %) indicated their employment setting as being within the metropolitan area and the other 36.8 % worked in a rural/regional employment setting.
Almost half (46.0 %) of the respondents reported they don’t have the skills to treat ED patients. In addition, 34.0 % of respondents indicated that there were not enough resources available to help them adequately treat these patients with only 2.7 % indicated they did not like treating this patient group or that it was too time consuming.
Increase in current knowledge of eating disorders and skill level
Upon completion of the online training program, participants reported a significant increase in their knowledge about EDs (z = 11.58, p < 0.001), and their clinical skills assessing and treating eating disorders (z = 11.42, p < 0.001) (see Table 1).
Decrease in personal bias toward eating disorders
In addition, upon completion of the online program, participants also endorsed significantly less stigmatised beliefs towards EDs (z = 5.76, p < 0.001) (see Table 1).
Increase in confidence to treat eating disorders
Health professionals reported a significant increase in their confidence to treat each EDs after completing the online training program, across all ED subtypes, AN (z = 9.12, p < 0.001), BN (z = 9.85, p < 0.001), BED (z = 9.85, p < 0.001) and EDNOS (z = 9.55, p < 0.001).
Willingness to treat eating disorders
Participant’s willingness to treat BED (z = 2.58, p = 0.01) and EDNOS (z = 2.57, p = 0.01) increased significantly after completing the online training program. There was no difference between pre and post training evaluations in health professionals’ willingness to treat anorexia nervosa (z = 0.53, p = 0.60), and bulimia nervosa (z = 1.74, p = 0.08).
Online training program evaluations
The acceptability of the program Overall the program received overwhelmingly positive self-report reviews. 96.2 % of respondents indicated that their current clinical practice had improved as a result of completing the online learning program. 98.4 % of respondents indicated that their expectations of the online learning program were met. 99.5 % of respondents indicated that the program was relevant or highly relevant to their practice. 95.8 % of respondents indicated that the program met their needs. One hundred percent of respondents stated that they would recommend the online learning program to other health professionals.
The purpose of the current study was to evaluate the effectiveness of an online training program specifically developed to disseminate evidence-based knowledge to health professionals working in the area of EDs. Online training programs offer a significant advantage over face-to-face training, particularly when considered within the context of rural and remote geographic locations, such as those within Australia, where training programs may not be easily accessed.
The results of this study demonstrated that the online training program was an effective tool in increasing health professionals’ level of knowledge, skill and confidence to treat people with EDs. The results also demonstrated that online training reduced health professionals’ personal bias towards people with EDs.
The lack of significant change on some measures of the willingness to treat item was likely result of a ceiling effect–in that pre willingness to treat was in this cohort very high.
Limitations of this study include the use of self-report measures rather than observation of the health professional in clinical practice. As a result, it is not possible to make determinations regarding the translation of these results to clinical settings. Another limitation included the absence of a wait list or manual control condition in order to compare different training methodologies.
The importance of this study lies firstly in the uniqueness of its subject, which targeted a broad range of health professionals, participants including psychologists, nurses, dietitians and social workers. The comprehensive format allowed access to best practice strategies from experts in the ED field covering a wide range of medical, dietetic and psychological management practices. Despite the diverse backgrounds of the participants the results were positive in all areas of assessment.
We note that no GPs were involved in the evaluation of this program and hence we are unable to report on the effect of the program for this important health discipline. This is believed to be a result of advertising and promotion of the program being more effective within the public hospital and clinic system, and GPs being a difficult sub-population to engage in learning both due to access to them, and considerable professional time constraints. Future research needs to evaluate the effectiveness of the program for GPs.
To our knowledge this online training program is the first of its kind internationally. The results of the study suggest that it may be an effective tool for the dissemination of knowledge, skill and confidence to general health clinicians in the diagnosis, treatment and ongoing management of eating disorders.
This study demonstrates support for a novel avenue of training in the area of EDs. Based on the results of this study, it is possible to conclude that this online training program offers the potential to make a substantial contribution to the development of the ED workforce. The online program has the capacity to reach large numbers of health care professionals and the ability to overcome barriers to access including time, cost and distance. Despite improvements in treatments for EDs, it is apparent that there are unmet needs for treatment and barriers to treatment-seeking amongst individuals with EDs, and a lack of workforce training is one of the factors contributing to this. These barriers included stigmatising attitudes and a lack of ED specific skills amongst health professionals. This online training program was able to increase knowledge, skill and confidence in health care professionals and also reduced personal bias towards sufferers.
Klump KL, Bulik CM, Kaye WH, Treasure J, Tyson E. Academy for eating disorders position paper: eating disorders are serious mental illnesses. Int J Eat Disord. 2009;42(2):97–103.
Bailey AP, Parker AG, Colautti LA, Hart LM, Liu P, Hetrick SE. Mapping the evidence for the prevention and treatment of eating disorders in young people. J Eat Disord. 2014;2:5–12.
Madden S, Morris A, Zurynski YA, Kohn M, Elliot EJ. Burden of eating disorders in 3–13 year old children in Australia. Med J Aust. 2009;190(8):410–4.
Matthews R, Hall WD, Vos T, Patton GC, Degenhardt L. What are the major drivers of prevalent disability burden in young Australians? Med J Aust. 2011;194(5):232–5.
Arcelus J, Mitchell AJ, Wales J, Nielsen S. Mortality rates in patients with anorexia nervosa and other eating disorders: a meta-analysis of 36 studies. Arch Gen Psychiatry. 2011;68(7):724–31.
Berkman ND, Lohr KN, Buik CM. Outcomes of eating disorders: a systematic review of the literature. Int J Eat Disord. 2007;40(4):293–309.
Preti A, Rocchi M, Sisti D, Camboni M, Miotto P. A comprehensive meta-analysis of the risk of suicide in eating disorders. Acta Psychiatria Scand. 2011;124(1):6–17.
Kostro K, Lerman JB, Attia E. The current status of suicide and self-injury in eating disorders: a narrative review. J Eat Disord. 2014;2:19–28.
Braun DL, Sunday S, Halmi K. Psychiatric comorbidity in patients with eating disorders. Psychol Med. 1994;24(4):859–67.
Godart NT, Flament MF, Curt F, Perdereau F, Lang FO, Venisse JL, et al. Anxiety disorders in subjects seeking treatments for eating disorders: a DSM IV controlled study. Psychiatry Res. 2003;117(3):245–58.
Kaye WH, Bulik CM, Thorton L, Barbarich N, Masters K. Comorbidity of anxiety disorders with anorexia and bulimia nervosa. Am J Psychiatr. 2004;161(12):2215–21.
Hay P, Giros F, Mond J. Prevalence and socio-demographic correlates of DSM-5 eating disorders in the Australian population. J Eat Disord. 2015;3:1–7.
Strober M, Freeman R, Lampert C, Diamond J. The association of anxiety disorders and obsessive compulsive personality disorder with anorexia nervosa: evidence from a family study with discussion of nosological and neurodevelopmental implications. Int J Eat Disord. 2007;40(Suppl):S46–51.
Sim LA, McAlpine DE, Grothe KB, Himes SM, Cockerill RG, Clark MM. Identification and treatment of eating disorders in the primary care setting. Mayo Clin Proc. 2010;85(8):746–51.
Dooley-Hash S, Lipson SK, Walton MA, Cunningham RM. Increased emergency department use by adolescents and young adults with eating disorders. Int J Eat Disord. 2013;46:308–15.
Currin L, Schmidt U, Waller G. Variables that influence diagnosis and treatment of the eating disorders within primary care settings: a vignette study. Int J Eat Disord. 2007;40(3):257–62.
McDonagh JE, Minnaar G, Kelly K, O’Connor D, Shaw KL. Unmet education and training needs in adolescent health of health professionals in a UK children’s hospital. Acta Paediatr. 2006;95(6):715–9.
Mahr F, Farahmand P, Bixler EO, Domen RE, Moser EM, Nadeem T, et al. A national survey of eating disorder training. Int J Eat Disord. 2015;48:443–5.
McMaster R, Beale B, Hillege S, Nagy S. The parent experience of eating disorders: interactions with health professionals. Int J Ment Health Nurs. 2004;13:67–73.
Zwickert K, Rieger E. Stigmatizing attitudes towards individuals with anorexia nervosa: an investigation of attribution theory. J Eat Disord. 2013;1(5).
Stewart MC, Keel PK, Schiavo RS. Stigmatization of anorexia nervosa. Int J Eat Disord. 2006;39:320–5.
Wutoh R, Boren SA, Balas EA. eLearning: a review of internet-based continuing medical education. J Contin Educ Health Prof. 2004;24(1):20–30.
Bauer S, Moessner M. Harnessing the power of technology for the treatment and prevention of eating disorders. Int J Eat Disord. 2013;46:508–15.
Sitzmann T, Kraiger K, Stewart D, Wisher R. The comparative effectiveness of web-based and classroom instruction a meta-analysis. Pers Psychol. 2006;59:623–64.
Jahng N, Krug D, Zhang Z. Student achievement in online distance education compared to face-to-face education, European Journal of Open, Distance and E-Learning (2007). Retrieved from: http://www.eurodl.org/materials/contrib/2007/Jahng_Krug_Zhang.htm
Curran VR, Fleet L. A review of evaluation outcomes of web‐based continuing medical education. Med Educ. 2005;39(6):561–7.
Fordis M, King JE, Ballantyne CM, Jones PH, Schneider KH, Spann SJ, et al. Comparison of the instructional efficacy of Internet-based CME with live interactive CME workshops: a randomized controlled trial. JAMA. 2005;294(9):1043–51.
Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Monton V. Instructional design variations in internet-based learning for health professionals: a systemic review and meta-analysis. Acad Med. 2010;85:909–22.
Carrard I, Crepin C, Rouget P, Lam T, Golay A, Van der Linden M. Randomised controlled trial of a guided self-help treatment on the internet for binge eating disorder. Behav Res Ther. 2011;1–10.
Ljotsson B, Lundin C, Mitsell K, Carlbring P, Ramklint M, Ghaderi A. Remote treatment of bulimia nervosa and binge eating disorder: a randomized trial of internet-assisted cognitive behavioural therapy. Behav Res Ther. 2007;45:649–61.
Pretorius N, Arcelus J, Beecham J, Dawson H, Doherty F, Eisler I, et al. Cognitive-behavioural therapy for adolescents with bulimic symptomatology: the acceptability and effectiveness of internet-based delivery. Behav Res Ther. 2009;47(9):729–36.
Jacobi C, Volker U, Trockel MT, Taylor CB. Effects of an internet-based intervention for sub-threshold eating disorders: a randomized controlled trial. Behav Res Ther. 2012;50:93–9.
Hoyle D, Slater J, Williams C, Schmidt U, Wade T. Evaluation of a web-based skills intervention for carers of people with anorexia nervosa: a randomized controlled trial. Int J Eat Disord. 2013;46:634–8.
McVey G, Gusella J, Tweed S, Ferrari M. A controlled evaluation of web-based training for teachers and public health practitioners on the prevention of eating disorders. Eat Disord. 2009;17:1–26.
Fairburn CG, Wilson GT. The dissemination and implementation of psychological treatments: problems and solutions. Int J Eat Disord. 2013;46:516–21.
Fairburn CG, Cooper Z. Therapist competence, therapy quality, and therapist training. Behav Res Ther. 2011;50:373–8.
Paxton SJ. Dissemination in the internet age: Taming a wild thing. Int J Eat Disord. 2013;45:525–8.
The authors declare no competing interests.
Sarah Maguire, Stephen Touyz and Janice Russell were responsible for the development of the program, the writing of the program curriculum, design of program evaluation, and writing of the paper. Adrienne O’Dell was involved in the management of the evaluation, data analysis and writing. Rachel Brownlow and Catia Dias-De-Costa were involved in data analysis and writing of the manuscript. All authors read and approved the final manuscript.