Journal Article
. 2021 Mar; 7(1):e13681.
doi: 10.2196/13681.

Exploring the Cost of eLearning in Health Professions Education: Scoping Review

Edward Meinert 1 Jessie Eerens 1 Christina Banks 1 Stephen Maloney 2 George Rivers 3 Dragan Ilic 4 Kieran Walsh 5 Azeem Majeed 1 Josip Car 1 
Affiliations
  • PMID: 33704073
  •     70 References

Abstract

Background: Existing research on the costs associated with the design and deployment of eLearning in health professions education is limited. The relative costs of these learning platforms to those of face-to-face learning are also not well understood. The lack of predefined costing models used for eLearning cost data capture has made it difficult to complete cost evaluation.

Objective: The key aim of this scoping review was to explore the state of evidence concerning cost capture within eLearning in health professions education. The review explores the available data to define cost calculations related to eLearning.

Methods: The scoping review was performed using a search strategy with Medical Subject Heading terms and related keywords centered on eLearning and cost calculation with a population scope of health professionals in all countries. The search was limited to articles published in English. No restriction was placed on literature publication date.

Results: In total, 7344 articles were returned from the original search of the literature. Of these, 232 were relevant to associated keywords or abstract references following screening. Full-text review resulted in 168 studies being excluded. Of these, 61 studies were excluded because they were unrelated to eLearning and focused on general education. In addition, 103 studies were excluded because of lack of detailed information regarding costs; these studies referred to cost in ways either indicating cost favorability or unfavorability, but without data to support findings. Finally, 4 studies were excluded because of limited cost data that were insufficient for analysis. In total, 42 studies provided data and analysis of the impact of cost and value in health professions education. The most common data source was total cost of training (n=29). Other sources included cost per learner, referring to the cost for individual students (n=13). The population most frequently cited was medical students (n=15), although 12 articles focused on multiple populations. A further 22 studies provide details of costing approaches for the production and delivery of eLearning. These studies offer insight into the ways eLearning has been budgeted and project-managed through implementation.

Conclusions: Although cost is a recognized factor in studies detailing eLearning design and implementation, the way cost is captured is inconsistent. Despite a perception that eLearning is more cost-effective than face-to-face instruction, there is not yet sufficient evidence to assert this conclusively. A rigorous, repeatable data capture method is needed, in addition to a means to leverage existing economic evaluation methods that can then test eLearning cost-effectiveness and how to implement eLearning with cost benefits and advantages over traditional instruction.

Keywords: costs and cost analysis; distance education; economics; education; online education; online learning; professional education.

The evaluating self-management and educational support in severely obese patients awaiting multidisciplinary bariatric care (EVOLUTION) trial: principal results.
Raj S Padwal, Scott Klarenbach, +4 authors, Sumit R Majumdar.
BMC Med, 2017 Mar 03; 15(1). PMID: 28249576    Free PMC article.
(S)Partners for Heart Health: a school-based program for enhancing physical activity and nutrition to promote cardiovascular health in 5th grade students.
Joseph J Carlson, Joey C Eisenmann, +5 authors, Deborah L Feltz.
BMC Public Health, 2008 Dec 24; 8. PMID: 19102777    Free PMC article.
Effects of the Australian National Hand Hygiene Initiative after 8 years on infection control practices, health-care worker education, and clinical outcomes: a longitudinal study.
M Lindsay Grayson, Andrew J Stewardson, +6 authors, Hand Hygiene Australia and the National Hand Hygiene Initiative.
Lancet Infect Dis, 2018 Oct 03; 18(11). PMID: 30274723
Doctors and nurses benefit from interprofessional online education in dermatology.
Thomas Schopf, Vibeke Flytkjær.
BMC Med Educ, 2011 Oct 18; 11. PMID: 21999114    Free PMC article.
Alzheimer's Prevention Education: If We Build It, Will They Come? www.AlzU.org.
R S Isaacson, N Haynes, +9 authors, C N Ochner.
J Prev Alzheimers Dis, 2014 Jan 01; 1(2). PMID: 28529932    Free PMC article.
Sharing best practices through online communities of practice: a case study.
Annamma Udaya Thomas, Grace P Fried, Peter Johnson, Barbara J Stilwell.
Hum Resour Health, 2010 Nov 16; 8. PMID: 21073733    Free PMC article.
Learning psychotherapy in the digital age.
John Manring, Roger P Greenberg, Robert Gregory, Lisa Gallinger.
Psychotherapy (Chic), 2011 Jun 07; 48(2). PMID: 21639655
Delivering a MOOC for literature searching in health libraries: evaluation of a pilot project.
Gil Young, Lisa McLaren, Michelle Maden.
Health Info Libr J, 2017 Dec 22; 34(4). PMID: 29265692
A descriptive, cross-sectional study of medical student preferences for vodcast design, format and pedagogical approach.
Robin K Pettit, Marjorie Kinney, Lise McCoy.
BMC Med Educ, 2017 May 21; 17(1). PMID: 28526022    Free PMC article.
Development, implementation and pilot evaluation of a Web-based Virtual Patient Case Simulation environment--Web-SP.
Nabil Zary, Gunilla Johnson, Jonas Boberg, Uno G H Fors.
BMC Med Educ, 2006 Mar 01; 6. PMID: 16504041    Free PMC article.
Medical education as a science: the quality of evidence for computer-assisted instruction.
Gerard S Letterie.
Am J Obstet Gynecol, 2003 Mar 14; 188(3). PMID: 12634669
The feasibility and acceptability of administering a telemedicine objective structured clinical exam as a solution for providing equivalent education to remote and rural learners.
Ryan T Palmer, Frances E Biagioli, +3 authors, Lisa G Dodson.
Rural Remote Health, 2015 Dec 04; 15(4). PMID: 26632083    Free PMC article.
A study protocol for a randomised controlled trial of an interactive web-based intervention: CancerCope.
Suzanne K Chambers, Lee Ritterband, +8 authors, Jeffrey Dunn.
BMJ Open, 2017 Jun 25; 7(6). PMID: 28645985    Free PMC article.
The value of online learning and MRI: finding a niche for expensive technologies.
David A Cook.
Med Teach, 2014 Jul 30; 36(11). PMID: 25072533
Evaluating the efficacy and cost-effectiveness of web-based indicated prevention of major depression: design of a randomised controlled trial.
Claudia Buntrock, David D Ebert, +4 authors, Matthias Berking.
BMC Psychiatry, 2014 Feb 04; 14. PMID: 24485283    Free PMC article.
Internet-based training in a practice-based research network consortium: a report from the Primary Care Multiethnic Network (PRIME Net).
Robert L Williams, Laurie McPherson, +3 authors, PRIME Net clinicians.
J Am Board Fam Med, 2009 Jul 10; 22(4). PMID: 19587260    Free PMC article.
Impact of a multipronged education strategy on antibiotic prescribing in Quebec, Canada.
Karl Weiss, Régis Blais, +2 authors, Michel Gaudet.
Clin Infect Dis, 2011 Jul 28; 53(5). PMID: 21791439
Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study.
Stephen A Stansfeld, Sally Kerry, +7 authors, Kamaldeep Bhui.
BMJ Open, 2015 Oct 28; 5(10). PMID: 26503383    Free PMC article.
Evidence-based microsurgical skill-acquisition series part 1: validated microsurgical models--a systematic review.
Danielle Dumestre, Justin K Yeung, Claire Temple-Oberle.
J Surg Educ, 2014 May 07; 71(3). PMID: 24797848
Systematic Review.
Online learning applied to a course on rational therapeutics: an international comparison between final year students of two medical schools.
Robert Likic, Casey White, +6 authors, Cary Engleberg.
Br J Clin Pharmacol, 2012 Jul 05; 75(2). PMID: 22759217    Free PMC article.
Decentralizing the delivery of HIV pre-exposure prophylaxis (PrEP) through family physicians and sexual health clinic nurses: a dissemination and implementation study protocol.
Malika Sharma, Allison Chris, +12 authors, Darrell H S Tan.
BMC Health Serv Res, 2018 Jul 05; 18(1). PMID: 29970087    Free PMC article.
Comparison of Web-based and face-to-face training concerning patient education within a hospital system.
Jill Berger, Robert Topp, +2 authors, Lynne Stewart.
J Nurses Staff Dev, 2009 Jun 09; 25(3). PMID: 19502896
Barriers to adoption of the surgical resident skills curriculum of the American College of Surgeons/Association of Program Directors in Surgery.
Patricia A Pentiak, Diane Schuch-Miller, +4 authors, James Robbins.
Surgery, 2013 Jul 03; 154(1). PMID: 23809481
Online psychoeducational support for infertile women: a randomized controlled trial.
Tara M Cousineau, Traci C Green, +5 authors, Mark Perloe.
Hum Reprod, 2007 Dec 20; 23(3). PMID: 18089552    Free PMC article.
Gaps in the existing public health informatics training programs: a challenge to the development of a skilled global workforce.
Ashish Joshi, Douglas Marcel Puricelli Perin.
Perspect Health Inf Manag, 2012 Dec 05; 9. PMID: 23209452    Free PMC article.
Online virtual cases to teach resource stewardship.
Linghong Linda Zhou, Gordon Tait, +2 authors, Shirley Lake.
Clin Teach, 2018 Jun 13; 16(3). PMID: 29893013
An Approach for Calculating Student-Centered Value in Education - A Link between Quality, Efficiency, and the Learning Experience in the Health Professions.
Peter Nicklen, George Rivers, +4 authors, Stephen Maloney.
PLoS One, 2016 Sep 16; 11(9). PMID: 27632427    Free PMC article.
Training practitioners to deliver opportunistic multiple behaviour change counselling in primary care: a cluster randomised trial.
Christopher C Butler, Sharon A Simpson, +11 authors, Stephen Rollnick.
BMJ, 2013 Mar 21; 346. PMID: 23512758    Free PMC article.
The Business Engineering Surgical Technologies (BEST) teaching method: incubating talents for surgical innovation.
V de Ruijter, P Halvax, +3 authors, S Perretta.
Surg Endosc, 2014 Jul 06; 29(1). PMID: 24993171
Review.
Internet and information technology use in treatment of diabetes.
N Kaufman.
Int J Clin Pract Suppl, 2010 Aug 18; (166). PMID: 20377663
Review.
Digital Education in Health Professions: The Need for Overarching Evidence Synthesis.
Josip Car, Jan Carlstedt-Duke, +7 authors, Digital Health Education Collaboration.
J Med Internet Res, 2019 Feb 15; 21(2). PMID: 30762583    Free PMC article.
Highly Cited. Systematic Review.
Opportunities for training for nutritional professionals in nutritional genomics: What is out there?
Jorja Collins, Melissa M Adamski, Cliona Twohig, Chiara Murgia.
Nutr Diet, 2017 Dec 19; 75(2). PMID: 29250906
Cost savings associated with pharmacy student interventions during APPEs.
Brian M Shepler.
Am J Pharm Educ, 2014 May 23; 78(4). PMID: 24850933    Free PMC article.
A partial economic evaluation of blended learning in teaching health research methods: a three-university collaboration in South Africa, Sweden, and Uganda.
Minna Kumpu, Salla Atkins, +2 authors, ARCADE consortium.
Glob Health Action, 2016 Oct 12; 9. PMID: 27725076    Free PMC article.
Improving the efficiency of advanced life support training: a randomized, controlled trial.
Gavin D Perkins, Peter K Kimani, +7 authors, Electronic Advanced Life Support Collaborators.
Ann Intern Med, 2012 Jul 04; 157(1). PMID: 22751757
40-4-40: educational and economic outcomes of a free, international surgical training event.
James Glasbey, Piriyah Sinclair, +2 authors, ASiT 40-4-40 Course Organisers.
Postgrad Med J, 2017 Jul 14; 93(1106). PMID: 28701324
HypoAware-a brief and partly web-based psycho-educational group intervention for adults with type 1 and insulin-treated type 2 diabetes and problematic hypoglycaemia: design of a cost-effectiveness randomised controlled trial.
Stefanie M P A Rondags, Maartje de Wit, +2 authors, Frank J Snoek.
BMC Endocr Disord, 2015 Aug 22; 15. PMID: 26292674    Free PMC article.
Application of a low-cost web-based simulation to improve students' practical skills in medical education.
Pablo Moreno-Ger, Javier Torrente, +3 authors, María Dolores Comas-Rengifo.
Int J Med Inform, 2010 Mar 30; 79(6). PMID: 20347383
Consortium-based approach to an online preceptor development program.
Charles H McDuffie, Lori J Duke, +4 authors, Elizabeth S McCullough.
Am J Pharm Educ, 2011 Oct 05; 75(7). PMID: 21969721    Free PMC article.
www.elearnSCI.org: a global educational initiative of ISCoS.
H S Chhabra, L A Harvey, +25 authors, I Lanig.
Spinal Cord, 2013 Mar 02; 51(3). PMID: 23448857
Review.
The release of catecholamines from the adrenal medulla and its modulation by alpha 2-adrenoceptors in the anaesthetized dog.
S Foucart, R Nadeau, J de Champlain.
Can J Physiol Pharmacol, 1987 Apr 01; 65(4). PMID: 3038285
Electronic resources for surgical anatomy.
Ah-Rin Anna Choi, Rodney Tamblyn, Mark D Stringer.
ANZ J Surg, 2008 Dec 18; 78(12). PMID: 19087047
Review.
Web-based training for EMT continuing education.
John M Jerin, Thomas D Rea.
Prehosp Emerg Care, 2005 Sep 09; 9(3). PMID: 16147485
A new hybrid model for exploring the adoption of online nursing courses.
Feng-Cheng Tung, Su-Chao Chang.
Nurse Educ Today, 2007 Aug 21; 28(3). PMID: 17706842
A holistic model for evaluating the impact of individual technology-enhanced learning resources.
James D Pickering, Viktoria C T Joynes.
Med Teach, 2016 Sep 02; 38(12). PMID: 27584048
Preparing the 21st century global healthcare workforce.
Sheri D Pruitt, JoAnne E Epping-Jordan.
BMJ, 2005 Mar 19; 330(7492). PMID: 15774994    Free PMC article.
Review.
A review of web-based support systems for students in higher education.
Marietta Papadatou-Pastou, Rhianna Goozee, +2 authors, Patapia Tzotzoli.
Int J Ment Health Syst, 2017 Oct 13; 11. PMID: 29021822    Free PMC article.
Review.
Updated guidance for trusted systematic reviews: a new edition of the Cochrane Handbook for Systematic Reviews of Interventions.
Miranda Cumpston, Tianjing Li, +4 authors, James Thomas.
Cochrane Database Syst Rev, 2019 Oct 24; 10. PMID: 31643080
Highly Cited.
Scoping studies: advancing the methodology.
Danielle Levac, Heather Colquhoun, Kelly K O'Brien.
Implement Sci, 2010 Sep 22; 5. PMID: 20854677    Free PMC article.
Highly Cited.
Evaluating PLATO: postgraduate teaching and learning online.
Menna Brown, Alison Bullock.
Clin Teach, 2014 Jan 11; 11(1). PMID: 24405912
Teaching pathology via online digital microscopy: positive learning outcomes for rurally based medical students.
Sundram Sivamalai, Shashidhar Venkatesh Murthy, Tarun Sen Gupta, Torres Woolley.
Aust J Rural Health, 2011 Jan 27; 19(1). PMID: 21265925
A critical examination of the time and workload involved in the design and delivery of an e-module in postgraduate clinical education.
Laura Delgaty.
Med Teach, 2012 Nov 16; 35(5). PMID: 23151211
Developing an integrated evidence-based medicine curriculum for family medicine residency at the University of Alberta.
G Michael Allan, Christina Korownyk, +3 authors, Donna Manca.
Acad Med, 2008 Jun 04; 83(6). PMID: 18520465
The virtual revolution: implications for academe.
S L Pardue.
Poult Sci, 2001 May 25; 80(5). PMID: 11372703
A model for continuing pharmacy education.
Karen J McConnell, Carey Newlon, Jeannine Dickerhofe.
Am J Pharm Educ, 2009 Sep 25; 73(5). PMID: 19777102    Free PMC article.
Interprofessional education: effects on professional practice and healthcare outcomes (update).
Scott Reeves, Laure Perrier, +2 authors, Merrick Zwarenstein.
Cochrane Database Syst Rev, 2013 Apr 02; (3). PMID: 23543515    Free PMC article.
Highly Cited. Systematic Review.
Development and evolution of The Knowledge Hub for Pathology and related electronic resources.
David F Hardwick, John Sinard, Fred Silva.
Hum Pathol, 2011 Feb 15; 42(6). PMID: 21316077
Evaluation of pharmacotherapy laboratory revisions implemented to reduce cost.
Casey Gallimore, Susanne G Barnett, Andrea L Porter, Karen J Kopacek.
Am J Pharm Educ, 2012 May 23; 76(4). PMID: 22611276    Free PMC article.
A comprehensive health labour market framework for universal health coverage.
Angelica Sousa, Richard M Scheffler, Jennifer Nyoni, Ties Boerma.
Bull World Health Organ, 2013 Dec 19; 91(11). PMID: 24347720    Free PMC article.
Assessing learning outcomes and cost effectiveness of an online sleep curriculum for medical students.
Hari Bandla, Rose A Franco, +3 authors, Dawn Bragg.
J Clin Sleep Med, 2012 Aug 16; 8(4). PMID: 22893775    Free PMC article.
Preventing disease through opportunistic, rapid engagement by primary care teams using behaviour change counselling (PRE-EMPT): protocol for a general practice-based cluster randomised trial.
Clio Spanou, Sharon A Simpson, +13 authors, Chris C Butler.
BMC Fam Pract, 2010 Sep 23; 11. PMID: 20858273    Free PMC article.
Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction.
Pradeep Paul George, Nikos Papachristou, +15 authors, Josip Car.
J Glob Health, 2014 Jul 01; 4(1). PMID: 24976965    Free PMC article.
Scaling-up an efficacious school-based physical activity intervention: Study protocol for the 'Internet-based Professional Learning to help teachers support Activity in Youth' (iPLAY) cluster randomized controlled trial and scale-up implementation evaluation.
Chris Lonsdale, Taren Sanders, +19 authors, David R Lubans.
BMC Public Health, 2016 Aug 26; 16(1). PMID: 27557641    Free PMC article.
A Scoping Review of Healthcare Costs for Patients with Cystic Fibrosis.
Ilene L Hollin, Karen A Robinson.
Appl Health Econ Health Policy, 2015 Dec 10; 14(2). PMID: 26649564
Review.
E-Learning with virtual teammates: A novel approach to interprofessional education.
Maja Djukic, Jennifer Adams, +4 authors, Marc Triola.
J Interprof Care, 2015 Jun 30; 29(5). PMID: 26120894
No clinic left behind: providing cost-effective in-services via distance learning.
Herschel Knapp, Michael Fletcher, +2 authors, Matthew Bidwell Goetz.
J Healthc Qual, 2011 Sep 01; 33(5). PMID: 23845129
The evaluating self-management and educational support in severely obese patients awaiting multidisciplinary bariatric care (EVOLUTION) trial: rationale and design.
Raj S Padwal, Arya M Sharma, +4 authors, Sumit R Majumdar.
BMC Health Serv Res, 2013 Sep 26; 13. PMID: 24059346    Free PMC article.
What deters nurses from participating in web-based graduate nursing programs?: A cross-sectional survey research study.
Suzanne H Carpenter.
Nurse Educ Today, 2015 Aug 16; 36. PMID: 26276532
Virtual reality training versus blended learning of laparoscopic cholecystectomy: a randomized controlled trial with laparoscopic novices.
Felix Nickel, Julia A Brzoska, +7 authors, Beat P Müller-Stich.
Medicine (Baltimore), 2015 May 23; 94(20). PMID: 25997044    Free PMC article.
Factors influencing rural health care professionals' access to continuing professional education.
Vernon R Curran, Lisa Fleet, Fran Kirby.
Aust J Rural Health, 2006 Mar 04; 14(2). PMID: 16512789