Abstract
The effect on knowledge levels immediately after a course on precarity in family medicine was assessed by comparing online learning against classroom learning, both followed by time for face-to-face discussion. Of 87 family medicine interns of the same class, 65 took part in the study and were evaluated, 34 being assigned to classroom learning and 31 to online learning. The increase in knowledge after the course was significantly higher in the online learning group (+27.8 points±11.2) than in the classroom group (+9.1 points±9.0) (p<0.0001).
Keywords: Online learning; Precarity; Family practice
Abbreviations
CNIL: Commission Nationale de l’Informatique et des Libertés; SD: Standard Deviation; T0: Test before the course; T1: Test immediately after the course
Background
Patients living in precarity have poorer health as well as poorer access to healthcare and disease prevention [1,2]. What's more, their management requires a blend of medical and social care which students have little training in. The use of online courses is gaining ground in initial and continuing medical education. Online learning maximizes the number of people who can be trained while minimizing training time. It also allows the learner to follow their course at times and locations of their choosing, with their learning made easier through illustrations and interactive links [3]. Online learning’s cost-effectiveness is one advantage sometimes put forward, but it has rarely been studied [4]. Drawbacks include non-completion of the course, geographical isolation and poor interfaces. In a meta-analysis of the effectiveness of online learning among health professionals in 2008 [5], Cook et al. found it to be superior to no training at all but not significantly better than a lecture. Only a few authors have found online courses to be more effective than classroom-based ones [6,7].
Objective
Few learning resources are available to French medical students regarding the management of patients facing precarity. The result is poor knowledge of the issue and inappropriate management. Using a pragmatic approach, this study aimed to develop an online course and evaluate its effect on knowledge levels immediately after the course by comparing it against a classroom lecture.
Methods
We used a pragmatic approach to compare two groups of medical students in a prospective comparative single-center study. Approval was obtained from the Commission Nationale de l’Informatique et des Libertés (CNIL), a data protection agency, and the Sud-Est VI Clermont-Ferrand institutional review board. The online and classroom courses were put together by a committee of experts and a team of trainers. All family medicine interns of the class of 2016 (n=87) were invited to attend a course entitled "Health and Precarity" on March 21, 2019. The classroom and online learning groups were determined by alphabetical order. A time for discussion with the trainers was organized after the course for both groups. The online course was organized in the computer room of the faculty. Knowledge was assessed through a questionnaire involving 18 multiple-choice questions devised and validated by the expert committee. Of these 18 questions, 6 tested general knowledge of precarity in medicine (subgroup 1), 8 related to existing support services and benefits (subgroup 2) and 4 went back over specific cases of precarity in medicine (migrant patients, unaccompanied minors, etc.) (subgroup 3). In both groups, the questionnaires were given to the students before the training course (T0) and then immediately afterward (T1). The primary endpoint was improvement after the course, defined as the difference in points achieved on the questionnaires between T1 and T0. The secondary endpoint was the interns' satisfaction with the type of training. Statistical analyses were conducted using SAS 9.4® software at a two-tailed significance level of 5%. Quantitative variables were compared using Student's t-test, while any association between two quantitative variables was compared using Pearson's linear correlation coefficient.
Results
Pre-training knowledge was similar in the two groups (Table 1). The increase in knowledge after training was significant regardless of the type of training taken. It was higher in the online learning group (+27.8 points±11.2) than in the classroom group (+9.1 points±9.0 (p<0.0001) (Figure 1).
Figure 1: Changes in mean between T0 and T1 according to type of training.
Population studied
Total
Classroom group
Online group
P-value
Expected population, n
87
45
42
-
No-shows, n
22
11
11
-
Study population, n
65
34
31
-
Satisfaction questionnaire not completed, n
2
2
0
-
Age (mean ± SD)
28.1 ± 2.1
28.4 ± 2.6
27.7 ± 1.4
0.1867
Men, n (%)
25 (38%)
14 (41%)
11 (35%)
0.6375
Women, n (%)
40 (62%)
20 (59%)
20 (65%)
Mean at T0 (points/100 ± SD)
50.9 ± 11.4
50.4 ± 10.6
51.5 ± 12.4
0.68397
Mean at T1 (points/100 ± SD)
69 ± 13.5
59.5 ± 10.9
79.3 ± 6.6
<0.0001
Improvement after course (T1-T0 ± SD)
+18 ± 13.7
+9.1 ± 9.0
+27.8 ± 11.2
<0.0001
Improvement after course for subgroup 1 (T1 -T0 ± SD)
-
+4.21 ± 13.51
+30.64 ± 15.31
<0.0001
Improvement after course for subgroup 2 (T1 -T0 ± SD)
-
+12.53 ± 16.97
+30.54 ± 16.23
<0.0001
Improvement after course for subgroup 3 (T1 -T0 ± SD)
-
+9.94 ± 3.60
+17.68 ± 11.08
0.09
Overall satisfaction
30.7/40
27.1/40
34.5/40
<0.0001
SD: Standard Deviation; T0: Test before the course; T1: Test immediately after the course; Subgroup 1: 6 questions tested general knowledge about precarity in medicine; Subgroup 2: 8 questions related to existing support services and benefits; Subgroup 3: 4 questions went back over specific cases of precarity in medicine (migrant patients, unaccompanied minors, etc.).
Table 1: Profile of study populations and main results of the Precamed study.
All online students improved their scores after the course (by between +6 and +50 points) whereas the classroom group’s scores at the same time point differed by between -14 to +25 points, with four students achieving lower scores after the course. On subgroup analysis, a significant difference was observed (p<0.0001) between the online and classroom groups with regard to subgroups 1 (general knowledge) and 2 (support services and benefits) but not subgroup 3 (specific cases of precarity) (p=0.09). Overall satisfaction was significantly better in the online group (34.5/40 vs. 27.1/40, p<0.0001). Lastly, total cost for developing the online course was estimated at €18,000.
Conclusion
Our study shows a significantly higher increase in knowledge among online students than classroom students for learning about precarity in medicine. Satisfaction was also higher among online students. Online learning is therefore an effective tool that offers a number of advantages for both the learner and the trainer. However, there is still a need in online learning for time for face-to-face discussion, particularly with complex topics like handling precarity in medicine. Blended learning courses that combine classroom sessions with online learning have demonstrated their effectiveness and should be the preferred option for medical education [8,9].
That said, the drawbacks of online learning warrant consideration, such as their time-consuming nature owing to the high number of activities (acting and filming consultations) coupled with the high cost of producing them. Also worth bearing in mind is regular updating of the course, which is again time-consuming and costly. It must also be possible to check whether the online course has been followed by the students. Lastly, our study only investigated knowledge levels immediately after the course. Some studies have shown that at later time points the increase in knowledge is not significantly higher between online and classroom courses [10-12].
All in all, online learning is a useful alternative to classroom learning for teaching about precarity in medicine but it should be combined with time for face-to-face discussion. The cost and time it takes to put together and produce a good-quality online course must be borne in mind if incorporating it into third-level teaching of family medicine.
Acknowledgments
The PrecaMed project was chosen as part of the first call for proposals of the Learn'in Auvergne funding program for innovative learning. The authors wish to acknowledge the support they received from the National Research Agency of the French government under the Investments for the Future Program (16-IDEX-0001 CAP 20-25).
References
- Santé publique France - DRESS. Etat de santé de la population en France: rapport 2017. 2017.
- INSEE. Espérance de vie à 35 ans par catégorie socioprofessionnelle et diplôme en. 2013.
- Maisonneuve H, Chabot O. L’Internet en formation médicale continue: aussi efficace que les formations dites présentielles. La Presse Médicale. 2009; 38: 1434-1442.
- Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med. 2006; 81: 207-212.
- Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-Based Learning in the Health Professions: A Meta-analysis. JAMA. 2008; 300: 1181-1196.
- Lu D-F, Lin Z-C, Li Y-J. Effects of a Web-based course on nursing skills and knowledge learning. J Nurs Educ. 2009; 48: 70-77.
- Wiecha JM, Chetty VK, Pollard T, Shaw PF. Web-based versus face-toface learning of diabetes management: the results of a comparative trial of educational methods. Fam Med. 2006; 38: 647-652.
- Curran VR, Fleet LJ, Kirby F. A comparative evaluation of the effect of Internetbased CME delivery format on satisfaction, knowledge and confidence. BMC Med Educ. 2010; 10: 10.
- Talib N, Onikul R, Filardi D, Simon S, Sharma V. Effective educational instruction in preventive oral health: hands-on training versus web-based training. Pediatrics. 2010; 125: 547-553.
- Fernández Alemán JL, Carrillo de Gea JM, Rodríguez Mondéjar JJ. Effects of competitive computer-assisted learning versus conventional teaching methods on the acquisition and retention of knowledge in medical surgical nursing students. Nurse Education Today. 2011; 31: 866-871.
- Bell DS, Harless CE, Higa JK, Bjork EL, Bjork RA, Bazargan M, et al. Knowledge retention after an online tutorial: a randomized educational experiment among resident physicians. J Gen Intern Med. 2008; 23: 1164- 1171.
- Salter SM, Karia A, Sanfilippo FM, Clifford RM. Effectiveness of E-learning in pharmacy education. Am J Pharm Educ. 2014; 78: 83.
Download PDF