Article Text
PDF
Abstract
Objective Training in gastrointestinal endoscopy in the UK occurs predominantly in a real world one-to-one trainer to trainee interaction. Previous surveys have shown surgical and gastroenterology trainees have had mixed experiences of supervision and training, and no surveys have explored specifically the role of trainee to trainer feedback. This study aimed to explore the experience of training and of providing trainer feedback for all disciplines of endoscopy trainees.
Design/method An online survey designed in collaboration with Joint Advisory Committee training committee and trainee representatives was distributed from January 2020 but was interrupted by the COVID-19 pandemic and hence terminated early.
Results There were 129 responses, including trainees from all disciplines and regions, of which 86/129 (66.7%) rated the culture in their endoscopy units favourably—either good or excellent. 65/129 (50.4%) trainees reported having one or more training lists allocated per week, with 41/129 (31.8%) reporting only ad hoc lists. 100/129 (77.5%) respondents were given feedback and 97/129 (75.2%) were provided with learning points from the list. 65/129 (50.4%) respondents reported their trainer completed a direct observation of procedure or direct observation of polypectomies. 73/129 (56.6%) respondents reported that they felt able to give feedback to their trainer, with 88/129 (68.2%) feeling they could do this accurately. Barriers to trainer feedback cited included time constraints, lack of anonymity and concerns about affecting the trainer–trainee relationship.
Conclusion Overall, the training environment has improved since previous surveys. There are still issues around interdisciplinary differences with some surgical trainees finding the training environment less welcoming, and trainee perceptions of hierarchical barriers and trainer responsiveness to feedback limiting the accuracy of their feedback.
- endoscopy
- colorectal surgery
- diagnostic and therapeutic endoscopy
- endoscopic procedures
- surgical training
Data availability statement
Data are available on reasonable request.
This article is made freely available for use in accordance with BMJ’s website terms and conditions for the duration of the covid-19 pandemic or until otherwise determined by BMJ. You may use, download and print the article for any lawful, non-commercial purpose (including text and data mining) provided that all copyright notices and trade marks are retained.
https://bmj.com/coronavirus/usageStatistics from Altmetric.com
- endoscopy
- colorectal surgery
- diagnostic and therapeutic endoscopy
- endoscopic procedures
- surgical training
Significance of this study
What is already known on this topic
The Joint Advisory Committee has overhauled endoscopy training in the UK improving certification processes and creating resources for trainer development.
Previous surveys of surgical and gastroenterology trainees have shown supervision and feedback have been mixed and there have been few studies exploring the role of the trainee feeding back to the trainer.
What this study adds
Trainees value high-quality training and trainers are more supportive and available than previously reported.
The ability to feedback to trainers is valued by trainees but perceptions around anonymity and hierarchy can prevent trainees giving accurate feedback.
How might it impact on clinical practice in the foreseeable future
Pressures on workforce provision and endoscopy training from the European working time directive, shape of training and COVID-19 pandemic means extra care is needed to maintain standards of endoscopy training.
Enhancing a reciprocal feedback environment will help trainer and trainee interaction.
More work is needed to explore the trainer perspective to inform trainee perceptions.
Introduction
Independent endoscopy practice in the UK now requires certification regulated by the Joint Advisory Committee (JAG). JAG certification for oesophagogastroduodenoscopy (OGD) is mandatory for certification of completion of training (CCT) for gastroenterology trainees and colonoscopy certification is expected, not mandated.1 Colorectal surgical trainees are expected to achieve equivalent competency in colonoscopy and the same is expected for upper gastrointestinal surgical trainees in OGD.2 As demand for endoscopy has increased rapidly,3 a workforce of non-medical/clinical endoscopists has expanded. They are trained via traditional training pathways or on accelerated training programmes that focus on a single endoscopic modality.
The majority of training in endoscopy happens on real patients on a one-to-one, trainer–trainee basis. The gold standard is for each trainee to have at least one adequately booked training list per week. Training can occur on an ad hoc basis where the trainee attends any list with a competent trainer.4 Training quality is overseen by the JAG training committee and trainees must complete a minimum number of procedures, achieve thresholds for key performance indicators (KPIs) and endoscopy non-technical skills (ENTS) prior to certification assessment.5 6 Training adjuncts such as simulation training,7 8 online and practical courses9 are promising, but the majority of training still occurs in the one-to-one environment.
Trainers are expected to have skills in teaching and facilitating feedback, in addition to expertise in the procedures they teach.10 JAG training courses teach practical teaching skills, how to train in ENTS and suggest methods of providing feedback. There is no formal accreditation for the role of endoscopy trainer other than attendance at the courses, hence previous surveys have shown wide variation in quality of training.11–13
Trainees receive formal feedback via the direct observation of procedure (DOPS) and direct observation of polypectomies (DOPys) forms which are a mandatory part of JAG endoscopy training. Similarly, trainers receive formal feedback via the direct observation of teaching (DOTS) tool. The use of DOTS is not mandated, and little work has been done to assess the use of this form, barriers to use or if it improves trainee experience.
Aims
This study aims to explore the views of endoscopy trainees on their learning environment, training and of providing trainer feedback.
Methods
A survey was devised in collaboration between trainee representatives and the JAG training committee. The survey was created on an electronic survey platform (Surveymonkey, Palo Alto, California, USA), with an email link sent to gastroenterology trainees via British Society of Gastroenterology (BSG) trainees committee, surgical trainees via Duke’s Club and a pop-up screen linking the survey was created on the electronic JAG endoscopy training system (JETS).
The survey was released on 29 January 2020 and anonymous responses were collected prospectively for 7 weeks as the COVID-19 pandemic resulted in significant disruption to endoscopy training the survey was terminated early.
This is the first survey to collect data from all disciplines of endoscopy trainees simultaneously, and the first to ask specifically about the experience of trainee to trainer feedback.
Results
A total of 129 endoscopy trainees completed the survey, there are approximately 1700 trainees registered on JETs potentially reflecting a 7.6% response due to closing the survey prematurely. However, it is unknown how many are active users on JETs and the responses reflected a wide range of disciplines, level of training and geography (table 1).
A table outlining the number of responses from each region, level of training and full or flexible training
Of 129, 65 (50.4%) trainees reported having one or more training lists allocated per week, with 41/129 (31.8%) reporting only ad hoc lists. Most respondents, 79/129 (61.2%), had an appraisal at least annually, however, 50/129 (38.8%) were never scheduled for appraisal formally. Of those without a scheduled appraisal, 27 (54%) were surgical trainees, 14 (28%) were trainee nurse endoscopists on the accelerated course and 9 (18%) were trainee nurse endoscopists on the traditional pathway. Overall, trainees rated the culture in their endoscopy units favourably with 86/129 (66.7%) rating it good or excellent.
Survey respondents were asked to reflect on their last endoscopy list. For 82/129 (63.6%), this was a dedicated training list, 22/129 (17.1%) ad hoc with their usual trainer, 12/129 (9.3%) ad hoc with someone else and 13/129 (10%) other. Of 129, 117 (90.7%) of the lists were diagnostic lists (5/129 endoscopic retrograde cholangiopancreatography and 4/129 other therapeutic). Of 129, 68 (52.7%) reported being trained by a consultant gastroenterologist, 37/129 (28.7%) by a consultant surgeon and 17/129 (13.2%) by a nurse endoscopist, with the remainder including specialty doctors or senior trainees.
During the list/training
Most respondents 122/129 (94.6%) reported trainer presence in the room during training, either at the bedside or nearby and this was felt to be appropriate for the level of supervision required (strongly agree 60.5%, agree 34.1%).
Of 129, 65 (50.4%) respondents rated training quality as excellent, with further 45/129 (34.9%) rating it as good. In contrast, three people reported training quality as poor. Of 129, 61 (47.3%) reported their trainer discussed their learning needs at the beginning of the list, with 49/129 (38%) stating their needs had been discussed on a previous list. Further results are presented in table 2.
A table showing the number of responses denoting their agreement with statements about their experience of their training for the last endoscopy list they went to
Of 129, 78 (60.5%) of respondents reported that their trainer was not distracted at all by other duties during their list with 4 (3.1%) reporting their trainer was distracted throughout the list.
Feedback from the trainer to the trainee
Of 129, 100 (77.5%) respondents were given feedback and 97/129 (75.2%) came away with learning points from the list. Of 129, 109 (84.5%) respondents stated the trainer allowed time for training within the confines of the list, 94/129 (72.9%) respondents were guided through the feedback provided. Of 129, 65 (50.4%) respondents reported their trainer completed a DOPS or DOPyS.
Feedback to the trainer
Of 129, 73 (56.6%) respondents reported that they felt able to give feedback to their trainer, with 88/129 (68.2%) feeling they could do this accurately and this represented a mixture of different types of trainees. Of 129, 61 (47.3%) reported regularly completing DOTS forms.
Barriers to trainer feedback
The survey contained an open-ended question on the barriers affecting trainee to trainer feedback. Answers were reviewed and grouped according to trends. Key themes are outlined in table 3 and more examples available in online supplemental material.
Supplemental material
Key themes denoting barriers to trainee to trainer feedback with verbatim examples from the open-ended question responses
How to improve training/the DOTS form
The last survey question asked respondents to outline how to improve the process of feedback for trainers. Some responses related to feedback and others covered issues around training in general. Key points included upskilling trainers in teaching endoscopy, formalising trainee to trainer feedback with an annual review and instituting a system of integrated training between endoscopists of different disciplines (eg, medical and surgical).
Discussion
To our knowledge, this is the first survey to collect data from all disciplines of endoscopy trainees in the UK. Overall, once trainees have access to endoscopy lists, most trainees describe a positive culture of training in endoscopy units leading to a positive experience.
This has improved since a survey of gastroenterology trainees in 2008 where only 60% experienced adequate supervision and only 23% of trainees rated their training as good/excellent.14 This suggests that the culture of training has improved significantly. However, adequate access to training lists remains an issue. A BSG trainees survey reported that 50% of gastroenterology trainees had not achieved full certification in colonoscopy near CCT,11 vs only 11% on this previous survey.14
Endoscopy training is facing significant challenges as departments balance the demands for service delivery with training.3 For gastroenterology trainees, the European working time directive (EWTD) and dual accreditation in general internal medicine can impact endoscopy training time.11 Similarly, surgical trainees have a competing need for operative exposure together with the impact of EWTD.15 16 Clinical endoscopists will help with service delivery but still require access to training lists. Only time will tell whether the shortened gastroenterology higher specialty training time from 5 years to 4 will have an impact on overall success rates of certification in endoscopy.11
Individually, the different groups had similar experiences, and there were no marked differences for flexible training/less than full time trainees. However, there were ongoing concerns felt by surgical trainees as barriers to their training. Only 38.9% of surgical trainees who responded reported having access to one training list per week, reflecting data from a Dukes’ Club 2019 survey15 and a JAG 2010 survey.16 In contrast, 70% of gastroenterology trainees who responded reported two or more scheduled endoscopy lists per week. Other barriers previously reported by surgical trainees include conflicting clinical obligations and prioritisation of gastroenterology or clinical endoscopist trainees for lists.15 This has implications for certification as significantly fewer surgical trainees achieve certification in OGD, colonoscopy and flexible sigmoidoscopy compared with gastroenterology trainees.17
What about clinical endoscopists?
Recent international surveys on the impact of COVID-19 on endoscopy training have not included clinical endoscopists.18 19 Although it impacts all trainees, a 4-month reduction in access will markedly impact those with training pathways of fewer than 2 years and for whom endoscopy is their main role. This has the potential to create difficulties between trainees of different disciplines as they compete for a finite resource. Maintaining an environment of training is a JAG requirement,4 and therefore, being aware of the challenges and removing barriers is vital.
Trainer qualities
A paper using expert interviews and qualitative methods outlined the qualities of an excellent endoscopy trainer(figure 1),10 some of the principles are outlined below with the results of the survey.
Attribute domains of an excellent endoscopy teacher taken from Wells 2010.10
Understanding the long term and the individual needs
Most trainers discussed the training needs of trainees either at the beginning of the list or at a prior list. This reflects the understanding that training sits within the long-term goal of development. Many trainees only reported ad hoc training lists which is likely due to competing responsibilities as noted on prior surveys.11 15 Despite this, most trainees reported that trainers understood when to intervene, which illustrates that trainers are intuitive and understand trainees’ needs.
Interpersonal attributes
Two-thirds of trainees reported the overall training environment as good or excellent. Most trainees felt well supported and reported that trainers were seldom distracted. There is a fine balance between necessary close supervision while still respecting the progression of trainees’ development. Nearly all trainees felt they could raise concerns or ask for help during the procedure. However, for formalised trainer feedback, many trainees raised concerns about providing constructive criticism due to perceived hierarchy.
Teaching attributes
DOPs was created to assess technical skills as influenced by KPIs and non-technical skills including management decisions.5 Although most trainees received feedback, only 50.4% had a DOPS/DOPys completed. JAG recommends one DOPS/DOPys per list.20 Time may have been a barrier as many lists were ad hoc lists. The lack of formal documented feedback makes assessing the quality and structure of training difficult. DOPs are required for certification and should be embedded in routine practice.
Another trainer attribute is the ability to learn and improve. Our data show that trainees have concerns about trainer feedback via DOTs due to perceived concerns about disrupting the training relationship due to a lack of anonymity. The General Medical Council survey collates anonymous trainee data to maintain ambiguity which could be implemented by JAG. Other suggestions included completing DOTS at a later date, but this may result in inaccurate data as accurate feedback should be timely.21 22 Overall, the creation of an environment of bidirectional feedback from the outset would break down perceived barriers.
Limitations
The survey commenced in January 2020 but was halted prematurely due to the COVID-19 pandemic and endoscopy disruption hence the low response rate. Other surveys have collected data over 1 year15 and it is unclear how many trainees accessed JETs during the survey time. This survey does not cover the trainer’s perspective which would be helpful to confirm or refute perceived trainee concerns.
Summary
This pre-COVID-19 survey of endoscopy training showed an overall improvement in training experience across all disciplines. Access to lists remains an issue but once trainees overcame this, training experience was good. Trainees value high-quality training and trainers are more supportive and available than previously reported. The ability to feedback to trainers is valued by trainees, and many solutions were offered to overcome current barriers. The ongoing challenges of balancing demand for training opportunities is likely to worsen with the COVID-19 pandemic. Further work should be done to examine the trainer’s perspective on feedback assessing if the barriers perceived by trainees are confirmed.
Supplemental material
Data availability statement
Data are available on reasonable request.
Ethics statements
Patient consent for publication
Ethics approval
The survey was voluntary and no ethical approval was required in line with similar surveys.
Acknowledgments
We are indebted to the JAG office team who helped format the electronic version of the survey, create the popup box on JETS and retrieved the results.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Twitter @lil_ratcliffe
Contributors ER devised the initial survey with CW and WSN, all authors reviewed draft survey and contributed to the final survey design. Data were analysed by ER, CW, WSN, SS and all authors were given opportunity to comment and advise on the data. ER produced the initial draft manuscript which was reviewed and edited by SS, WSN and CW. All authors then reviewed and contributed to the final manuscript.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.