JAG consensus statements for training and certification in oesophagogastroduodenoscopy
======================================================================================

* Keith Siau
* Ian L P Beales
* Adam Haycock
* Durayd Alzoubaidi
* Rachael Follows
* Rehan Haidry
* Jayan Mannath
* Susan McConnell
* Aravinth Murugananthan
* Srivathsan Ravindran
* Stuart A Riley
* R N Williams
* Nigel John Trudgill
* Andrew M Veitch

## Abstract

**Introduction** Training and quality assurance in oesophagogastroduodenoscopy (OGD) is important to ensure competent practice. A national evidence-based review was undertaken to update and develop standards and recommendations for OGD training and certification.

**Methods** Under the oversight of the Joint Advisory Group (JAG), a modified Delphi process was conducted with stakeholder representation from British Society of Gastroenterology, Association of Upper Gastrointestinal Surgeons, trainees and trainers. Recommendations on OGD training and certification were formulated following literature review and appraised using Grading of Recommendations Assessment, Development and Evaluation. These were subjected to electronic voting to achieve consensus. Accepted statements were incorporated into the updated certification pathway.

**Results** In total, 32 recommendation statements were generated for the following domains: definition of competence (4 statements), acquisition of competence (12 statements), assessment of competence (10 statements) and post-certification support (6 statements). The consensus process led to following certification criteria: (1) performing ≥250 hands-on procedures; (2) attending a JAG-accredited basic skills course; (3) attainment of relevant minimal performance standards defined by British Society of Gastroenterology/Association of Upper Gastrointestinal Surgeons of Great Britain and Ireland, (4) achieving physically unassisted D2 intubation and J-manoeuvre in ≥95% of recent procedures, (5) satisfactory performance in formative and summative direct observation of procedural skills assessments.

**Conclusion** The JAG standards for diagnostic OGD have been updated following evidence-based consensus. These standards are intended to support training, improve competency assessment to uphold standards of practice and provide support to the newly-independent practitioner.

*   endoscopy

## Introduction

Oesophagogastroduodenoscopy (OGD) is the single most commonly performed endoscopic procedure in the UK, with over 1 million procedures per year.1 Over the last decade, ongoing efforts to improve quality of OGD worldwide have been driven by the high rates of post-endoscopy upper gastrointestinal cancer (PEUGIC), improvements in colonoscopy outcomes and increasing expectations by patients to receive high quality endoscopy.2 These have included the development of national quality standards which define the requirements for competent OGD practice.3 

Pivotal to quality assurance in endoscopy is training and certification. In the UK, the Joint Advisory Group in Gastrointestinal Endoscopy (JAG) oversees endoscopy training and certification.4 Certification is a standardised process which formally credentials a trainee for independent and unsupervised endoscopy nationwide.5 The JAG OGD certification process was originally formulated in 2011 based on pragmatism, in an era where evidence and quality standards on OGD training were lacking. With the development of national quality standards, and the increasing body of evidence relevant to OGD training, there was a call to review the existing certification pathways in endoscopy.

Following consultation with UK Specialist Advisory Committees, a committee was assembled by JAG and its stakeholders, including the British Society of Gastroenterology (BSG) and the Association of Upper Gastrointestinal Surgeons of Great Britain and Ireland (AUGIS), to develop evidence and consensus-based recommendations relevant to training and certification in diagnostic OGD. The aim was to develop a robust set of recommendations which would form the framework of OGD certification within the UK. Specifically, recommendations were made on the following areas: (1) definition of competence, (2) acquisition of competence, (3) assessment of competence and (4) post-certification support.

The following aspects were considered beyond the scope of this guideline:

*   Paediatric OGD.

*   Therapeutics, for example, upper gastrointestinal (GI) bleeding.

*   Optical diagnosis.

*   Barrett’s oesophagus.

## Methods

### Guideline development

A modified DELPHI process was commissioned by the JAG Quality Assurance of Training Working Group, with inclusion of JAG, BSG, AUGIS, training leads and trainee members, nursing and medical representatives and including representation from England, Wales, Scotland and Northern Ireland. Through a series of teleconferences, participants were allocated to four working groups based on the scope of the guideline. Each working group was tasked with framing questions relevant to training and certification, using a Population, Intervention, Comparator, Outcome format where possible. Literature searches were then systematically conducted in major databases including Embase, MEDLINE, PubMed and the Cochrane Database of Systematic Reviews. Results were collated and summarised into recommendation statements; these were appraised using the Grading of Recommendations Assessment, Development and Evaluations (GRADE) framework.6 The level of evidence and strength of recommendation were provided for each statement. Although it is standard practice to align recommendations with the level of evidence, statements could receive discordant recommendations (eg, strong recommendation for low quality evidence) if, on balance, the perceived benefit outweighed the paucity of available evidence.

### Consensus process

An anonymised, electronic voting process was undertaken during a face-to-face meeting to measure consensus with recommendation statements. Five Likert scale responses were provided for each statement (Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree and Strongly Agree), with Agree and Strongly Agree indicating agreement with a statement. 80%+ agreement was specified *a priori* as a threshold to accept a statement. For statements that were not accepted, up to three rounds of revisions and re-voting were permitted before they were rejected. On collation of the accepted statements, the document was sent to stakeholder groups for review. Accepted statements were then integrated into the final OGD certification pathway.

## Recommendation statements

In total, 32 recommendation statements were generated for the following domains: definition of competence (4 statements), acquisition of competence (12 statements), assessment of competence (10 statements) and post-certification support (6 statements). These are summarised in table 1.

View this table:
[Table 1](http://fg.bmj.com/content/13/3/193/T1)

Table 1 
Summary of recommendation statements for training and certification in OGD.

### Defining competence

1.1: Competence in diagnostic OGD is defined as the ability to perform procedures effectively and safely to national standards.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

Competence in OGD refers to the ability to perform the procedure effectively and safely to defined minimum standards, across a spectrum of cases and contexts. In the UK, the individual competencies are defined within the upper GI DOPS assessment form and the minimum standards defined are stipulated within the 2017 BSG and AUGIS quality standards document.3 It should be noted that competence does not necessarily equate with expertise; it is therefore essential for a practitioner to develop his or her skills beyond the minimum standard of competence. Competence also needs to be maintained; this may encompass a certain minimum case volume, continuous professional development and measurement of performance by key performance indicators (KPIs).

1.2: Competence in OGD will include attainment of relevant minimal performance standards as currently defined by BSG/AUGIS.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

1.3: Competence in OGD should include procedural completion, defined as D2 intubation and J-manoeuvre, in at least 95% of procedures.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *91%* ** 

Prior to this document, JAG criteria for certification included only two measures of competence in OGD: ability to reach the second part of the duodenum unassisted in ≥95% cases, and ability to perform a J-manoeuvre unassisted in ≥95% cases. A minimum procedure number of ≥200 had also been mandated. This did not require any defined expertise or assessment in pathology recognition or management. It is recognised that up to 11.3% of upper GI cancers cases may have had a previously normal OGD in the preceding 3 years.7 This might be explained by failure to diagnose early cancers or premalignant pathology at OGD, either due to an inadequate examination, or due to a lack of knowledge of the appearance of such pathology. In colonoscopy, there has been great emphasis on adequate mucosal visualisation to improve adenoma detection rate and reduce post-colonoscopy colorectal cancers. Although premalignant pathology in the upper GI tract is more variable, and the pathways less well defined than the colorectal adenoma–carcinoma sequence, there is an opportunity to detect more relevant pathology than is currently the case.8 9 To address this issue, the BSG and AUGIS standards were published in 2017 with defined minimum and aspirational standards.3 The JAG OGD standards will be aligned with these minimum standards for competent practice.

1.4: Competence in OGD will include attainment of additional standards of performance defined in this document, including preprocedural, procedural, postprocedural and endoscopic non-technical skills.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

In addition to technical endoscopic competencies, all trainees should be competent in peri-procedural aspects of endoscopy. These may be preprocedural (to include consent, sedation, etc), procedural (technical and cognitive elements), postprocedural (eg, report writing) and endoscopic non-technical skills (ENTS). These aspects are measured and detailed within direct observation of procedural skills (DOPS) assessments, which include descriptors of the expected levels of competency.

### Acquiring competence

2.1: Training should take place in a unit that is accredited for endoscopy training.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

There are no published data specifically related to outcomes in training related to JAG-accreditation status of units. However, the processes of quality assurance (QA) of both service and training remain integral to the overall JAG quality framework. The JAG QA process assesses endoscopy units on criteria specifically related to training and the training environment; engagement and benchmarking ensures that standards are maintained and improved.10 

Despite full JAG accreditation, some units will have difficulties providing all the required training to the trainees on site, depending on the number of trainees and subspecialties. In the UK, other specialties such as radiology and histopathology have pioneered a more centralised academy-style training programme with organised training focused in one area, but with planned networked exposure in other units. Such a system has been used in advanced endoscopy. Full implementation of academy-based training may be challenging for UK gastroenterology trainees due to the competing non-endoscopy demands.5 11 A more centralised, organised programme may allow more equitable access to training and experiences. In all situations, a full record of training cases should be maintained by the trainee and all training units within a training network should be JAG accredited.

2.2: Training procedures should be uploaded onto the National Endoscopy Database.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

The establishment and evolution of the National Endoscopy Database (NED) is an important initiative for UK endoscopy.12 The data from NED will be used to populate trainees’ individual portfolios and ultimately reduce the time required to develop the trainees’ JETS portfolios. Accuracy of data input will be essential for accurate recording of training and both trainers and trainees will need to ensure that procedures performed outside the normal endoscopy environment (eg, emergencies in theatre) are captured accurately.

2.3: Simulation training may be used to enhance the earlier development of technical skills but cannot currently be used as a substitute for more traditional skills and decision-making training.

Evidence: ** *Moderate* **; Recommendation: ** *Weak* **; Agreement: ** *82%* ** 

Prospective randomised controlled studies have shown that endoscopic simulation-based training (SBT) can significantly enhance the trainee performance.13–17 This is most evident in the early part of the learning curve for novices and improves scope handling skills.17 There is no evidence to show that simulation training significantly impacts the rate of acquisition of the more complex cognitive and management tasks,18 or that simulation reduces the overall number of procedures required to reach overall competence.19 However, a case–control study of novice endoscopists from the UK found that attendees of a 2-day OGD induction course combining theory and SBT were more likely to achieve JAG certification over the 16-month post-course follow-up period.20 While simulation enhances the early acquisition of technical skills, it should not substitute patient-based endoscopy training.21 Such training should be supervised and be associated with specific performance enhancing feedback.22 23 

2.4: Trainees should attend the JAG Basic Skills in OGD course prior to certification, ideally during early training.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *91%* ** 

Mandated endoscopy courses are necessary aspects of endoscopy training and skill acquisition that have been stipulated by JAG.24 The JAG Basic Skills in OGD course provides a uniform, structured introduction to OGD, including issues related to indications, safety, ergonomics,25 scope handling,26 sedation and background knowledge. It has been updated to incorporate the additional standards recommended by BSG/AUGIS.3 Other forms of education, including e-learning resources, can enhance acquisition of cognitive skills such as lesion recognition. The JAG QAT Working Group will continue to provide quality assurance of the basic skills course to ensure consistency, validity and currency. Based on colonoscopy data, Basic Skills courses appear to be more useful when attended early during training, that is, probably between 20–70 cases overall.27 As a point of good practice, the trainees, in discussion with their trainers, should plan the timing of the course, within the context of their own personal development plan before starting OGD training. This discussion may well often involve those with a wider remit overseeing the trainees’ progress, particularly regional programme directors.

2.5: Trainees should only undertake the JAG basic OGD course when continued regular training at their base unit is confirmed.

Evidence: ** *Very Low* **; Recommendation: ** *Weak* **; Agreement: ** *82%* ** 

The Basic Skills Course functions as a complement to continued training at base hospitals and it is important that trainees have the opportunity to reinforce their learning from the course with regular hands-on training. The Basic Skills Course should be undertaken when access to training can be continued over the subsequent 3 months at a minimum, with at least one post-course training-list per week.

2.6: Trainees should use a wide range of resources to support OGD training.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

Training on dedicated, purpose-specific lists can improve skills acquisition in endoscopy, as shown by the improvement in dysplasia detection rate and reduction in bleeding and perforation rates in comparison to those without formal training.28 29 A variety of other educational resources such as e-learning systems can be beneficial.30 BEST-Academia is a European web-based training platform designed by an expert committee and has been shown to increase detection and delineation of neoplastic lesions in Barrett’s oesophagus.31 Online tools, textbooks, journals, live endoscopy demonstrations, conferences and hospital multidisciplinary teams (MDTs) and teaching sessions can all contribute to the gaining of competence in trainees. Although resources can be sign-posted, it would be counterproductive to be too prescriptive. Similarly, it is important that any resources developed for, or advocated to support, learners within JAG-associated programmes are suitably focused on trainee and patient outcomes. This will need to encompass a suitably broad range of endoscopy cases to maximally enhance pathology recognition, decision-making and ENTS.

**2.7:** Training resources should be developed to support competency acquisition in lesion recognition.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

2.8: Training resources should be developed to support competency acquisition in ENTS.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

2.9: Trainees should have access to a wide range of case-mix to enhance training in pathology recognition, periprocedural management and ENTS.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

While acquisition of purely technical OGD skills occurs relatively quickly, it takes longer, and a greater number of procedures, to develop the essential skills of lesion recognition, management and ENTS.32 33 Currently, the majority of OGD training involves elective outpatient cases, where the incidence of pathology is low. Each trainee should be encouraged to enhance ENTS competency, especially in lesion recognition. Trainers and training units (as well as JAG) are encouraged to develop resources to enhance the development of these skills. Over time, training lists should expand their case-mix to enhance training in pathology recognition and management of a wide range of diagnostic cases, while developing ENTS. This may involve a variety of endoscopy trainers or purpose-specific endoscopy training lists.

There are no data on which to inform any recommendations on desirable timescales for the acquisition of competence in OGD. This is influenced by many variables, including intensity of training.34 Therefore, more intensive training may be favoured within the context of continuous longitudinal endoscopy training, but may not be readily possible in the context of other competing demands for many trainees. The minimum exposure to training should be one specific training list per week. This training list should have the content and number of cases adjusted for the trainee’s development, and importantly include time for feedback and DOPS.

It is accepted that ENTS are important for the safe and effective performance of endoscopy. In the UK, acquisition of these skills lags behind the development of the technical skills of scope control.33 Specific courses and teaching on ENTS has been shown to enhance short-term knowledge performance and recognition of these skills in expert endoscopists and teams.35 Short-term ENTS training, in conjunction with simulation in novices, has been shown to enhance colonoscopy performance and may be generalisable to OGD.36 

2.10: 250 procedures should be the minimum required before eligibility for summative assessment, assuming all other metrics are satisfactory.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

JAG has previously mandated a minimum of 200 OGD procedures as an eligibility criterion for certification. This was based on earlier studies that found that procedural completion can be achieved within this number. Using the GAGES-UE tool for assessment (which measures only clear technical skills), Vassiliou *et al* suggested that the gross technical skills were obtainable by 50 cases.37 A prospective, cross-sectional study by Cass *et al* concluded that gastroenterology and surgical trainees require more than 100 procedures to reach >90% oesophageal intubation rate.38 An earlier UK study found that 187 procedures were required to reach competency in D2 intubation.39 However it is clear that the more complex cognitive and pathology managements skills take longer to acquire than the technical skills required for procedural completion. More recent data from the USA and the UK confirm that the acquisition of the postprocedure technical, cognitive skills and overall global competency often requires 250 or more procedures.32 33 Reliable accurate pathology recognition takes longer, requiring 300 procedures in 90% of cases.32 Overall competency, including postprocedure management, was not reached until 225–249 procedures, although preprocedure competencies such as indication and sedation were developed much earlier (100–124 procedures).33 Technical skills including adequate visualisation of the stomach were acquired at an intermediate rate (150–174 procedures). Therefore, although technical competencies seem to be acquired relatively rapidly, the skills essential for patient management such as ENTS, report writing, pathology recognition and post-endoscopic management require longer.32 33 From JAG certification data,5 the median number of OGD procedures at the time of summative assessment was 282 (ranging between 245–305 for different specialties), suggesting that most trainees feel comfortable applying for certification after performing considerably more than 200 procedures to gain confidence in the more complex cognitive and management aspects of OGD. Accordingly, the panel recommends that all trainees should have a minimum of 250 hands-on OGD procedures to be eligible for summative assessment.

2.11: All trainers delivering training in OGD should have taken part in an endoscopy-focused Train-the-Trainers course (eg, TGT/TCT).

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

Endoscopy training should ideally be provided by individuals with the requisite skills and behaviours to teach endoscopy effectively, including an awareness of the principles of adult education, best practices in procedural skills education and appropriate use of beneficial educational strategies such as feedback.10 40 41 Trainers in OGD should have appropriate training for their role and undertake regular performance review. Ideally, all trainers will have completed an endoscopy-focused Train-the-Trainer’s (TTT) course. It is aspirational for trainers to have at least annual appraisal of training performance from peers and trainees,42 and undertake formal update training, either as a refresher trainer session or as faculty on a Basic Skills Course, every 5 years. Throughout the UK, many endoscopy trainers provide training in more than one modality. Although attending a Train-Gastroscopy-Trainer (TGT) course is desirable, there is considerable overlap in the educational content of other procedure-specific TTT courses which are transferable to OGD training, and as such, having these credentials would be considered sufficient as an OGD trainer.

There is limited evidence on the effects of training-the-trainer in endoscopy; however studies in the field of surgery have shown that formal training of trainers can result in a significantly higher rating by their learners.43 Having more than one trainer can be beneficial in providing complimentary training and maximising training opportunities. Each trainee should have a specific endoscopy trainer who would directly oversee their development, conduct regular appraisal of progress and plan and document training objectives. This provides the opportunity to discuss learning from adverse events and complications. Appraisal meetings for trainees should take place at least once every 3 months.

2.12: Trainees must complete a reflection tool on JETS every 50 procedures. This forms a framework for meetings with their endoscopy supervisor every 6 months or less

Evidence: ** *Very low* **; Recommendation: ** *Weak* **; Agreement: ** *100%* ** 

Reflective practice is ‘the process whereby an individual thinks analytically about anything relating to their professional practice with the intention of gaining insight and using the lessons learnt to maintain good practice or make improvements where possible’.44 As part of endoscopy training, concurrent (while performing the procedure) and facilitative (delayed feedback or debriefing) techniques may be used. Facilitative feedback is particularly used to help the trainee reflect on what happened, analyse performance and recognise areas of strength and those that need improvement. While students mastering early skills seem to be benefitting from concurrent feedback, performance and learning are enhanced by delayed feedback.40 45 Reflective practice is already established in medical and nursing training and in the post-qualification appraisal process, but has not been formalised within endoscopy training.

The use of reflection in practice has been linked to improvements in learning and improve patient safety.46 The opportunity to consolidate learning and identify opportunities to improve technique or patient care integrates cognitive and non-cognitive skills,47 drawing together elements of best practice from the available literature, tailored to the patient and case. Such reflections allow the inclusion of feedback and learning outcomes from the wider endoscopy team, with focus on the patient and not only on the trainees’ experience. Therefore, it is recommended that reflective learning becomes formalised into the OGD training process.

### Assessment of competence

3.1: DOPS should be used as the assessment tool for competency in OGD.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

The UK upper GI endoscopy DOPS is a validated tool for assessing competency in upper GI endoscopy. It comprises 34 individual competency items split into six domains, including ENTS. In a UK-wide study involving over 10 000 DOPS assessments by 987 trainees, data on the validity and reliability of DOPS were presented, along with learning curves, competency benchmarks and predictors of competency.33 48 From generalisability theory analyses, satisfactory reliability thresholds could be achieved based on different combinations of assessors and assessments.33 

3.2: DOPS should be mapped to current BSG/AUGIS standards for OGD.

Evidence: ** *Very Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

Given that best practice standards in upper GI endoscopy have been stipulated within UK guidelines and endorsed by stakeholder societies,3 the consensus of the working group was to map existing UK upper GI endoscopy standards with those assessed within DOPS to align quality standards with competency measures (online supplemental table 1).

### Supplementary data

[[flgastro-2021-101907supp001.pdf]](pending:yes) 

3.3: Total procedure times (with inspection time for surveillance procedures) should be included in the OGD report and assessed within DOPS.

Evidence: ** *Low* **; Recommendation: ** *Weak* **; Agreement: ** *100%* ** 

The total OGD procedure time has been shown to correlate with diagnostic yield, and a minimum time of 7 min has been suggested in European guidelines.49 50 This ensures sufficient time for thorough inspection, washing and the application of antispasmodics and mucolytics where appropriate.51 The UK BSG/AUGIS standards recommend noting total procedure time for all surveillance procedures; this should be included in the endoscopy report and assessed within DOPS.

3.4: Diagnosis specific DOPS should be developed to facilitate competency acquisition and assessment for OGD, for example, Barrett’s oesophagus.

Evidence: ** *Very Low* **; Recommendation: ** *Weak* **; Agreement: ** *91%* ** 

Surveillance of Barrett’s oesophagus is considered a high-risk indication. A systematic review by Visrodia *et al* cited a 1-year PEUGIC rate of 25%.52 In recognition of the technical nuances in Barrett’s surveillance (eg, mucosal inspection, usual of adjunct, dysplasia assessment, biopsies), the panel favoured the development of formative DOPS specific to Barrett’s surveillance to facilitate competency assessment and to ultimately improve endoscopic quality and reduce PEUGIC rates with Barrett’s oesophagus.

3.5 DOPS should record the indication for and diagnosis of the procedure and be linked to the JETS e-portfolio/NED.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *91%* ** 

All UK trainees in GI endoscopy are required to register and log training data onto the JETS e-portfolio. This generates KPIs which act as a surrogate measure of competence. The NED project aims to upload trainee-level procedural data from individual endoscopy reporting systems directly to the JETS e-portfolio for QA purposes.12 This includes procedure-specific outcome data necessary for KPI calculations, for example, indications, diagnoses, therapeutic data, sedation and complications. The OGD DOPS are recorded separately on JETS but do not contain procedural outcome data. Where appropriate, assessment data from DOPS should be linked to procedural outcome data to facilitate QA and research in OGD training.

3.6 Trainees should have at least one formative DOPS performed per 10 procedures.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *91%* ** 

The provision of performance-enhancing feedback is central to supervised endoscopy training and is embedded in the JAG TTT philosophy. The DOPS provide an essential means for focusing the feedback related to procedures as well as mapping out the learning and development curve for the trainee.45 We recommend for a minimum of one DOPS every 10 cases during training. Trainees and trainers are however encouraged to do as many as they feel appropriate.

3.7 Each formative DOPS should be performed on a single preselected case.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

To minimise selection bias, each DOPS should be performed on a single case prespecified by the trainee or trainer. DOPS should not be retrospectively chosen on a completed case or averaged across cases performed on a list.

3.8 At least three formative DOPS from each of three different observers should be performed over the last 100 cases before summative assessment.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *82%* ** 

Data from the JETS database shows that the reliability of the DOPS varied with the number of observers and the number of DOPS.33 DOPS from at least three observers are required for adequate reliability for determining competence. Therefore, it is recommended that at least nine DOPS in total, with at least three different observers, be performed in the last 100 cases before deciding to continue to summative assessment. Based on existing requirements, trainees should be competent in the last five DOPS in a minimum of 90% of all assessed items, with none requiring maximal or significant supervision.

3.9: Eligibility for summative assessment in OGD may be triggered once the following are met:

1.  Fulfil criteria for BSG standards for competence in OGD.

2.  Unassisted D2 intubation and J-manoeuvre rates of ≥95% (in the preceding 3 months).

3.  Attaining a minimum hands-on procedure count of 250.

4.  Attendance of JAG Basic Skills course.

5.  Meeting formative DOPS requirements.
    
    *   Minimum of 25 formative DOPS performed by ≥3 different assessors.
    
    *   Last five DOPS rated competent without supervision for 90%+ of all items.

6.  Evidence of engagement with the JETS reflection tool (minimum of five reflection entries).

Evidence: **Low**; Recommendation: **Strong**; Agreement: **100%** 

Based on the recommendation statements within this document, trainees will only be eligible for summative assessment when they have fulfilled the criteria above (figure 1).

3.10: For successful completion of the summative DOPS assessment, the trainee should be rated as ‘ready for independent practice’ for all items within four DOPS, by two different assessors, neither of whom is their regular assessor.

Evidence: ** *Very low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

![Figure 1](http://fg.bmj.com/https://fg.bmj.com/content/flgastro/13/3/193/F1.medium.gif)

[Figure 1](http://fg.bmj.com/content/13/3/193/F1)

Figure 1 
Proposed JAG pathway for training and certification in OGD. DOPS, direct observation of procedural skills; GI, gastrointestinal; NED, National Endoscopy Database; OGD, oesophagogastroduodenoscopy; PD, program director

All JAG certification pathways require trainees to undertake summative assessment in order to provide robust and objective demonstration of competence to determine readiness for independent practice. To mitigate bias, trainees must perform a total of four summative OGD DOPS and be rated competent in all items by two different assessors, none of whom should be their current main assessor. Assessors should have trainer credentials and should have received formal training in assessing DOPS.

### Post-certification support

4.1: Newly certified OGD practitioners should have access to a named supervisor to discuss cases and to review progress.

Evidence: ** *Very Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

In the post-certification period, it is recognised that most newly certified practitioners will require a defined period of supervision (eg, 1 year) and ongoing endoscopy exposure to achieve the outcomes of an experienced practitioner.53 54 As such, a newly-certified practitioner should have access to a named supervisor who can review progress and provide advice where needed. Instances where support may be beneficial may include: review of photodocumentation (and indeterminate lesions) and postprocedural management plans. We recommend that such arrangements should be made with a named supervisor on a regular basis to safeguard patient management and to facilitate skills development. The supervisor should possess valid trainer credentials, that is, recognised OGD trainer and have attended a TTT course.

4.2: The ongoing training requirements of individuals should be identified and practitioners should undertake additional training/upskilling as defined within their personal development plan.

Evidence: ** *Very Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

In endoscopy, the path from competent to high-quality practice involves an ongoing learning curve post-certification. We recommend that, as part of professional development, the training requirements of newly-certified endoscopists should be identified, discussed and recorded. For OGD, this could include lesion characterisation training, for example, Barrett’s surveillance, and training in therapeutic modalities, for example, upper GI bleed haemostasis, oesophageal dilatation. This should include plans for supporting underperformance if self-reported or observed during the newly independent period, in line with JAG guidance.55 Practitioners should also be encouraged to attend upper GI MDT meetings at least on an ad hoc basis.

4.3: Newly certified practitioners may perform OGD without direct supervision, but should have systems in place to ensure appropriate list size and caseload selection.

Evidence: ** *Very Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

During newly-independent practice, it is possible that the cessation of directly supervised practice can lead to a drop in performance.56 An analysis of completion metrics recorded on the UK trainee e-portfolio found a small but statistically significant decrement in mean D2 intubation and J-manoeuvre rates in the 3 months pre-certification versus post-certification.5 We suggest that, in the immediate post-certification period, there should be systems in place to ensure that list size and caseload selection is tailored to the practitioner. Existing JAG guidelines (predating COVID-19) recommend for a standard diagnostic OGD to be allocated a minimum of 20 min; this may need to be increased in the immediate post-certification period.

We recommend that complex cases, for example, acute upper GI bleeding, known therapeutic intent, previous intubation failure,57 American Society of Anaesthesiologists grade 3+ or patients on the intensive care unit, should not be independently performed by the new-certified endoscopist unless deemed competent by a supervisor/training lead. Newly-certified practitioners should be able to review the caseload and volume on their list to ensure appropriateness, to anticipate issues and for time management purposes. This is a prerequisite for checklists and effective team briefing and should be considered part of the non-technical skills repertoire.58 59 

4.4: There should be appropriate mechanisms in place for performance monitoring and review during the early post-certification period.

Evidence: ** *Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

The recent implementation of the UK NED enables key performance indicators in OGD to be collected centrally and benchmarked against national quality standards to quality assure endoscopy practice.12 In according with JAG recommendations for quality assurance of services, performance data of newly-certified practitioners should be subjected to review at regular intervals to enable practitioners to discuss queries, concerns or issues with caseload or time management.

4.5: Significant adverse advents should be discussed with the supervisor and reflected on in their appraisal.

Evidence: ** *Very Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

Complications during OGD are rare but may be more common in interventional procedures performed by trainees.60 All significant adverse events, that is, perforation, bleeding, missed cancer, postprocedural readmissions and mortality, should be discussed locally at an endoscopy governance meeting. In cases where adverse events are deemed to be avoidable through technical or non-technical factors attributable to the endoscopist, such cases should be formally reflected on and discussed in appraisals involving their supervisor.

4.6: In the post-certification period, newly-independent endoscopists should perform at least 100 procedures a year to maintain competence.

Evidence: ** *Very Low* **; Recommendation: ** *Strong* **; Agreement: ** *100%* ** 

The BSG/AUGIS quality standards document suggests for each endoscopist to perform at least 100 OGDs per year to maintain proficiency and prevent skills decay.3 Evidence for this has been inferred from colonoscopy practice.34 Although it is acknowledged that practitioners within training programmes may struggle to achieve such a volume due to conflicting commitments, endoscopy services and training programmes should strive to enable newly-independent practitioners to achieve such a volume in line with national guidance.

## Discussion

Adequate training in upper GI endoscopy is essential for procedural effectiveness, patient comfort and safety. Studies on PEUGIC from the UK and internationally have demonstrated a need to improve performance in diagnostic OGD. While there has been a structured training programme for competence in OGD in the UK for over a decade, we have been learning from this in order to improve the training experience for trainees and patients. This has been facilitated by the publication of BSG/AUGIS standards for OGD, and by evaluation of training methodologies and outcomes. Since the release of the first OGD certification document, training in OGD has evolved to include added focus on ENTS, lesion recognition, inspection technique, competency assessment and quality assurance of the training process itself.

Due to the limited available evidence, the nature of training studies and the rigours of GRADE, we acknowledge that much of the cited studies were of very-low to low quality evidence. The rationale for these recommendations lie within the relevant sections of this document. This revised curriculum has incorporated published evidence related to training, but has also provided expert consensus where evidence is lacking but deemed to be important to the OGD training pathway. Future study and evaluation of the recommended measures will be required and will be facilitated by data from JETS and NED.

Although COVID-19 has had a profound effect on endoscopy training,61 the safety of trainees as well as patients remain paramount. Infection prevention measures will need to be adhered to in training situations, but the criteria set out in this curriculum document will remain unchanged.

## Ethics statements

### Patient consent for publication

Not applicable.

### Ethics approval

This study does not involve human participants.

## Footnotes

*   Twitter @drkeithsiau, @Doc_Wot

*   Contributors Conception: KS, ILPB and AMV. DELPHI design: KS, ILPB and AMV. Literature searches: All authors. Electronic voting: All authors. Manuscript draft: All authors. Critical review and approval of final version: All authors.

*   Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

*   Competing interests None declared.

*   Provenance and peer review Not commissioned; externally peer reviewed.

*   Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

[http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/)
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/).

## References

1.   Shenbagaraj L , Thomas-Gibson S , Stebbing J , et al . Endoscopy in 2017: a national survey of practice in the UK. Frontline Gastroenterol 2019;10:7–15.[doi:10.1136/flgastro-2018-100970](http://dx.doi.org/10.1136/flgastro-2018-100970) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30651952 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZmxnYXN0cm8iO3M6NToicmVzaWQiO3M6NjoiMTAvMS83IjtzOjQ6ImF0b20iO3M6MjM6Ii9mbGdhc3Ryby8xMy8zLzE5My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

2.   Menon S , Trudgill N . How commonly is upper gastrointestinal cancer missed at endoscopy? A meta-analysis. Endosc Int Open 2014;2:E46–50.[doi:10.1055/s-0034-1365524](http://dx.doi.org/10.1055/s-0034-1365524) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

3.   Beg S , Ragunath K , Wyman A , et al . Quality Standards in upper gastrointestinal endoscopy: a position statement of the British Society of gastroenterology (BSG) and association of upper gastrointestinal surgeons of great britain and ireland (AUGIS). Gut 2017;66:1886–99.[doi:10.1136/gutjnl-2017-314109](http://dx.doi.org/10.1136/gutjnl-2017-314109) pmid:http://www.ncbi.nlm.nih.gov/pubmed/28821598 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZ3V0am5sIjtzOjU6InJlc2lkIjtzOjEwOiI2Ni8xMS8xODg2IjtzOjQ6ImF0b20iO3M6MjM6Ii9mbGdhc3Ryby8xMy8zLzE5My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

4.   Siau K , Green JT , Hawkes ND , et al . Impact of the joint Advisory group on gastrointestinal endoscopy (JAG) on endoscopy services in the UK and beyond. Frontline Gastroenterol 2019;10:93–106.[doi:10.1136/flgastro-2018-100969](http://dx.doi.org/10.1136/flgastro-2018-100969) 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZmxnYXN0cm8iO3M6NToicmVzaWQiO3M6NzoiMTAvMi85MyI7czo0OiJhdG9tIjtzOjIzOiIvZmxnYXN0cm8vMTMvMy8xOTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

5.   Siau K , Anderson JT , Valori R , et al . Certification of UK gastrointestinal endoscopists and variations between trainee specialties: results from the JETS e-portfolio. Endosc Int Open 2019;7:E551–60.[doi:10.1055/a-0839-4476](http://dx.doi.org/10.1055/a-0839-4476) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30957005 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

6.   Balshem H , Helfand M , Schünemann HJ , et al . GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64:401–6.[doi:10.1016/j.jclinepi.2010.07.015](http://dx.doi.org/10.1016/j.jclinepi.2010.07.015) pmid:http://www.ncbi.nlm.nih.gov/pubmed/21208779 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1016/j.jclinepi.2010.07.015&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=21208779&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 
    
    [Web of Science](http://fg.bmj.com/lookup/external-ref?access_num=000288364300009&link_type=ISI) 

7.   Menon S , Trudgill N . How commonly is upper gastrointestinal cancer missed at endoscopy? A meta-analysis. Endosc Int Open 2014;2:E46–50.[doi:10.1055/s-0034-1365524](http://dx.doi.org/10.1055/s-0034-1365524) pmid:http://www.ncbi.nlm.nih.gov/pubmed/26135259 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

8.   Veitch AM , Uedo N , Yao K , et al . Optimizing early upper gastrointestinal cancer detection at endoscopy. Nat Rev Gastroenterol Hepatol 2015;12:660–7.[doi:10.1038/nrgastro.2015.128](http://dx.doi.org/10.1038/nrgastro.2015.128) pmid:http://www.ncbi.nlm.nih.gov/pubmed/26260369 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1038/nrgastro.2015.128&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=26260369&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

9.   Banks M , Graham D , Jansen M , et al . British Society of gastroenterology guidelines on the diagnosis and management of patients at risk of gastric adenocarcinoma. Gut 2019;68:1545–75.[doi:10.1136/gutjnl-2018-318126](http://dx.doi.org/10.1136/gutjnl-2018-318126) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31278206 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZ3V0am5sIjtzOjU6InJlc2lkIjtzOjk6IjY4LzkvMTU0NSI7czo0OiJhdG9tIjtzOjIzOiIvZmxnYXN0cm8vMTMvMy8xOTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

10.  Valori R , Cortas G , de Lange T , et al . Performance measures for endoscopy services: a European Society of gastrointestinal endoscopy (ESGE) quality improvement initiative. United European Gastroenterol J 2019;7:21–44.[doi:10.1177/2050640618810242](http://dx.doi.org/10.1177/2050640618810242) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30788114 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

11.  Clough J , FitzPatrick M , Harvey P , et al . Shape of training review: an impact assessment for UK gastroenterology trainees. Frontline Gastroenterol 2019;10:356–63.[doi:10.1136/flgastro-2018-101168](http://dx.doi.org/10.1136/flgastro-2018-101168) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31656560 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZmxnYXN0cm8iO3M6NToicmVzaWQiO3M6ODoiMTAvNC8zNTYiO3M6NDoiYXRvbSI7czoyMzoiL2ZsZ2FzdHJvLzEzLzMvMTkzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

12.  Lee TJ , Siau K , Esmaily S , et al . Development of a national automated endoscopy database: the United Kingdom national endoscopy database (NED). United European Gastroenterol J 2019;7:798–806.[doi:10.1177/2050640619841539](http://dx.doi.org/10.1177/2050640619841539) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31316784 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

13.  Shirai Y , Yoshida T , Shiraishi R , et al . Prospective randomized study on the use of a computer-based endoscopic simulator for training in esophagogastroduodenoscopy. J Gastroenterol Hepatol 2008;23:1046–50.[doi:10.1111/j.1440-1746.2008.05457.x](http://dx.doi.org/10.1111/j.1440-1746.2008.05457.x) pmid:http://www.ncbi.nlm.nih.gov/pubmed/18554236 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=18554236&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

14.  Qiao W , Bai Y , Lv R , et al . The effect of virtual endoscopy simulator training on novices: a systematic review. PLoS One 2014;9:e89224.[doi:10.1371/journal.pone.0089224](http://dx.doi.org/10.1371/journal.pone.0089224) pmid:http://www.ncbi.nlm.nih.gov/pubmed/24586609 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=24586609&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

15.  Ende A , Zopf Y , Konturek P , et al . Strategies for training in diagnostic upper endoscopy: a prospective, randomized trial. Gastrointest Endosc 2012;75:254–60.[doi:10.1016/j.gie.2011.07.063](http://dx.doi.org/10.1016/j.gie.2011.07.063) pmid:http://www.ncbi.nlm.nih.gov/pubmed/22153875 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1016/j.gie.2011.07.063&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=22153875&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

16.  Di Giulio E , Fregonese D , Casetti T , et al . Training with a computer-based simulator achieves basic manual skills required for upper endoscopy: a randomized controlled trial. Gastrointest Endosc 2004;60:196–200.[doi:10.1016/S0016-5107(04)01566-4](http://dx.doi.org/10.1016/S0016-5107(04)01566-4) pmid:http://www.ncbi.nlm.nih.gov/pubmed/15278044 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1016/S0016-5107(04)01566-4&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=15278044&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 
    
    [Web of Science](http://fg.bmj.com/lookup/external-ref?access_num=000223188100006&link_type=ISI) 

17.  Ferlitsch A , Schoefl R , Puespoek A , et al . Effect of virtual endoscopy simulator training on performance of upper gastrointestinal endoscopy in patients: a randomized controlled trial. Endoscopy 2010;42:1049–56.[doi:10.1055/s-0030-1255818](http://dx.doi.org/10.1055/s-0030-1255818) pmid:http://www.ncbi.nlm.nih.gov/pubmed/20972956 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1055/s-0030-1255818&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=20972956&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

18.  Jirapinyo P , Kumar N , Thompson CC . Validation of an endoscopic part-task training box as a skill assessment tool. Gastrointest Endosc 2015;81:967–73.[doi:10.1016/j.gie.2014.08.007](http://dx.doi.org/10.1016/j.gie.2014.08.007) pmid:http://www.ncbi.nlm.nih.gov/pubmed/25310934 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

19.  Ekkelenkamp VE , Koch AD , de Man RA , et al . Training and competence assessment in GI endoscopy: a systematic review. Gut 2016;65:607–15.[doi:10.1136/gutjnl-2014-307173](http://dx.doi.org/10.1136/gutjnl-2014-307173) pmid:http://www.ncbi.nlm.nih.gov/pubmed/25636697 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZ3V0am5sIjtzOjU6InJlc2lkIjtzOjg6IjY1LzQvNjA3IjtzOjQ6ImF0b20iO3M6MjM6Ii9mbGdhc3Ryby8xMy8zLzE5My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

20.  Siau K , Hodson J , Neville P , et al . Impact of a simulation-based induction programme in gastroscopy on trainee outcomes and learning curves. World J Gastrointest Endosc 2020;12:98–110.[doi:10.4253/wjge.v12.i3.98](http://dx.doi.org/10.4253/wjge.v12.i3.98) pmid:http://www.ncbi.nlm.nih.gov/pubmed/32218889 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

21.  Khan R , Plahouras J , Johnston BC , et al . Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy. Cochrane Database Syst Rev 2018;8:CD008237.[doi:10.1002/14651858.CD008237.pub3](http://dx.doi.org/10.1002/14651858.CD008237.pub3) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30117156 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

22.  Mahmood T , Darzi A . The learning curve for a colonoscopy simulator in the absence of any feedback: no feedback, no learning. Surg Endosc 2004;18:1224–30.[doi:10.1007/s00464-003-9143-4](http://dx.doi.org/10.1007/s00464-003-9143-4) pmid:http://www.ncbi.nlm.nih.gov/pubmed/15457382 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1007/s00464-003-9143-4&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=15457382&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 
    
    [Web of Science](http://fg.bmj.com/lookup/external-ref?access_num=000223341500010&link_type=ISI) 

23.  Kruglikova I , Grantcharov TP , Drewes AM , et al . The impact of constructive feedback on training in gastrointestinal endoscopy using high-fidelity Virtual-Reality simulation: a randomised controlled trial. Gut 2010;59:181–5.[doi:10.1136/gut.2009.191825](http://dx.doi.org/10.1136/gut.2009.191825) pmid:http://www.ncbi.nlm.nih.gov/pubmed/19828469 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZ3V0am5sIjtzOjU6InJlc2lkIjtzOjg6IjU5LzIvMTgxIjtzOjQ6ImF0b20iO3M6MjM6Ii9mbGdhc3Ryby8xMy8zLzE5My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

24.  Anderson JT . Assessments and skills improvement for endoscopists. Best Pract Res Clin Gastroenterol 2016;30:453–71.[doi:10.1016/j.bpg.2016.05.005](http://dx.doi.org/10.1016/j.bpg.2016.05.005) pmid:http://www.ncbi.nlm.nih.gov/pubmed/27345651 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

25.  Khan R , Scaffidi MA , Satchwell J , et al . Impact of a simulation-based ergonomics training curriculum on work-related musculoskeletal injury risk in colonoscopy. Gastrointest Endosc 2020;92:1070–80.[doi:10.1016/j.gie.2020.03.3754](http://dx.doi.org/10.1016/j.gie.2020.03.3754) pmid:http://www.ncbi.nlm.nih.gov/pubmed/32205194 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

26.  Lee S-H , Park Y-K , Cho S-M , et al . Technical skills and training of upper gastrointestinal endoscopy for new beginners. World J Gastroenterol 2015;21:759–85.[doi:10.3748/wjg.v21.i3.759](http://dx.doi.org/10.3748/wjg.v21.i3.759) pmid:http://www.ncbi.nlm.nih.gov/pubmed/25624710 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

27.  Siau K , Hodson J , Anderson JT , et al . Impact of a national basic skills in colonoscopy course on trainee performance: an interrupted time series analysis. World J Gastroenterol 2020;26:3283–92.[doi:10.3748/wjg.v26.i23.3283](http://dx.doi.org/10.3748/wjg.v26.i23.3283) pmid:http://www.ncbi.nlm.nih.gov/pubmed/32684742 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

28.  Ooi J , Wilson P , Walker G , et al . Dedicated Barrett's surveillance sessions managed by trained endoscopists improve dysplasia detection rate. Endoscopy 2017;49:524–8.[doi:10.1055/s-0043-103410](http://dx.doi.org/10.1055/s-0043-103410) pmid:http://www.ncbi.nlm.nih.gov/pubmed/28399610 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

29.  van Vilsteren FGI , Pouw RE , Herrero LA , et al . Learning to perform endoscopic resection of esophageal neoplasia is associated with significant complications even within a structured training program. Endoscopy 2012;44:4–14.[doi:10.1055/s-0031-1291384](http://dx.doi.org/10.1055/s-0031-1291384) pmid:http://www.ncbi.nlm.nih.gov/pubmed/22109651 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1055/s-0031-1291384&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=22109651&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

30.  Yao K , Uedo N , Muto M , et al . Development of an e-learning system for teaching endoscopists how to diagnose early gastric cancer: basic principles for improving early detection. Gastric Cancer 2017;20:28–38.[doi:10.1007/s10120-016-0680-7](http://dx.doi.org/10.1007/s10120-016-0680-7) pmid:http://www.ncbi.nlm.nih.gov/pubmed/28032233 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

31.  Bergman JJGHM , de Groof AJ , Pech O , et al . An interactive web-based educational tool improves detection and delineation of Barrett's Esophagus-Related neoplasia. Gastroenterology 2019;156:1299–308.[doi:10.1053/j.gastro.2018.12.021](http://dx.doi.org/10.1053/j.gastro.2018.12.021) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30610858 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1053/j.gastro.2018.12.021&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

32.  Miller AT , Sedlack RE , ACE Research Group . Competency in esophagogastroduodenoscopy: a validated tool for assessment and generalizable benchmarks for gastroenterology fellows. Gastrointest Endosc 2019;90:613–20.[doi:10.1016/j.gie.2019.05.024](http://dx.doi.org/10.1016/j.gie.2019.05.024) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31121154 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

33.  Siau K , Crossley J , Dunckley P , et al . Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training. Surg Endosc 2020;34:105–14.[doi:10.1007/s00464-019-06737-7](http://dx.doi.org/10.1007/s00464-019-06737-7) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30911922 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

34.  Jorgensen JE , Elta GH , Stalburg CM , et al . Do breaks in gastroenterology fellow endoscopy training result in a decrement in competency in colonoscopy? Gastrointest Endosc 2013;78:503–9.[doi:10.1016/j.gie.2013.03.1331](http://dx.doi.org/10.1016/j.gie.2013.03.1331) pmid:http://www.ncbi.nlm.nih.gov/pubmed/23660564 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1016/j.gie.2013.03.1331&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=23660564&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

35.  Matharoo M , Haycock A , Sevdalis N , et al . Endoscopic non-technical skills team training: the next step in quality assurance of endoscopy training. World J Gastroenterol 2014;20:17507–15.[doi:10.3748/wjg.v20.i46.17507](http://dx.doi.org/10.3748/wjg.v20.i46.17507) pmid:http://www.ncbi.nlm.nih.gov/pubmed/25516665 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.3748/wjg.v20.i46.17507&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=25516665&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 
    
    [Web of Science](http://fg.bmj.com/lookup/external-ref?access_num=000346386300029&link_type=ISI) 

36.  Walsh CM , Scaffidi MA , Khan R , et al . Non-technical skills curriculum incorporating simulation-based training improves performance in colonoscopy among novice endoscopists: randomized controlled trial. Dig Endosc 2020;32:940–8.[doi:10.1111/den.13623](http://dx.doi.org/10.1111/den.13623) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31912560 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

37.  Vassiliou MC , Kaneva PA , Poulose BK , et al . Global assessment of gastrointestinal endoscopic skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg Endosc 2010;24:1834–41.[doi:10.1007/s00464-010-0882-8](http://dx.doi.org/10.1007/s00464-010-0882-8) pmid:http://www.ncbi.nlm.nih.gov/pubmed/20112113 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1007/s00464-010-0882-8&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=20112113&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

38.  Cass OW , Freeman ML , Peine CJ , et al . Objective evaluation of endoscopy skills during training. Ann Intern Med 1993;118:40–4.[doi:10.7326/0003-4819-118-1-199301010-00008](http://dx.doi.org/10.7326/0003-4819-118-1-199301010-00008) pmid:http://www.ncbi.nlm.nih.gov/pubmed/8416157 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.7326/0003-4819-118-1-199301010-00008&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=8416157&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 
    
    [Web of Science](http://fg.bmj.com/lookup/external-ref?access_num=A1993KE60500008&link_type=ISI) 

39.  Ward ST , Hancox A , Mohammed MA , et al . The learning curve to achieve satisfactory completion rates in upper GI endoscopy: an analysis of a national training database. Gut 2017;66:1022–33.[doi:10.1136/gutjnl-2015-310443](http://dx.doi.org/10.1136/gutjnl-2015-310443) pmid:http://www.ncbi.nlm.nih.gov/pubmed/26976733 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZ3V0am5sIjtzOjU6InJlc2lkIjtzOjk6IjY2LzYvMTAyMiI7czo0OiJhdG9tIjtzOjIzOiIvZmxnYXN0cm8vMTMvMy8xOTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

40.  Walsh CM , Ling SC , Wang CS , et al . Concurrent versus terminal feedback: it may be better to wait. Acad Med 2009;84:S54–7.[doi:10.1097/ACM.0b013e3181b38daf](http://dx.doi.org/10.1097/ACM.0b013e3181b38daf) pmid:http://www.ncbi.nlm.nih.gov/pubmed/19907387 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=19907387&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 
    
    [Web of Science](http://fg.bmj.com/lookup/external-ref?access_num=000276130600014&link_type=ISI) 

41.  Waschke KA , Anderson J , Valori RM , et al . ASGE principles of endoscopic training. Gastrointest Endosc 2019;90:27–34.[doi:10.1016/j.gie.2018.10.017](http://dx.doi.org/10.1016/j.gie.2018.10.017) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31122745 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

42.  Ratcliffe E , Subramaniam S , Ngu WS . Endoscopy training in the UK pre-COVID–19 environment: a multidisciplinary survey of endoscopy training and the experience of reciprocal feedback. Frontline Gastroenterol 2021.[doi:10.1136/flgastro-2020-101734](http://dx.doi.org/10.1136/flgastro-2020-101734) 
    
    

43.  Wyles SM , Schwarz E , Dort J , et al . SAGE(S) advice: application of a standardized train the trainer model for faculty involved in a Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) hands-on course. Surg Endosc 2017;31:2017–22.[doi:10.1007/s00464-017-5463-7](http://dx.doi.org/10.1007/s00464-017-5463-7) pmid:http://www.ncbi.nlm.nih.gov/pubmed/28289974 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

44. Academy of Medical Royal Colleges. The reflective practitioner: guidance for doctors and medical students, 2018. Available: [https://www.aomrc.org.uk/wp-content/uploads/2018/09/the\_reflective\_practioner\_guidance\_single\_page.pdf](https://www.aomrc.org.uk/wp-content/uploads/2018/09/the\_reflective\_practioner_guidance_single_page.pdf) 
    
    

45.  Dilly CK , Sewell JL . How to give feedback during endoscopy training. Gastroenterology 2017;153:632–6.[doi:10.1053/j.gastro.2017.07.023](http://dx.doi.org/10.1053/j.gastro.2017.07.023) pmid:http://www.ncbi.nlm.nih.gov/pubmed/28757268 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

46.  Ravindran S , Thomas-Gibson S , Murray S , et al . Improving safety and reducing error in endoscopy: simulation training in human factors. Frontline Gastroenterol 2019;10:160–6.[doi:10.1136/flgastro-2018-101078](http://dx.doi.org/10.1136/flgastro-2018-101078) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31205657 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZmxnYXN0cm8iO3M6NToicmVzaWQiO3M6ODoiMTAvMi8xNjAiO3M6NDoiYXRvbSI7czoyMzoiL2ZsZ2FzdHJvLzEzLzMvMTkzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

47.  Macaulay CP , Winyard PJW . Reflection: tick box exercise or learning for all? BMJ 2012;345:e7468.[doi:10.1136/bmj.e7468](http://dx.doi.org/10.1136/bmj.e7468) 
    
    

48.  Siau K , Dunckley P , Valori R , et al . Changes in scoring of direct observation of procedural skills (DOPS) forms and the impact on competence assessment. Endoscopy 2018;50:770–8.[doi:10.1055/a-0576-6667](http://dx.doi.org/10.1055/a-0576-6667) pmid:http://www.ncbi.nlm.nih.gov/pubmed/29614526 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

49.  Teh JL , Tan JR , Lau LJF , et al . Longer examination time improves detection of gastric cancer during diagnostic upper gastrointestinal endoscopy. Clin Gastroenterol Hepatol 2015;13:480–7.[doi:10.1016/j.cgh.2014.07.059](http://dx.doi.org/10.1016/j.cgh.2014.07.059) pmid:http://www.ncbi.nlm.nih.gov/pubmed/25117772 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1016/j.cgh.2014.07.059&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=25117772&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

50.  Bisschops R , Areia M , Coron E , et al . Performance measures for upper gastrointestinal endoscopy: a European Society of gastrointestinal endoscopy (ESGE) quality improvement initiative. Endoscopy 2016;48:843–64.[doi:10.1055/s-0042-113128](http://dx.doi.org/10.1055/s-0042-113128) pmid:http://www.ncbi.nlm.nih.gov/pubmed/27548885 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

51.  Sajid MS , Rehman S , Chedgy F , et al . Improving the mucosal visualization at gastroscopy: a systematic review and meta-analysis of randomized, controlled trials reporting the role of Simethicone ± N-acetylcysteine. Transl Gastroenterol Hepatol 2018;3:29.[doi:10.21037/tgh.2018.05.02](http://dx.doi.org/10.21037/tgh.2018.05.02) pmid:http://www.ncbi.nlm.nih.gov/pubmed/29971260 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

52.  Visrodia K , Singh S , Krishnamoorthi R , et al . Magnitude of missed esophageal adenocarcinoma after Barrett's esophagus diagnosis: a systematic review and meta-analysis. Gastroenterology 2016;150:599–607. quiz e14-5.[doi:10.1053/j.gastro.2015.11.040](http://dx.doi.org/10.1053/j.gastro.2015.11.040) pmid:http://www.ncbi.nlm.nih.gov/pubmed/26619962 
    
    [CrossRef](http://fg.bmj.com/lookup/external-ref?access_num=10.1053/j.gastro.2015.11.040&link_type=DOI) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=26619962&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

53. British Society of Gastroenterology ERCP Working Party. ERCP – the way forward, a standards framework, 2014. Available: [https://www.bsg.org.uk/asset/341DCD67-426A-44F4-910DD392C8A39606](https://www.bsg.org.uk/asset/341DCD67-426A-44F4-910DD392C8A39606) 
    
    

54.  Siau K , Hodson J , Valori RM , et al . Performance indicators in colonoscopy after certification for independent practice: outcomes and predictors of competence. Gastrointest Endosc 2019;89:482–92.[doi:10.1016/j.gie.2018.07.032](http://dx.doi.org/10.1016/j.gie.2018.07.032) 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

55.  Ravindran S , Thomas-Gibson S , Siau K . Joint Advisory group on gastrointestinal endoscopy (JAG) framework for managing underperformance in gastrointestinal endoscopy. Frontline Gastroenterol 2021.[doi:10.1136/flgastro-2021-101830](http://dx.doi.org/10.1136/flgastro-2021-101830) 
    
    

56.  Siau K , Hodson J , Valori RM , et al . Performance indicators in colonoscopy after certification for independent practice: outcomes and predictors of competence. Gastrointest Endosc 2019;89:482–92.[doi:10.1016/j.gie.2018.07.032](http://dx.doi.org/10.1016/j.gie.2018.07.032) pmid:http://www.ncbi.nlm.nih.gov/pubmed/30076842 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

57.  Siau K , Li J , Fisher NC , et al . Intubation failure during gastroscopy: incidence, predictors and follow-up findings. J Gastrointestin Liver Dis 2017;26:339–44.[doi:10.15403/jgld.2014.1121.264.isq](http://dx.doi.org/10.15403/jgld.2014.1121.264.isq) pmid:http://www.ncbi.nlm.nih.gov/pubmed/29253046 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

58.  Matharoo M , Thomas-Gibson S , Haycock A , et al . Implementation of an endoscopy safety checklist. Frontline Gastroenterol 2014;5:260–5.[doi:10.1136/flgastro-2013-100393](http://dx.doi.org/10.1136/flgastro-2013-100393) pmid:http://www.ncbi.nlm.nih.gov/pubmed/25285191 
    
    [Abstract/FREE Full Text](http://fg.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiZmxnYXN0cm8iO3M6NToicmVzaWQiO3M6NzoiNS80LzI2MCI7czo0OiJhdG9tIjtzOjIzOiIvZmxnYXN0cm8vMTMvMy8xOTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

59.  Ravindran S , Matharoo M , Coleman M , et al . Teamworking in endoscopy: a human factors toolkit for the COVID-19 era. Endoscopy 2020;52:879–83.[doi:10.1055/a-1204-5212](http://dx.doi.org/10.1055/a-1204-5212) pmid:http://www.ncbi.nlm.nih.gov/pubmed/32572861 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

60.  Fudman DI , Falchuk KR , Feuerstein JD . Complication rates of trainee- versus attending-performed upper gastrointestinal endoscopy. Ann Gastroenterol 2019;32:273–7.[doi:10.20524/aog.2019.0372](http://dx.doi.org/10.20524/aog.2019.0372) pmid:http://www.ncbi.nlm.nih.gov/pubmed/31040624 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom) 

61.  Siau K , Iacucci M , Dunckley P , et al . The impact of COVID-19 on gastrointestinal endoscopy training in the United Kingdom. Gastroenterology 2020;159:1582–5.[doi:10.1053/j.gastro.2020.06.015](http://dx.doi.org/10.1053/j.gastro.2020.06.015) pmid:http://www.ncbi.nlm.nih.gov/pubmed/32553761 
    
    [PubMed](http://fg.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fflgastro%2F13%2F3%2F193.atom)