Abstract
Purpose: To develop and test a model of teaching by means of an abdominal cavity simulator.
Methods: This study had two stages: development of a teaching model and an experimental prospective study that aimed to evaluate the residents’ competence. The participants were divided into 3 groups: first-year resident, second-year resident, and senior surgeon. The two groups of resident physicians received training in the simulator, under instructor supervision for skill acquisition, according to the model proposed in first stage. The surgeons did not receive this intervention. The correlations and associations were verified through simple and multiple linear regressions. The learning curves were analysed using Cox regression models. The impact of the epidemiological characteristics was tested.
Results: All residents reached the maximum score at the end of 16 steps and were comparable to the experimental (p<0.001).
Conclusion: Residents who underwent training using the methodology of the proposed teaching model, which is based on realistic simulation, acquired proficiency in the accomplishment of endosutures in up to 16 hours of training in the laboratory.
Key words: Laparoscopy; Education; Simulation Training; Surgical Procedures, Operative
Introduction
Simulation is a training method used mainly in risk activities, with the aim of increasing the safety of the procedures. In the area of healthcare, it aims to reproduce the essential aspects of a clinical scenario, increasing the possibility of success in a real clinical context1. Realistic simulation has emerged as a tool for learning in video surgery, performed in an accessible, safe, controlled and standardized environment, which aims to improve skills and transfer them to the operating room, promoting an increase in the learning curve2.
The growing ethical need for greater patient safety has stimulated the development and validation of simulators as a teaching tool in the skills laboratories of several institutions2. The use of simulators can be applied at different levels of professional training: during the specialty years, in the postgraduate period, and in the maintenance of certain previously acquired skills in professionals3.
Complex laparoscopic tasks, such as laparoscopic sutures and intracorporeal knots, require a high level of technical skill. This can be achieved through the use of a simulation model4. The performance of video surgeries by resident physicians considerably increases surgical time and hospital stay5. The practice of physicians learning advanced laparoscopic procedures in the operating room is insufficient for proficiency in advanced techniques. This emphasizes the importance of training in the laboratory before the operating room, with the aim of improving learning6. Buckley et al.4 have consistently documented the positive impact of the simulation on operative time, although the data are insufficient to demonstrate the transfer of these skills to the operating room. Choy et al.7 have shown that training with simulators improves residents’ ability to perform advanced procedures and the safety of residency programmes.
Considering that there are few well-designed teaching models that were proven to be effective in the preparation of resident physicians for advanced laparoscopic techniques outside the operating room, this paper sought to develop and test a model of teaching by means of an abdominal cavity simulator for the progression of skills in videolaparoscopic endosutures.
Methods
The research was analysed and approved by the Research Ethics Committee (REC) of Centro Universitário Unichristus and Instituto Dr. José Frota (Protocol of REC 59774116.20000.5049), in compliance with Resolution 466/12 of the National Health Council. The research was processed according to the release of the approved consent opinion and after free and informed consent of the group studied by participant in which they expressed their consent to participate in the research.
Study type and population
This study was divided in two stages: the first was the development of a teaching model that uses abdominal cavity simulators to acquire proficiency in videolaparoscopic endosutures, employing the scientific literature and proposing interventions. At this stage, there were no human trials. The Psychomotor Skills Progression Scale and Suture Proficiency in Video Surgery was developed as an initial reference for psychomotor skills developed by Moura Júnior5.
The second stage was an experimental prospective study that aimed to evaluate the residents’ competence in the progression of their abilities to execute tasks using the proposed teaching model. In this stage, the participants were divided into 3 groups with 10 components each: first-year resident physicians (R1), second-year resident physicians (R2), and senior surgeon preceptors of surgery. The two groups of resident physicians received training in the simulator. Resident physicians R1 and R2 conducted two weekly sessions of training in video simulator surgery under instructor supervision for skill acquisition (ergonomics, laparoscopic forceps handling, stereotactic, triangulation, core effect, ambidexterity, hapticity, handles, strings, adjusted knots and endosutures), according to the model proposed in step 1. The training sessions lasted two hours. The surgeons did not receive this intervention.
The competence of R1 and R2 in the execution of the endosutures was evaluated longitudinally. Residents who were able to complete the six points with five adjusted knots within 18 minutes had their training terminated after suture analysis by the investigator, confirming that all qualitative criteria were met. The training was completed when the endorsed study reached two points in the evaluation of the researcher, as shown in Table 1.
The senior surgeons performed suturing with at least six points with five adjusted knots. Surgeons who achieved the goal in shorter time continued to suture until they completed eighteen minutes.
Study site
Previous training and evaluation of surgical residents occurred in the Surgical Skills Laboratories, Centro Universitário Unichristus, and Instituto Dr. José Frota, from February to September 2016. Unichristus´ SSL is housed in a 40 m² air-conditioned room with fluorescent lighting. It has 08 Endo-Suture Trainer Box® simulators distributed at a distance of 1.0 metres from each other, with 08 support benches, consumer surgical materials (threads, gloves, tissue substitutes, forms) and permanent instruments (tweezers, needle holders and laparoscopic scissors). José Frota Institute’s SSL is installed in an air-conditioned room in the Study Center, measuring 50 m², with fluorescent ceiling lighting. It has 02 Endo-Suture Trainer Box® simulators installed at a distance of 1.5 metres between them, two benches and a support table.
Study sample
The sample consisted of 10 resident physicians of first-year general surgery (R1), 10 second-year general surgery residents (R2) and 10 senior surgeons, a sample compatible with studies published in the international literature.
Intervention group: Residents of general surgery (R1 and R2) in the state of Ceará enrolled in the Dr José Frota Institute (IJF) on duty for a minimum of 30 days between February and September 2016 were included in the sample. Residents who did not complete the training, those who did not follow the proposed model of endorsement, and those who were on leave or leave during the training period were excluded from the study.
Comparative group: Surgeons employed at the Dr José Frota Institute who have performed at least 50 advanced videolaparoscopic surgeries (fundoplication and/or endosuture digestive procedures) and who have performed more than 50 hours of videolaparoscopic procedures per year. Surgeons who were on leave or leave during the study period were not included in the sample.
Study variables
We used epidemiological variables of the first- (R1) and second-year (R2) residents who measured the level of previous experience with videolaparoscopic procedures. For both groups of residents and senior surgeons, we used categorical variables that assessed the quality of the suture and numerical variables that measured the level of ability and the time to perform the endosutures, as described below:
Categorical variables
-
a) Variable “distance between points”: All six knots must maintain between them a distance between 5 and 7 mm. The pointer scored 0.2 points. If any knots were outside the standardized distance, the participant received a zero score. The assessment was made by the researcher.
-
b) Variable “tissue margin of knots”: All six knots should have a lateral tissue margin to suture between 4 and 5 mm. The indicator was worth 0.2 points. If any knots were outside the standardized range, the participant would receive zero.
-
c) Variable “border symmetry”: The six knots should maintain symmetry at the depth of the left and right edges of the suture. The acceptable difference was less than 1 mm. This item equals 0.2 points. If any knots were out of standardized symmetry, the score would be zeroed.
-
d) Variable “knot tension”: The six knots should have adequate tension, keeping the edges of the suture together. The indicator was worth 0.2 points. If any points were out of standardized tension, the score would be zero. The gauging was performed by the researcher with the removal of all points using laparoscopic scissors. The tip of the scissors was inserted into the point handle, allowing a unique cut.
The measurements of each item were made by a experienced surgeon (more than 80 surgeries), through blinded recordings of the procedures performed by the participants, after the end of the procedure, and by only on judge to guarantee standardization.
Numerical variables
-
a) Variable “number of knots in 18 minutes”: at least five knots should be performed in 18 minutes. The indicator was worth 0.5 points. If less than five knots were performed at the standard time, the score would be zero. The assessment was made by the researcher.
-
b) Variable “time to make the suture” (06 points with 05 knots adjusted): The six knots should be performed in a time equal to or less than 18 minutes. The indicator was worth 1.0 point. If the six points were accomplished in a longer time than standardized, the score would be zero. The assessment was made by the researcher.
-
c) Variable “sum of skills”: Represented the sum of all categorical and numerical variables. This variable defined the level of skill in making the suture. When the sum was equal to 2.0 points, it was considered that the student had reached proficiency.
Acquisition of proficiency
The competence of the residents in the execution of the sutures was evaluated longitudinally. The training was completed when the suture earned two points according to the researcher’s evaluation. The criteria used to consider the proficient trainee are listed in Table 1.
Development of the teaching model
The developed model was composed of theoretical and practical activities aimed at the acquisition of psychomotor skills in basic and advanced video surgery. The training sessions were performed in Surgical Skills Laboratories using abdominal cavity simulators with structure to simulate laparoscopic procedures. Sessions were monitored by a surgeon. The following materials were used in the laboratory of surgical skills: abdominal cavity simulators, surgical instruments, thread, rubber pieces, and other materials. Chart 1 summarizes the training steps.
Data processing and analysis
The numerical and categorical variables used as parameters to acquire proficiency in the endosutures were analysed in the pre-test and in the post-tests. Categorical quantitative results were presented as percentages and counts, and the numerical results were measured as central trend measures. A comparison test was performed on the binomial distribution of a sample to test the main hypothesis. ANOVA and chi square tests were performed to compare variables, as appropriate. The correlations and associations between two numerical variables were verified through simple and multiple linear regression, when the determinants were included in addition to the number of training sessions. Comparisons with p value up to 0.05 were considered significant. The learning curves were analysed longitudinally using Cox regression models. The impact of the epidemiological characteristics on the learning curve was tested. The qualitative data were transformed by a Likert scale for quantitative gauging. The data were tabulated and analysed by SPSS software (Statistical Package for the Social Sciences), v23, SPSS, Inc. for the analysis and evaluation of data collected.
Results
Evolution of learning
Table 2 shows the number of tests required to obtain the maximum score for residents. The average knots made in 18 minutes were 2 knots in the pre-test and increased to 6 points in the last test. The average suture length increased from 45.9 minutes to 18 minutes from the pre-test to the last test. The mean final score evolved from 0.2 in the pre-test to 2.0 in the final test. The p-value of the main hypothesis test was 0.012.
Tables 3 and 4 show the comparison of the skills between R1 and R2 in the pre-test and after the last test, along with comparisons with the results of the surgeons.
Comparison of skills, in the pre-test and after the last training test, among first (R1) and second (R2) year surgical residents of IJF Institute.
Comparison of skills, in the pre-test and after the last training test, between the residents of the second year of surgery and the senior surgeons of IJF Institute.
The comparison of pre-test skills among first- and second-year residents revealed a statistically significant difference in the edge symmetry and final score, with the superiority of second-year residents. Edge symmetry was better performed by R2 in the pre-test (p = 0.006) compared to R1. The mean final score of the R1 in the pre-test was 0.1, while that of R2 was 0.4 and that of the surgeons was 1.8. In the pre-test, the distance between the knots (p = (P = 0.031), tissue margin (p = 0.531), adequate knot tension (p = 0.051), number of knots in 18 minutes (p = 0.247) and suture preparation time (p = 0.083) showed no statistically significant differences between R1 and R2. The R2 showed a greater ability than the R1 in the symmetry criterion of the pre-test edges (p = 0.006). It was noted that only 10% of the R1 was able to correctly perform the distance between the knots, a good tissue margin of the knots, symmetry of the edges and adequate tension of the knots, criteria evaluated in the pre-test. Comparison of skills in the pre-test between R2 and senior surgeons revealed a statistically significant difference in the 5 criteria and in the final score, with superior performance of the surgeons. The distance between the knots (p = 0.010), the tissue margin of the knots (p <0.001), knot tension (p = 0.010), 5 or more knots in 18 min (p <0.001) and suture (P <0.001) were criteria better performed by the surgeons than by the R2, during the pre-test.
In the post test, it was observed that there was only a difference in the symmetry of the edges between R1 and R2. Approximately 90% of the R2 obtained adequate symmetry, compared with 60.4% of the R1 (p = 0.001). In the comparison between R2 and surgeons, one criterion, “tissue margin of 4 to 5 mm knots” (p = 0.046), showed a significant difference in relation to the results of the pre-test.
Figure 1 shows the evolution of the final score reached by residents of IJF surgery throughout the training. All residents studied reached the maximum score at the end of the procedure.
Discussion
These results demonstrated that general surgery residents who underwent training in videolaparoscopic simulators using the methodology of the proposed teaching model based on realistic simulation acquired proficiency in the performance of endosutures after up to 16 hours of training in the laboratory. The P-value of the main hypothesis test was 0.012.
Consistent evidence of the efficacy of simulation as a tool for skill acquisition led the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) to develop and incorporate into their cognitive curriculum an educational programme entitled Fundamental of Laparoscopic Skills (FSL) in the early 2000s. The training aims to improve and transfer the skills acquired from the training lab to the operating room8. The programme consists of laparoscopic training modules in simulators covering pre, intra and postoperative knowledge and basic (object transfer, cut patterns, loop ligatures, knots and extracorporeal sutures) and advanced laparoscopic procedures (intracorporeal knots and sutures), with the measurement of cognitive and technical skills. Korndorffer et al.9 studied the transfer of skills from a simulation environment to the operating room. Seventeen residents with basic videolaparoscopy training but with minimal experience in advanced procedures were randomized to undergo training in simulators preceding a laparoscopic Nissen fundoplication in pigs. The group with previous training in simulators performed fundoplication in less time, with a lower overall score and errors (p<0.001), confirming the superior performance compared to the group without the intervention. The author concluded that simulator training is effective in acquiring skills, and these are transferable to the operating room9. The data from this study reinforce the analysis of the insufficient quality of the endosuture measured in the pre-test of the two groups of residents and in the group of surgeons, where it was verified that only 10% of first-year residents and 20% of second-year residents performed technically suitable sutures. It is noteworthy that most of the R2 were in the last quarter of the residence. In the pre-test, was identified that the skills of residents of different years and surgeons was quite diverse. When comparing the groups of residents and surgeons in the post-test, it was observed that one of the finest variables of the evaluation, the symmetry, was the only point that the least experienced residents had a deficit compared to their second-year peers. Both presented inferior results to the surgeons with regard to the margin of the nodes, demonstrating that the adequate margin has a flatter learning curve. This also suggest the efficacy of the proposed model.
There is a great variety of simulators for training in laparoscopy, with advantages and disadvantages in each model. However, the criteria for proficiency evaluation are quite heterogeneous in the learning studies. One criterion often analysed is the time to perform the procedure. Although the relevance of the procedures’ time is unquestionable from an economic perspective, the analysis alone does not reflect surgical proficiency10. Complex laparoscopic tasks, such as laparoscopic sutures and intracorporeal knots, require a high level of technical skill. This can be acquired through the use of a simulation model. In a systematic review, Buckley et al.11 studied the acquisition of skills through simulation and transfer to the operating room. Sixteen randomized controlled trials involving 309 participants were eligible for qualitative analysis. Operative time decreased significantly in all studies.
Simulation training programmes have shown a shortening of the transferable learning curve to the operating room, reducing intra and postoperative complications and, consequently, improving surgical outcomes for patients. Aggarwal et al.12 studied the learning curve in 20 novice residents using virtual reality simulators for cholecystectomy compared to conventional surgeries in swine. The author concluded that the simulation model was more efficient and reduced the learning curve in the operating room. It should be emphasized, however, that there is still a well-designed teaching model proven to be effective in the preparation of residents for skills acquisition in advanced laparoscopic techniques outside the operating room implemented in surgical residences in Brazil. Nacul et al.1 reviewed the situation of teaching in video surgery in services that published their methods in Brazil, concluding that there is a great deficit in the training and training in video surgery in the different specialties, which is reflected in the large learning curves1.
Limitations
The study did not measure the retention of skills after the acquisition of proficiency. New translational studies will be needed to analyse the transfer of skills to the operating room. Residents may have had external training, apart from the training offered, between the initial and final tests, although there wasn’t parallel formal training offered in their study places during the study period. Further studies may use concurrent controls of same year.
Conclusions
The teaching model, which was the object of this study, presented significant evidence of evolution in the learning curve, offering the beginner surgeon the methods, ability, safety and efficacy in performing basic and advanced tasks in video surgery, such as knots and intracorporeal sutures. Mastery of these skills will enable surgeons to progressively perform more complex procedures.
References
-
1 Nácul MP, Cavazzola LT. Current status of residency training in laparoscopic surgery in Brazil: a critical review. ABCD Arq Bras Cir Dig (São Paulo). 2015;28(1):81-5. doi: 10.1590/s0102-67202015000100020.
» https://doi.org/10.1590/s0102-67202015000100020 -
2 Stefanidis D, Arora S, Parrack DM, Hamad GG, Capella L, Grantcharov T, Urbach DR, Scott DJ, Jones DB. Research priorities in surgical simulation for the 21st century. Am J Surg. 2012;203(1):49-53. doi: 10.1016/j.amjsurg.2011.05.008.
» https://doi.org/10.1016/j.amjsurg.2011.05.008 -
3 Cabrera Vilanova A, Muñoz García A, Sabench Pereferrer F, Hernández González M, Castillo Déjardin DD. Evaluación de las habilidades quirúrgicas durante el pregrado mediante la introducción de un simulador virtual. Cir Esp (Ed impr). 2013;91(3):177-83. doi: 10.1016/j.ciresp.2012.05.019.
» https://doi.org/10.1016/j.ciresp.2012.05.019 -
4 Buckley CE, Kavanagh DO, Traynor O, Neary PC. Is the skillset obtained in surgical simulation transferable to the operating theatre? Am J Surg. 2014;207(1):146-57. doi: 10.1016/j.amjsurg.2013.06.017.
» https://doi.org/10.1016/j.amjsurg.2013.06.017 - 5 Moura Júnior LGD. Modelo acadêmico de ensino teórico-prático em vídeo cirurgia, por meio de novo simulador real de cavidade abdominal (Doutotado). Universidade Federal do Ceará; 2015.
-
6 Palter VN, Orzech N, Reznick RK, Grantcharov TP. Validation of a structured training and assessment curriculum for technical skill acquisition in minimally invasive surgery: a randomized controlled trial. An Surg. 2013;257(2):224-30. doi: 10.1097/SLA.0b013e31827051cd.
» https://doi.org/10.1097/SLA.0b013e31827051cd -
7 Choy I, Okrainec A. Simulation in surgery: perfecting the practice. Surg Clin North Am. 2010;90(3):457-73. doi: 10.1016/j.suc.2010.02.011.
» https://doi.org/10.1016/j.suc.2010.02.011 -
8 Cavalini WLP, Claus CMP, Dimbarre D, Cury Filho EA, Bonin EA, Loureiro Mde P, Salvalaggio P. Development of laparoscopic skills in Medical students naive to surgical training. Einstein (São Paulo). 2014;12(4):467-72. doi: 10.1590/S1679-45082014AO3237.
» https://doi.org/10.1590/S1679-45082014AO3237 -
9 Korndorffer JR, Dunne JB, Sierra R, Stefanidis D, Touchard CL, Scott DJ. Simulator training for laparoscopic suturing using performance goals translates to the operating room. J Am Coll Surg. 2005;201(1):23-9. doi: 10.1016/j.jamcollsurg.2005.02.021.
» https://doi.org/10.1016/j.jamcollsurg.2005.02.021 -
10 Berguer R, Forkey D, Smith W. Ergonomic problems associated with laparoscopic surgery. Surg Endosc. 1999;13(5):466-8. doi: 10.1007/PL00009635.
» https://doi.org/10.1007/PL00009635 -
11 Buckley CE, Kavanagh DO, Nugent E, Ryan D, Traynor OJ, Neary PC. The impact of aptitude on the learning curve for laparoscopic suturing. Am J Surg. 2014;207(2):263-70. doi: 10.1016/j.amjsurg.2013.08.037.
» https://doi.org/10.1016/j.amjsurg.2013.08.037 -
12 Aggarwal R, Hance J, Undre S, Ratnasothy J, Moorthy K, Chang A, Darzi A. Training junior operative residents in laparoscopic suturing skills is feasible and efficacious. Surgery. 2006;139(6):729-34. doi: 10.1016/j.surg.2005.12.010.
» https://doi.org/10.1016/j.surg.2005.12.010
Publication Dates
-
Publication in this collection
Jan 2018
History
-
Received
15 Sept 2017 -
Reviewed
16 Nov 2017 -
Accepted
19 Dec 2017