Acessibilidade / Reportar erro

Construction and validation of a non-organic, homemade, low-cost cricothyrotomy simulator. A cross-sectional study

Construção e validação de um simulador de cricotireotomia não orgânico, caseiro e de baixo custo: um estudo transversal

ABSTRACT

Introduction:

Cricothyrotomy is a procedure that may save lives in emergency acute respiratory failure. Cricothyrotomy must be trained during undergraduate medical education, and low-cost simulators may offer a satisfying solution in economical and practical terms.

Objective:

The aims of this study were to build and assess the face, content, and construct validity of a low-cost, homemade cricothyrotomy simulator developed by the authors.

Methods:

Forty-seven students and nine surgeons performed three successive simulated cricothyrotomies and answered a face and content validity questionnaire. The construct validity was tested by comparing procedural duration and a global performance score intra- and between groups.

Results:

Most face and content validity questionnaire items were highly and positively rated, with no difference between the groups. Accordingly, students and surgeons agreed that the simulator resembles a human neck anterior surface, is easy and safe to use, allows the performance of critical steps of the cricothyrotomy, and exhibits potential teaching feasibility. Procedural duration decreased between the first and third attempts among students (mean time decrease = 61.85 s; 95% CI - 41.86 - 81.85; p < 0.001), and a significant difference was found between surgeons’ and students’ performance duration (mean difference = 101.36 seconds [95% CI = 69.08 - 133.64] p < 0.001), suggesting construct validity. The students’ performance scores improved between the first and second attempts (mean difference = 2.25 points; CI 95% = 1.31 - 3.20; p < 0.001).

Conclusions:

The non-organic, homemade, low-cost cricothyrotomy simulator has acceptable face, content, and construct validity and is suitable for use as a training tool by undergraduate medical students.

Keywords:
Airway management; Cricoid, surgery; Medical education, undergraduate; Simulation training; Validation study

RESUMO

Introdução:

A cricotireotomia é um procedimento que pode salvar vidas em caso de insuficiência respiratória aguda de emergência. A cricotireotomia deve ser treinada durante a graduação médica, e simuladores de baixo custo podem oferecer uma solução satisfatória em termos econômicos e práticos.

Objetivo:

Este estudo teve como objetivos construir e determinar as validades de face, conteúdo e construção de um simulador caseiro de cricotireotomia de baixo custo desenvolvido pelos autores.

Método:

Quarenta e sete estudantes e nove cirurgiões realizaram três cricotireotomias simuladas sucessivas e responderam a um questionário de validade de face e de conteúdo. A validade de construto foi testada comparando tempos procedurais e um escore de desempenho global intragrupos e intergrupos.

Resultado:

A maioria dos itens do questionário de validade face e de conteúdo foram avaliados de forma positiva, sem diferença entre os grupos. Assim, estudantes e cirurgiões concordaram que o simulador se assemelha a uma superfície anterior do pescoço humano, é fácil e seguro de usar, permite a realização de etapas críticas da cricotireotomia e apresenta potencial viabilidade de ensino. O tempo de procedimento diminuiu entre a primeira e a terceira tentativa entre os estudantes (diminuição média do tempo = 61,85 s; IC 95% - 41,86 - 81,85; p < 0,001), e foi encontrada diferença significativa entre os tempos de atuação dos cirurgiões e dos estudantes (diferença média = 101,36 segundos [IC 95% = 69,08 - 133,64] p < 0,001), sugerindo validade de construto. Os escores de desempenho dos alunos melhoraram entre a primeira e a segunda tentativa (diferença média = 2,25 pontos; IC 95% = 1,31 - 3,20; p < 0,001).

Conclusão:

O simulador de cricotireotomia inorgânico, de fabricação caseira e de baixo custo possui validade de face, conteúdo e construção aceitáveis para ser usado como ferramenta de treinamento para estudantes de graduação em Medicina.

Palavras-chave:
Gerenciamento das Vias Aéreas; Cartilagem Cricoide; Cirurgia; Educação Médica; Graduação; Treinamento de Simulação; Estudo de Validação.

INTRODUCTION

Cricothyrotomy is a life-saving procedure used in emergency airway management. Cricothyrotomy accounts for approximately 0.45% of emergency airway interventions as the last resource to establish a patent airway in “cannot intubate, cannot oxygenate” (CICO) scenarios. Thus, mastering cricothyrotomy is crucial for physicians, especially those involved in emergency, critical, or anesthesia care.11. Higgs A, McGrath BA, Goddard C, Rangasami J, Suntharalingam G, Gale R, et al. Guidelines for the management of tracheal intubation in critically ill adults. Br J Anaesth 2018;120(2):323-352. Nevertheless, proficiency achievement poses challenges, notably the limited availability of high-fidelity simulators and the financial investment regarding cost-efficiency22. Temperly K, Yaegashi C, Silva A, Novak E. Desenvolvimento e validação de um simulador de traqueostomia de baixo custo. Sci Medica 2018;28:28845.)-(44. A Nah S, Singaravel S, Sanmugam A. Do-It-Yourself Surgical Simulation Kits: One Academic Medical Center’s Response to the COVID-19 Pandemic in Malaysia. Academic Medicine , Vol. 96 , No. 1..

Simulators serve as tools for the acquisition and improvement of procedural skills in airway management55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.)-(77. Khan IF, Zidoun Y, Mascarenhas S, Zary N. Promoting Simulation-Based Learning through Low-Cost Simulators: Development, Skills Targeted and Implementation.. Simulators also facilitate hands-on practice in a stress-free and safe environment, fostering mastery of technical and non-technical procedural skills55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.),(66. Gadgil US. Role of simulators in surgical education. ALTEX - Altern Anim Exp 2007;24(3):172-173.. Skills acquired through simulation training can be effectively transferred to clinical practice55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.),(77. Khan IF, Zidoun Y, Mascarenhas S, Zary N. Promoting Simulation-Based Learning through Low-Cost Simulators: Development, Skills Targeted and Implementation.)-(99. Weller JM. Simulation in undergraduate medical education: bridging the gap between theory and practice. Med Educ 2004;38(1):32-38., thus contributing to patient safety and minimizing costs associated with medical errors1010. Panazzolo ARP, Grando LB, Volpato LK, de Oliveira Filho GR. The development and psychometric validation of a low-cost anthropomorphic 3D-printout simulator for training basic skills applicable to office-based hysteroscopy. Gynecol Surg 2021;18(1):7.. Implementing simulation-based learning in some medical education contexts may face obstacles primarily related to the institutional budget, physical space, or clerical support.

Commercially available high-fidelity simulators are expensive55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.),(77. Khan IF, Zidoun Y, Mascarenhas S, Zary N. Promoting Simulation-Based Learning through Low-Cost Simulators: Development, Skills Targeted and Implementation.),(1111. Ellinas H, Denson K, Simpson D. Low-Cost Simulation: How-To Guide. J Grad Med Educ 2015;7(2):257-258., and exceed the needs for basic skill training55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.),(1212. Stone L, Hellewell SA. Low cost simulation training in anaesthesia. Update Anaesth 2014;29:44-46.)-(1717. Hart D, Nelson J, Moore J, Gross E, Oni A, Miner J. Shoulder Dystocia Delivery by Emergency Medicine Residents: A High‐fidelity versus a Novel Low‐fidelity Simulation Model-A Pilot Study. AEM Educ Train 2017;1(4):357-362.. While high-fidelity simulators are essential for training non-technical skills and crisis resource management, low-fidelity simulators may be more effective for technical skills 1313. Adams AJ, Wasson EA, Admire JR, Pablo Gomez P, Babayeuski RA, Sako EY, et al. A Comparison of Teaching Modalities and Fidelity of Simulation Levels in Teaching Resuscitation Scenarios. J Surg Educ 2015;72(5):778-785.),(1414. Maran NJ, Glavin RJ. Low- to high-fidelity simulation - a continuum of medical education? Med Educ 2003;37(s1):22-28.. The abovementioned factors have contributed to fostering research on low-cost, low-fidelity simulators22. Temperly K, Yaegashi C, Silva A, Novak E. Desenvolvimento e validação de um simulador de traqueostomia de baixo custo. Sci Medica 2018;28:28845.),(33. Kei J, Mebust DP, Duggan LV. The REAL CRIC Trainer: Instructions for Building an Inexpensive, Realistic Cricothyrotomy Simulator With Skin and Tissue, Bleeding, and Flash of Air. J Emerg Med 2019;56(4):426-430.),(55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.)-(88. Sankaranarayanan G, Odlozil CA, Hasan SS, Shabbir R, Qi D, Turkseven M, et al. Training on a virtual reality cricothyroidotomy simulator improves skills and transfers to a simulated procedure. Trauma Surg Acute Care Open 2022;7(1):e000826.),(1010. Panazzolo ARP, Grando LB, Volpato LK, de Oliveira Filho GR. The development and psychometric validation of a low-cost anthropomorphic 3D-printout simulator for training basic skills applicable to office-based hysteroscopy. Gynecol Surg 2021;18(1):7.)-(1212. Stone L, Hellewell SA. Low cost simulation training in anaesthesia. Update Anaesth 2014;29:44-46.),(1818. Nah SA, Singaravel S, Sanmugam A. Do-It-Yourself Surgical Simulation Kits: One Academic Medical Center’s Response to the COVID-19 Pandemic in Malaysia. Academic Medicine , Vol. 96 , No. 1.)-(2222. Doucet G, Ryan S, Bartellas M, Parsons M, Dubrowski A, Renouf T. Modelling and Manufacturing of a 3D Printed Trachea for Cricothyroidotomy Simulation. Cureus 2017;9(8):e1575.. For example, Kei et al. introduced the REAL CRIC Trainer, a cost-efficient simulator that includes skin, tissue, and bleeding components33. Kei J, Mebust DP, Duggan LV. The REAL CRIC Trainer: Instructions for Building an Inexpensive, Realistic Cricothyrotomy Simulator With Skin and Tissue, Bleeding, and Flash of Air. J Emerg Med 2019;56(4):426-430.. Similarly, Varaday et al. developed a homemade cricothyrotomy model that showed potential as a training tool2121. Varaday SS, Yentis SM, Clarke S. A homemade model for training in cricothyrotomy*. Anaesthesia 2004;59(10):1012-1015.. However, data on the psychometric validity of low-fidelity cricothyrotomy simulators are still scarce.

This study aimed to validate the psychometric performance - face, content, and construct validity - of a non-organic, homemade, low-cost cricothyrotomy simulator specifically developed for this study.

METHOD

The Institutional Research Ethics Committee approved this observational cross-sectional study (Certificate of Presentation of Ethical Review number 49469321.7.0000.0121). Written informed consent and authorization for the use of images were obtained from the study participants. This study complies with the STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) statement2323. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med 2007;4(10):e297..

Forty-seven medical students and nine surgeons were recruited from December 2021 to July 2022. The inclusion criterion for students was having been approved in the surgical technique discipline of the medical course, and the exclusion criterion was having had previous training in cricothyroidotomy. The inclusion criterion for surgeons was an experience with at least two emergent cricothyrotomies in actual patients.

The simulator was designed to mimic the structures of the anterior human neck and the airway involved in the performance of the cricothyrotomy: skin, thyroid, and cricoid cartilages, cricothyroid ligament, trachea, main bronchi, and lungs. The cartilages were sculpted in epoxy resin over a corrugated plastic electrical conduit simulating the trachea. A replaceable kinesiology tape covered a 1 cm hole between the thyroid and cricoid components, simulating the cricothyroid ligament. Garden hose Y-shaped accessories adapted to the distal part of the trachea component simulated the main bronchi, and rubber balloons adapted to the bronchi component simulated the lungs. The assembled components were embedded into a high-density foam piece with rounded contours simulating the anterior face of a human neck. The simulator was covered with an artificial skin made of a tulle mesh embedded in skin-color silicone resin. The set was attached to a base made of two medium-density fiberboard (MDF) boards with hinges at one end, allowing the replacement of the cricothyroid ligament component and the skin incision site between attempts. The construction cost of the simulator was estimated by summing the acquisition prices of the simulator components.

A cricothyrotomy kit containing a scrubbing bowl, gauze pads, straight forceps for antisepsis, a fenestrated drape, a disposable scalpel with a number 15 blade, curved forceps, and simulated antiseptic solution (tap water) was available for performing the simulated procedures.

Before participating in the simulation session, each participant completed a demographic questionnaire that included age, self-declared gender identity, and dominant hand. The students were asked about the semester they were attending in the medical course, while the surgeons were inquired about their specialty, time in practice and the number of cricothyrotomies performed.

Thirty minutes before starting the simulation session, students watched a video demonstrating the steps of an emergent cricothyrotomy using the simulator.

The cricothyrotomy demonstration followed a pre-defined 13-step task sequence: (1) glove wearing, (2) skin antisepsis, (3) drape positioning, (4) assembly of the scalpel, (5) palpation of the cricothyroid ligament, (6) transversal skin incision over the cricothyroid ligament, (7) assuring the incision is approximately 1-cm wide, (8) 90° rotation of the scalpel to pass the bougie, (9) bougie advancement into the trachea, (10) tracheal tube lubrication, (11) positioning of the tracheal tube into the trachea, (12) tracheal cuff inflation, (13) lung inflation. After watching the video, the students were allowed to ask questions and clarify doubts with the instructor.

Afterward, each participant performed a sequence of three simulated cricothyrotomies at 3 to 5-minute intervals, during which the instructor replaced the cricothyroid ligament component, repositioned the artificial skin for the next attempt and replaced the cricothyrotomy kit.

The procedures were digitally recorded with cameras focused on the participants’ hands to allow blind assessment and rating of the student’s technical performance. Procedural duration was obtained from the video recordings.

The participating surgeons performed three consecutive simulated cricothyrotomies at 3 to 5-minute intervals between them, using their techniques of choice. The procedures were video recorded, and performance duration was obtained from the videos.

After completing the cricothyrotomy attempts, the participants answered a 22-item questionnaire addressing criteria for face and content validity, usability, students’ self-perceived preparedness or surgeons’ perceptions about the simulator’s realism, and general opinions about the relevance of teaching cricothyrotomy to medical students.

The criteria for face validity included the simulator’s resemblance to a human anterior aspect of the neck and the haptic sensations produced by the simulator components (items 1 and 2). The criteria for content validity included the participants’ perceived capacity of the simulator to reproduce the steps of an emergent cricothyrotomy and its use as a teaching or training tool for undergraduate medical students (items 8 - 15). The criteria for usability included the easiness and intuitiveness of assembly, portability, safety, construction, and operational costs (items 3 - 7 and 19 - 22). Miscellaneous topics included one question directed at surgeons addressing the realism of the cricothyrotomy performed on the simulator (item 18); two questions directed at medical students addressing the perceived self-preparedness for performing an emergent cricothyroidotomy in an actual patient, and the role of the simulator experience in acquiring cricothyrotomy skills (items 16 and 17); and one question addressed the perceived relevance of developing cricothyrotomy skills during undergraduate medical education (item 20). The items were rated on 11-point (0 - 10) numerical rating scales, where zero represented the most negative and ten the most positive perceptions. To meet the construct validity criteria, performance on the simulator should differentiate students’ and surgeons’ procedural duration, identify distinct student performance levels, and capture the students’ technical changes across sequential attempts.

The students’ technical performance was independently assessed by the two authors based on the video recordings using a 13-item checklist containing the steps of cricothyrotomy as demonstrated to the students before data collection. The items were rated on binary (yes/no) scales indicating the performance or not of each step2424. Hill C, Reardon R, Joing S, Falvey D, Miner J. Cricothyrotomy Technique Using Gum Elastic Bougie Is Faster Than Standard Technique: A Study of Emergency Medicine Residents and Medical Students in an Animal Lab. Acad Emerg Med 2010;17(6):666-669.),(2525. Heymans F, Feigl G, Graber S, Courvoisier DS, Weber KM, Dulguerov P. Emergency Cricothyrotomy Performed by Surgical Airway-naive Medical Personnel: A Randomized Crossover Study in Cadavers Comparing Three Commonly Used Techniques. Anesthesiology 2016;125(2):295-303.. Discrepant ratings were reviewed, and the final performance scores comprised the average of the two raters’ scores.

Statistical Analyses

Shapiro-Wilk and Kolmogorov-Smirnov tests were used to assess the adherence of data to the normal distribution. Scores assigned to items in the validation questionnaire were compared between students and experts using the Mann-Whitney U tests and summarized as median and 25th - 75th percentiles. Two-way, repeated measures ANOVA (groups x attempts) was used to compare performance duration between students and experts. Data are summarized as mean and 95% confidence limits. Square root transformation was applied to the students’ performance scores, and one-way, repeated measures ANOVA (attempts) followed by the Student-Newman-Keuls post hoctest were used to compare the students’ performance scores among the three attempts. For reporting, squared marginal means and 95% confidence intervals (95% CI) were estimated to return summary scores to the original scale. Statistical significance was set at an alpha probability lower than 5%. The internal consistency of the face and content validity questionnaire was assessed by estimating the Cronbach’ alpha coefficient.

The sample size was estimated based on a minimal expected difference in performance duration between students and surgeons of at least 0.8 standard deviations, assuming an alpha = 5% and 1 - beta = 20%. Accordingly, a sample including 24 students and eight surgeons was adequate for two-tailed comparisons using the Mann-Whitney test, with an allocation rate of at least three students to one surgeon. Sample size calculations were performed using G*Power software, version 3.1 2626. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39:175-191..

RESULTS

Study sample

Forty-seven students and nine surgeons completed the study without losses or missing data. The study flow diagram is shown in Figure 1.

Figure 1
Study flow diagram.

The demographic data of the samples are shown in Table 1.

Table 1
Participants’ demographic data.

Simulator construction cost

The construction cost of the simulator was estimated at US$ 30 and the session cost was estimated at ¢40 for each attempt. The simulator is shown in Figure 2.

Figure 2
External view of the simulator.

Face and content validity

The Cronbach’s alpha coefficient of the face and content validity questionnaire was 0.88 (95% CI = 0.83 - 0.92). Responses to the validation questionnaire are shown in Table 2. Accordingly, students and surgeons assigned similarly high ratings to the visual and tactile resemblance of the simulator to the front surface of a human neck. The simulator was considered capable of reproducing the main cricothyrotomy steps, and its adequacy as a teaching device was rated highly by students and surgeons. Usability was suggested by the high ratings assigned to the simulator’s easiness and intuitiveness of assembly, portability, safety, and low cost. Students and surgeons were also very positive regarding the relevance of acquiring cricothyrotomy skills in medical education. No differences were found between the students’ and surgeons’ ratings. The experience in the simulator contributed to the students’ positive perceptions about their acquisition of cricothyrotomy skills and their self-preparedness to perform it in actual patients. Surgeons positively rated the realism of the simulator.

Table 2
Comparison between students’ and surgeons’ responses to the face and content validity questionnaire.

Construct validity

The surgeons’ procedural duration were shorter than the students’ in all attempts (Table 3). Procedural duration did not change across the surgeons’ attempts, but the students’ times decreased significantly from the first to the third attempt.

Table 3
Comparison of performance duration between students and surgeons.

The students’ technical performance scores increased significantly from the first (mean ± SEM = 9.01 ± 0.01; 95% CI = 8.16 - 9.91) to the second attempt (mean ± SEM = 11.56 ± 0.0009; 95% CI = 11.14 - 11.99; p = < 0.001) but stabilized from the second to the third attempt (mean ± SEM = 11.32 ± 0.01; 95% CI = 10.25 - 12.43).

DISCUSSION

Cost-effective, objective-driven simulators are critical in medical education55. Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.),(99. Weller JM. Simulation in undergraduate medical education: bridging the gap between theory and practice. Med Educ 2004;38(1):32-38.),(1515. Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, et al. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ 2019;19(1):29.),(1515. Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, et al. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ 2019;19(1):29., especially for vital procedures such as cricothyrotomy11. Higgs A, McGrath BA, Goddard C, Rangasami J, Suntharalingam G, Gale R, et al. Guidelines for the management of tracheal intubation in critically ill adults. Br J Anaesth 2018;120(2):323-352., given the dramatic and life-saving nature of this procedure in CICO scenarios2020. Hughes KE, Biffar D, Ahanonu EO, Cahir TM, Hamilton A, Sakles JC. Evaluation of an Innovative Bleeding Cricothyrotomy Model. Cureus 2018;10(9):e3327.)-(2222. Doucet G, Ryan S, Bartellas M, Parsons M, Dubrowski A, Renouf T. Modelling and Manufacturing of a 3D Printed Trachea for Cricothyroidotomy Simulation. Cureus 2017;9(8):e1575.. This study provides evidence for the reliability of a homemade, low-cost cricothyrotomy simulator for training undergraduate medical students in cricothyrotomy.

A simulator must demonstrate its face, content, and construct validity to be considered educationally beneficial and merit advanced psychometric testing1010. Panazzolo ARP, Grando LB, Volpato LK, de Oliveira Filho GR. The development and psychometric validation of a low-cost anthropomorphic 3D-printout simulator for training basic skills applicable to office-based hysteroscopy. Gynecol Surg 2021;18(1):7.),(2727. McDougall EM. Validation of surgical simulators. J Endourol 2007;21(3):244-247.),(2828. Schout BMA, Hendrikx AJM, Scheele F, Bemelmans BLH, Scherpbier AJJA. Validation and implementation of surgical simulators: a critical review of present, past, and future. Surg Endosc 2010;24(3):536-546.. Validation strategies can be distinguished into subjective and objective approaches. Subjective approaches evaluate novices’ and experts’ opinions, while objective approaches evaluate experimental prospective performances. Face and content validity are examples of subjective validity, while construct validity requires an objective parameter. Face validity refers to how realistic the simulator looks and feels to the user and its acceptance, implying that some resemblance must be perceived between the simulator and human anatomical structures. Also, haptic sensations returned to the operator during simulation must be similar to those returned during the performance on an actual patient. Content validity refers to the capability of the simulator to allow the performance of the main steps of the target procedure, as assessed by experts. The simulator developed for this study met the face and content validity criteria.

Construct validity requires demonstrating that performance on the simulator can discriminate distinct performance levels, for example, between experts and novices, or changes in performance in time, indicating gain of familiarity or skills during repeated attempts. Accordingly, the simulator consistently differentiated performance duration between surgeons and students, and students’ performance scores improved from the first to the second attempt, suggesting that the simulator may have met the criteria for construct validity2727. McDougall EM. Validation of surgical simulators. J Endourol 2007;21(3):244-247.),(2828. Schout BMA, Hendrikx AJM, Scheele F, Bemelmans BLH, Scherpbier AJJA. Validation and implementation of surgical simulators: a critical review of present, past, and future. Surg Endosc 2010;24(3):536-546..

Our results suggest high face validity of the simulator, based on the participants’ favorable judgment about the resemblance and haptic similarities between the simulator and the human anterior neck anatomy. Favorable experts’ judgment about the capacity of reproducing the main steps of an emergent cricothyrotomy and the usefulness of the simulator as a teaching tool suggests the content validity of the simulator. Evidence for the construct validity of the simulator is provided by its capacity of discriminating between novice and expert performance and capturing student improvement across attempts1414. Maran NJ, Glavin RJ. Low- to high-fidelity simulation - a continuum of medical education? Med Educ 2003;37(s1):22-28..

This study must be interpreted considering its limitations. The study primarily focused on assessing the simulator’s face, content, and construct validity and did not explore other forms of validity (e.g., concurrent and criterion validity), which would have demanded a randomized controlled design. Also, long-term educational skill retention was not addressed in this study. Cricothyrotomy is a time-sensitive procedure. We did not impose time limits on students to complete the procedures. Adding time limits and increasing the number of procedures would have provided additional metrics of skill acquisition. Furthermore, assessing the simulator performance in a simulated CICO situation was not done. Skill transfer to the practice on actual patients was not aimed in this study because of the rarity of the procedure in the clinical setting and because the most skilled operator will always be prioritized in a CICO life-threatening situation.

CONCLUSION

In conclusion, the non-organic, homemade, low-cost cricothyrotomy simulator described in this study has acceptable face, content, and construct validity to be used as a training tool by undergraduate medical students.

REFERENCES

  • 1
    Higgs A, McGrath BA, Goddard C, Rangasami J, Suntharalingam G, Gale R, et al. Guidelines for the management of tracheal intubation in critically ill adults. Br J Anaesth 2018;120(2):323-352.
  • 2
    Temperly K, Yaegashi C, Silva A, Novak E. Desenvolvimento e validação de um simulador de traqueostomia de baixo custo. Sci Medica 2018;28:28845.
  • 3
    Kei J, Mebust DP, Duggan LV. The REAL CRIC Trainer: Instructions for Building an Inexpensive, Realistic Cricothyrotomy Simulator With Skin and Tissue, Bleeding, and Flash of Air. J Emerg Med 2019;56(4):426-430.
  • 4
    A Nah S, Singaravel S, Sanmugam A. Do-It-Yourself Surgical Simulation Kits: One Academic Medical Center’s Response to the COVID-19 Pandemic in Malaysia. Academic Medicine , Vol. 96 , No. 1.
  • 5
    Urdiales A, Struck G, Guetter C, Yeagashi C, Temperly K, Abreu P, et al. Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models. Rev Colégio Bras Cir;47.
  • 6
    Gadgil US. Role of simulators in surgical education. ALTEX - Altern Anim Exp 2007;24(3):172-173.
  • 7
    Khan IF, Zidoun Y, Mascarenhas S, Zary N. Promoting Simulation-Based Learning through Low-Cost Simulators: Development, Skills Targeted and Implementation.
  • 8
    Sankaranarayanan G, Odlozil CA, Hasan SS, Shabbir R, Qi D, Turkseven M, et al. Training on a virtual reality cricothyroidotomy simulator improves skills and transfers to a simulated procedure. Trauma Surg Acute Care Open 2022;7(1):e000826.
  • 9
    Weller JM. Simulation in undergraduate medical education: bridging the gap between theory and practice. Med Educ 2004;38(1):32-38.
  • 10
    Panazzolo ARP, Grando LB, Volpato LK, de Oliveira Filho GR. The development and psychometric validation of a low-cost anthropomorphic 3D-printout simulator for training basic skills applicable to office-based hysteroscopy. Gynecol Surg 2021;18(1):7.
  • 11
    Ellinas H, Denson K, Simpson D. Low-Cost Simulation: How-To Guide. J Grad Med Educ 2015;7(2):257-258.
  • 12
    Stone L, Hellewell SA. Low cost simulation training in anaesthesia. Update Anaesth 2014;29:44-46.
  • 13
    Adams AJ, Wasson EA, Admire JR, Pablo Gomez P, Babayeuski RA, Sako EY, et al. A Comparison of Teaching Modalities and Fidelity of Simulation Levels in Teaching Resuscitation Scenarios. J Surg Educ 2015;72(5):778-785.
  • 14
    Maran NJ, Glavin RJ. Low- to high-fidelity simulation - a continuum of medical education? Med Educ 2003;37(s1):22-28.
  • 15
    Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, et al. High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ 2019;19(1):29.
  • 16
    Katayama A, Nakazawa H, Tokumine J, Lefor AK, Watanabe K, Asao T, et al. A high-fidelity simulator for needle cricothyroidotomy training is not associated with increased proficiency compared with conventional simulators. Medicine (Baltimore) 2019;98(8):e14665.
  • 17
    Hart D, Nelson J, Moore J, Gross E, Oni A, Miner J. Shoulder Dystocia Delivery by Emergency Medicine Residents: A High‐fidelity versus a Novel Low‐fidelity Simulation Model-A Pilot Study. AEM Educ Train 2017;1(4):357-362.
  • 18
    Nah SA, Singaravel S, Sanmugam A. Do-It-Yourself Surgical Simulation Kits: One Academic Medical Center’s Response to the COVID-19 Pandemic in Malaysia. Academic Medicine , Vol. 96 , No. 1.
  • 19
    Diniz R, Duarte AL dos A, Oliveira CAS de, Romiti M. Animais em aulas práticas: podemos substituí-los com a mesma qualidade de ensino? Rev Bras Educ Médica 2006;30:31-40.
  • 20
    Hughes KE, Biffar D, Ahanonu EO, Cahir TM, Hamilton A, Sakles JC. Evaluation of an Innovative Bleeding Cricothyrotomy Model. Cureus 2018;10(9):e3327.
  • 21
    Varaday SS, Yentis SM, Clarke S. A homemade model for training in cricothyrotomy*. Anaesthesia 2004;59(10):1012-1015.
  • 22
    Doucet G, Ryan S, Bartellas M, Parsons M, Dubrowski A, Renouf T. Modelling and Manufacturing of a 3D Printed Trachea for Cricothyroidotomy Simulation. Cureus 2017;9(8):e1575.
  • 23
    Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med 2007;4(10):e297.
  • 24
    Hill C, Reardon R, Joing S, Falvey D, Miner J. Cricothyrotomy Technique Using Gum Elastic Bougie Is Faster Than Standard Technique: A Study of Emergency Medicine Residents and Medical Students in an Animal Lab. Acad Emerg Med 2010;17(6):666-669.
  • 25
    Heymans F, Feigl G, Graber S, Courvoisier DS, Weber KM, Dulguerov P. Emergency Cricothyrotomy Performed by Surgical Airway-naive Medical Personnel: A Randomized Crossover Study in Cadavers Comparing Three Commonly Used Techniques. Anesthesiology 2016;125(2):295-303.
  • 26
    Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39:175-191.
  • 27
    McDougall EM. Validation of surgical simulators. J Endourol 2007;21(3):244-247.
  • 28
    Schout BMA, Hendrikx AJM, Scheele F, Bemelmans BLH, Scherpbier AJJA. Validation and implementation of surgical simulators: a critical review of present, past, and future. Surg Endosc 2010;24(3):536-546.
  • 2
    Avaliado pelo processo de double blind review.
  • SOURCES OF FUNDING

    The authors declare no sources of funding.

Edited by

Chief Editor: Rosiane Viana Zuza Diniz. Associate Editor: Izabel Coelho.

Publication Dates

  • Publication in this collection
    21 June 2024
  • Date of issue
    Apr-Jun 2024

History

  • Received
    19 Jan 2024
  • Accepted
    14 Apr 2024
Associação Brasileira de Educação Médica SCN - QD 02 - BL D - Torre A - Salas 1021 e 1023 | Asa Norte, Brasília | DF | CEP: 70712-903, Tel: (61) 3024-9978 / 3024-8013, Fax: +55 21 2260-6662 - Brasília - DF - Brazil
E-mail: rbem.abem@gmail.com