<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OALibJ</journal-id><journal-title-group><journal-title>Open Access Library Journal</journal-title></journal-title-group><issn pub-type="epub">2333-9705</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/oalib.1103412</article-id><article-id pub-id-type="publisher-id">OALibJ-74707</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Biomedical&amp;Life Sciences</subject><subject> Business&amp;Economics</subject><subject> Chemistry&amp;Materials Science</subject><subject> Computer Science&amp;Communications</subject><subject> Earth&amp;Environmental Sciences</subject><subject> Engineering</subject><subject> Medicine&amp;Healthcare</subject><subject> Physics&amp;Mathematics</subject><subject> Social Sciences&amp;Humanities</subject></subj-group></article-categories><title-group><article-title>
 
 
  Effectiveness of Low Cost Laparoscopic Training Box to Increase Laparoscopic Skills in Urology Training Center Universitas Padjadjaran/Hasan Sadikin General Hospital
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Aaron</surname><given-names>Tigor Sihombing</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Jupiter</surname><given-names>Sibarani</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Sudigdo</surname><given-names>Adi</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Postgraduate School of Medicine, Universitas Padjadjaran, Bandung, Indonesia</addr-line></aff><aff id="aff1"><addr-line>Urology Department, Faculty of Medicine, Universitas Padjadjaran, Bandung, Indonesia</addr-line></aff><pub-date pub-type="epub"><day>02</day><month>03</month><year>2017</year></pub-date><volume>04</volume><issue>03</issue><fpage>1</fpage><lpage>8</lpage><history><date date-type="received"><day>January</day>	<month>29,</month>	<year>2017</year></date><date date-type="rev-recd"><day>Accepted:</day>	<month>March</month>	<year>11,</year>	</date><date date-type="accepted"><day>March</day>	<month>14,</month>	<year>2017</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
   
   Laparoscopy has become the standard of care in many urological procedures. Various simulations are used to train laparoscopic skills. This study evaluates the effectiveness of our low cost laparoscopic training box simulation to improve urologic laparoscopic skills. The study was conducted during Urology Laparoscopic Surgery Training Course in the department of Urology Universitas Padjadjaran/Hasan Sadikin General Hospital in year 2016. Eight practicing urologists with mean age 40.2 completed the study. Lecture and video presentation were presented to all participants before box training. Pre- training participants w
   ere evaluated for two basic laparoscopic tasks using a global rating scale and a task specific checklist. Participants then were trained under instructor supervision and then evaluated using the same global rating scale and specific task list. Participants performed nephrectomy on the second day on a live animal (pigs) and evaluated. Wilcoxon matched paired signed-rank test was used to analyze pre- and post-training score results. There are statistically significant improvements in global rating scale and task specific checklist for both tasks (
   P
    
   &lt; 0.05). All participants successfully performed nephrectomy on the pigs that reflects low cost laparoscopic training box simulation is effective to improve urologic laparoscopic skills. 
  
 
</p></abstract><kwd-group><kwd>Laparoscopy</kwd><kwd> Low Cost Training Box</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>With the advancement in surgical technology, laparoscopic surgery has become the standard in many urological procedures. Laparoscopy has the ability to minimize surgical trauma, decrease postoperative surgical pain, reduce the length of the hospital stay, and provide a safe and esthetically surgical wound. In renal cancer treatment for instance, laparoscopy radical nephrectomy has replaced open radical nephrectomy as the standard for renal cancer total removal [<xref ref-type="bibr" rid="scirp.74707-ref1">1</xref>] . Other procedure in which laparoscopy has become a standard is laparoscopic deroofing for renal cyst. Current evidence on the safety and efficacy of laparoscopic deroofing of simple renal cysts is adequate to support the use of this procedure [<xref ref-type="bibr" rid="scirp.74707-ref2">2</xref>] .</p><p>In Indonesia laparoscopy urologic surgery is not widely distributed. This is primarily due to high cost and advanced technologies require organizing laparoscopy training course. There are only three centers in Indonesia that have facility to organize laparoscopic urology training course. The course is only held once a year and some of the equipments for the laparoscopic urology training are rotated from center to center. Also there is no formal fellowship available for laparoscopic urologic training in Indonesia.</p><p>One of the problems for widespread use of laparoscopy surgery in Indonesia is a steep learning curve in laparoscopic surgery. The learning curve for laparoscopy radical prostatectomy ranged from 250 to 750 cases [<xref ref-type="bibr" rid="scirp.74707-ref3">3</xref>] . In laparoscopy pyeloplasty the learning curve reached a plateau after 51 cases [<xref ref-type="bibr" rid="scirp.74707-ref4">4</xref>] .</p><p>In order to shorten the laparoscopic learning curve, various simulations from simple box trainer, animal and virtual reality simulator are used. Virtual reality system is an advanced and effective training method which has been proved to significantly improve performance in the operation room compared to the control group [<xref ref-type="bibr" rid="scirp.74707-ref5">5</xref>] . Similarly, simple box training improves technical skills compared with no training in trainees without previous laparoscopic experience [<xref ref-type="bibr" rid="scirp.74707-ref6">6</xref>] .</p><p>Laparoscopy simulation system is expensive to most Indonesian, thus it is not targeted for use by trainer outside of training facilities. However, given a low budget for education system, limited training center and the growing demand in laparoscopy training, a low-cost and effective simulation system is needed.</p><p>Urology department Universitas Padjadjaran has designed a low-cost training box for laparoscopy simulation training. The objective of this study is to evaluate the effectiveness of our low-cost training box designed to improve laparoscopic urology skills.</p></sec><sec id="s2"><title>2. Material and Method</title><p>This study was carried out during three days course of 2<sup>nd</sup> Indonesia Japan Collaboration Program for Urology Laparoscopic Surgery Training Course in the department of Urology Universitas Padjadjaran/Hasan Sadikin General Hospital in year 2016. Hasan Sadikin general hospital is a tertiary hospital in Indonesia with three hundred and seventy four medical doctors and thirty four thousand admission per year. Ethical permission from Hasan Sadikin general hospital ethical committee was taken before the commencemment of the study</p><p>All hands on training laparoscopy participants, who are practicing urologist, are included in this study.</p><p>The department of urology Universitas Padjadjaran has set up a training room contain with six training box (<xref ref-type="fig" rid="fig1">Figure 1</xref>). Lectures consisting of basic instrument in laparoscopy surgery, basic techniques in laparoscopy surgery, suturing and knotting, and video presentation were presented before box training session. Box training demonstration is performed by instructor for each task. Three hours supervised box training session with one candidate held the camera for the other participant to feel of how camera is important in laparoscopic surgery. Partici- pants performed 4 tasks in the following order : first task transferring peanut to a small rubber bag ; second task inserting stent to a hole on a straw ; third task pattern cutting ; fourth task suturing and knotting (<xref ref-type="fig" rid="fig2">Figure 2</xref>). On the second day all participants were performing nephrectomy on a pig.</p><p>Locally manufactured box-trainer fitted with rubber gaskets to accommodate cannulae for the scope and tools (<xref ref-type="fig" rid="fig3">Figure 3</xref>). A camera equipment and a fiber- optic light source was used and the image is displayed on a video monitor.</p><fig id="fig1"  position="float"><label><xref ref-type="fig" rid="fig1">Figure 1</xref></label><caption><title> Training room</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/74707x2.png"/></fig><fig id="fig2"  position="float"><label><xref ref-type="fig" rid="fig2">Figure 2</xref></label><caption><title> (A) small rubber bag and peanut; (B) straw with different side hole (arrow); (C) cutting pattern; (D) sponge marked with dot for suturing and knotting</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/74707x3.png"/></fig><fig id="fig3"  position="float"><label><xref ref-type="fig" rid="fig3">Figure 3</xref></label><caption><title> Locally manufactured box trainer</title></caption><graphic mimetype="image"   position="float"  xlink:type="simple"  xlink:href="http://html.scirp.org/file/74707x4.png"/></fig><p>Pre training assesment</p><p>Each participant was given two basic task. The assessment was done by an observer using a global rating scale (<xref ref-type="table" rid="table1">Table 1</xref>) and a task specific checklist (<xref ref-type="table" rid="table2">Table 2</xref>) [<xref ref-type="bibr" rid="scirp.74707-ref7">7</xref>] .<sup> </sup></p><p>The first task is to insert ureteral catheter no. 4 french (fr) to a hole on a straw without damaging or displacing the straw. There are three straws with different hole placement, one on the right side of the straw, one on the midle side of the straw and one on the left side of the hole (<xref ref-type="fig" rid="fig2">Figure 2</xref>(B)).</p><p>The second task is to perform suturing to a dot marked white sponge and to performed a square knot using 3-0 silk sutures with a curve needle.</p><p>Post training Assesment</p><p>After completion all course sessions, participants were asked to perform the same tasks and were assessed by the same rating scale. Wilcoxon matched paired signed-rank test is used to assessed statistical significant difference between pre course and post course scores and a P value &lt; 0.05 is considered to statistically significant. All analysis were performed using R, which is open source and freely available.</p><p>On the second day, the participants were divided to four groups consist of two participant each, to perform nephrectomy on a pig. One participant holding the camera and one participant performing the operation. Successful operation is considered if there is no other organ injury while performing nephrectomy and the pig is still alive after unilateral nephrectomy.</p></sec><sec id="s3"><title>3. Results</title><p>There were eight urologists completed the study. All of the participant are male with mean age of 40.2 years and mean working experience 6.6 years.</p><p>The mean improvement in ureteral stent insertion score by global rating scale are listed in <xref ref-type="table" rid="table3">Table 3</xref>. Using Wilcoxon matched-paired signed-ranks test, 2-tailed P-value 0.01391 (P &lt; 0.05) which is statistically significant.</p><p>The mean improvement in suture drill score by global rating score are listed</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Global rating scale (Maximum score 20)</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  colspan="6"  >Rating</th></tr></thead><tr><td align="center" valign="middle" >Variable</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >2</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >5</td></tr><tr><td align="center" valign="middle" >Time and motion</td><td align="center" valign="middle" >Many unnecessary</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Efficient time and motion, but some unnecessary moves</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Economy of movement and maximum efficiency</td></tr><tr><td align="center" valign="middle" >Instrument handling</td><td align="center" valign="middle" >Repeatedly makes tentative or awkward moves with instruments</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Competent use of instruments, although occasionally appeared stiff or awkward</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Fluid moves with instruments and no awkwardness</td></tr><tr><td align="center" valign="middle" >Knowledge of instruments</td><td align="center" valign="middle" >Frequently asked for the wrong instrument or used inappropriate instrument</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Knew the names of most instruments and used appropriate instrument for the task</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Obviously familiar with the instruments required and their names</td></tr><tr><td align="center" valign="middle" >Use of assistants</td><td align="center" valign="middle" >Consistently placed assistants poorly or failed to used assistants</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Good use of assistants most of the time</td><td align="center" valign="middle" ></td><td align="center" valign="middle" >Strategically used assistant to the best advantage at all times</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Task specific checklist. One point for each correctly performed procedure</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Procedure</th><th align="center" valign="middle" >Correctly performed</th><th align="center" valign="middle" >Incorectly performed</th></tr></thead><tr><td align="center" valign="middle" >Proper straw handling</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Proper stent insertion</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Correct needle holding tehnique</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Accurate needle passage</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Square knot</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td></tr></tbody></table></table-wrap><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Participant characteristic</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >No.</th><th align="center" valign="middle" >Age (years)</th><th align="center" valign="middle" >Gender</th><th align="center" valign="middle" >Working experience (years)</th></tr></thead><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >39</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >6</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >47</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >12</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >55</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >18</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >46</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >11</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >36</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >3</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >33</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >7</td><td align="center" valign="middle" >33</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >1</td></tr><tr><td align="center" valign="middle" >8</td><td align="center" valign="middle" >33</td><td align="center" valign="middle" >Male</td><td align="center" valign="middle" >1</td></tr></tbody></table></table-wrap><p>in <xref ref-type="table" rid="table4">Table 4</xref>. Using Wilcoxon matched-paired signed-ranks test, 2-tailed P-value 0.0136 (P &lt; 0.05) which is statistically significant.</p><p>The mean improvement in task check list is listed in <xref ref-type="table" rid="table5">Table 5</xref>. Using Wilcoxon matched-paired signed-ranks test, 2-tailed P-value 0.0132 (P &lt; 0.05) which is statistically significant.</p><p>All four groups (two participants each, one participant holding the camera and one participant performing the operation) performed succesfull nephrecto- my procedure. There was no other organ injury and the pigs alive (<xref ref-type="table" rid="table6">Table 6</xref>).</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Global rating scale (Maximum score 20)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" >Pre-training score</th><th align="center" valign="middle" >Post-training score</th></tr></thead><tr><td align="center" valign="middle" >Mean</td><td align="center" valign="middle" >7.6</td><td align="center" valign="middle" >12.5</td></tr><tr><td align="center" valign="middle" >Standard deviation</td><td align="center" valign="middle" >3.3</td><td align="center" valign="middle" >1.2</td></tr><tr><td align="center" valign="middle" >Median</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >12</td></tr></tbody></table></table-wrap><p>Using Wilcoxon matched-paired signed-ranks test, 2-tailed P-value 0.01391.</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Mean pre and post training global rating scale in suturing and knotting</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" >Pre-training score</th><th align="center" valign="middle" >Post-training score</th></tr></thead><tr><td align="center" valign="middle" >Mean</td><td align="center" valign="middle" >6.7</td><td align="center" valign="middle" >10.3</td></tr><tr><td align="center" valign="middle" >Standard deviation</td><td align="center" valign="middle" >3.0</td><td align="center" valign="middle" >2.0</td></tr><tr><td align="center" valign="middle" >Median</td><td align="center" valign="middle" >5.5</td><td align="center" valign="middle" >9.5</td></tr></tbody></table></table-wrap><p>Using Wilcoxon matched-paired signed-ranks test, 2-tailed P-value 0.0136.</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Mean pre-training and post training task checklist</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" >Pre-training score</th><th align="center" valign="middle" >Post-training score</th></tr></thead><tr><td align="center" valign="middle" >Mean</td><td align="center" valign="middle" >7.6</td><td align="center" valign="middle" >12.5</td></tr><tr><td align="center" valign="middle" >Standard deviation</td><td align="center" valign="middle" >3.3</td><td align="center" valign="middle" >1.2</td></tr><tr><td align="center" valign="middle" >Median</td><td align="center" valign="middle" >7</td><td align="center" valign="middle" >12</td></tr></tbody></table></table-wrap><p>Using Wilcoxon matched-paired signed-ranks test, 2-tailed P-value 0.0132.</p></sec><sec id="s4"><title>4. Discussion</title><p>In 1990 laparoscopy surgery was introduced to Indonesian general surgeons. A teleconference between American surgeon and Indonesian was held in Indonesia private hospital. It was followed by laparoscopy cholecystectomy live surgery demonstartion in two private hospitals in the capital city of Indonesia Jakarta. Since then laparascopy cholecystectomy has gradually become a gold standard for treating gallbladder disease in several major cities in Indonesia.</p><p>Laparoscopy urology in Indonesia was started in 2004 when five Indonesian urologists were sent for laparoscopy training in Salzbourg, Austria. In contrast to laparascopy cholecystectomy there was not such a relatively easy to learn and frequent procedure in urology. Also the center for laparoscopy urology training in Indonesia has not changed since 2004. This is due to cost for building a laparoscopy center. Thus the widespread use of laparoscopy urology in Indone- sia is very slow.</p><p>Study by Gawande et al. [<xref ref-type="bibr" rid="scirp.74707-ref8">8</xref>] showed that 66% of all adverse events in Colorado and Utah hospital were surgical and 54% of these surgical adverse events were preventable. These findings showed that there is a need for a quality improve- ment in surgical care.</p><p>Indonesian research and higher education ministry in 2013 planned to shorten urology training time from 5 years training to 4 years training to fasten urology spreading in Indonesia. However, these plans will reduce the opportu- nities for trainee urologists to learn their skills through experience in the operating room and reduce quality surgical care.</p><p>Simulation offered a promising training environment for intraoperative stress management, enhancing performance and patient safety [<xref ref-type="bibr" rid="scirp.74707-ref9">9</xref>] . Evidence suggests that skills acquired in the simulated environment may transfer to the clinical setting [<xref ref-type="bibr" rid="scirp.74707-ref10">10</xref>] . However, for a simulation to be integrated into any training curriculum, it must be shown that it is effective and efficient (low cost and reducing training time).</p><p>Our box training simulation was designed to improve basic skills. Ureteral catheter insertion to a hole in a straw was designed to improve instrument hand- ling, two dimensional image orientation, depth perception and hand-eye coordi- nation.</p><p>One of the most challenging skills to gain in laparascopy is tissue anastomosis. Suturing drill in our laparascopy training box, the participants were asked to place stich to a sponge marked with dot using 3-0 silk suture with a curve needle. Attention was paid on tracing, needle holding, taking proper bites, accuracy puncture needle to the dot, tying a knot and cutting off extra suture.</p><p>P.D. van Hove et al. [<xref ref-type="bibr" rid="scirp.74707-ref11">11</xref>] review and analyze studies addressing the validity and reliability of methods for objective skills assessment within surgery and gynaecology. There were 104 studies and these studies were assessed according to the Oxford Centre for Evidence-Based Medicine levels of evidence. They concluded that most methods of skills assessment are valid for feedback or measuring progress of training.</p><p>This study used a global rating scale and task specific check list. Both of the measurement showed statistically significant improvement in laparoscopy performance in the box training simulation.</p><p>Studies by Martin et al. [<xref ref-type="bibr" rid="scirp.74707-ref12">12</xref>] and Beard et al. [<xref ref-type="bibr" rid="scirp.74707-ref13">13</xref>] correlate performance in bench tasks with performance in live animals (pigs) and the operating room. These studies found that there were correlation between performance in bench task and performance in live animal and operating rooms.</p><p>In our study there were improvements in both global rating scale and task specific check list in all participants and all groups successfully performed nephrectomy on pigs. Limitation of our study is the low number of participant and all participants are practicing urologists who have working experience at least one year.</p><p>Based on this study, we can conclude that our low cost training box is effective as a simulator to improve laparoscopic skills for urologist.</p></sec><sec id="s5"><title>Cite this paper</title><p>Sihombing, A.T., Sibarani, J. and Adi, S. (2017) Effectiveness of Low Cost Laparoscopic Training Box to Increase Laparoscopic Skills in Urology Training Center Universitas Padjadjaran/ Hasan Sadikin General Hospital. Open Access Library Journal, 4: e3412. https://doi.org/10.4236/oalib.1103412</p></sec></body><back><ref-list><title>References</title><ref id="scirp.74707-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Berger, A., Brandina, R., Atalla, M.A., et al. (2009) Laparoscopic Radical Nephrectomy for Renal Cell Carcinoma: Oncological Outcomes at 10 Years or More. The Journal of Urology, 182, 2172-2176. https://doi.org/10.1016/j.juro.2009.07.047</mixed-citation></ref><ref id="scirp.74707-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Consonni, P., Nava, L., Scattoni, V. and Bianchi, A. (1996) Percutaneous Echo-Guided Drainage and Sclerotherapy of Symptomatic Renal Cysts: Critical Comparison with Laparoscopic Treatment. The Archives of Italian Urology and Andrology, 68, 27-30.</mixed-citation></ref><ref id="scirp.74707-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Hammid, A., Mohammed, S.K., Khurshid, A.G., et al. (2014) Learning Curves for Urological Procedures: A Systematic Review. BJU International, 114, 617-629.https://doi.org/10.1111/bju.12315</mixed-citation></ref><ref id="scirp.74707-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Naya, Y., Araki, K., Kaga, K., et al. (2011) Learning Curve of Laparoscopic Pyeloplasty with 51 Cases by a Single Surgeon. Journal of Endourology, 25, 216-217.</mixed-citation></ref><ref id="scirp.74707-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Grantcharov, T.P., Kristiansen, V.B., Bendix, J., Bardram, L., Rosenberg, J. and Funch-Jensen, P. (2004) Randomized Clinical Trial of Virtual Reality Simulation for Laparoscopic Skills Training. The British Journal of Surgery, 91, 146-150.https://doi.org/10.1002/bjs.4407</mixed-citation></ref><ref id="scirp.74707-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Nagendran, M., Toon, C.D., Davidson, B.R. and Gurusamy, K.S. (2014) Laparoscopic Surgical Box Model Training for Surgical Trainees with No Prior Laparoscopic Experience. Cochrane Database of Systematic Reviews, 17, CD010479.</mixed-citation></ref><ref id="scirp.74707-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Moorthy, K., Munz, Y., Sarker, S.K. and Darzi, A. (2003) Objective Assessment of Technical Skills in Surgery. British Medical Journal, 327, 1032-1037.https://doi.org/10.1136/bmj.327.7422.1032</mixed-citation></ref><ref id="scirp.74707-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Gawande, A.A., Thomas, E.J., Zinner, M.J. and Brennan, T.A. (1999) The Incidence and Nature of Surgical Adverse Events in Colorado and Utah in 1992. Surgery, 126, 66-75. https://doi.org/10.1067/msy.1999.98664</mixed-citation></ref><ref id="scirp.74707-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Arora, S., Sevdalis, N., Nestel, D., Tierney, T., Woloshynowych, M. and Kneebone, R. (2009) Managing Intraoperative Stress: What Do Surgeons Want from a Crisis Training Program? The American Journal of Surgery, 197, 537-543.https://doi.org/10.1016/j.amjsurg.2008.02.009</mixed-citation></ref><ref id="scirp.74707-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Issenberg, S.B., Mc Gaghie, W.C., Petrusa, E.R., Lee Gordon, D. and Scalese, R.J. (2005) Features and Uses of High-Fidelity Medical Simulations That Lead to Effective Learning: A BEME Systematic Review. Medical Teacher, 27, 10-28.https://doi.org/10.1080/01421590500046924</mixed-citation></ref><ref id="scirp.74707-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Van Hove, P.D., Tuijthof, G.J., Verdaasdonk, E.G., Stassen, L.P. and Dankelman, J. (2010) Objective Assessment of Technical Surgical Skills. The British Journal of Surgery, 97, 972-987. https://doi.org/10.1002/bjs.7115</mixed-citation></ref><ref id="scirp.74707-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Martin, J.A., Regehr, G., Reznick, R., MacRae, H., Murnaghan, J., Hutchison, C., et al. (1997) Objective Structured Assessment of Technical Skill (OSATS) for Surgical Residents. The British Journal of Surgery, 84, 273-278.</mixed-citation></ref><ref id="scirp.74707-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Beard, J.D., Jolly, B.C., Newble, D.I., Thomas, W.E., Donnelly, J. and Southgate, L.J. (2005) Assessing the Technical Skills of Surgical Trainees. The British Journal of Surgery, 92, 778-782. https://doi.org/10.1002/bjs.4951</mixed-citation></ref></ref-list></back></article>