Deep learning-based computer vision to recognize and classify suturing gestures in robot-assisted surgery.

Abstract:

BACKGROUND:Our previous work classified a taxonomy of suturing gestures during a vesicourethral anastomosis of robotic radical prostatectomy in association with tissue tears and patient outcomes. Herein, we train deep learning-based computer vision to automate the identification and classification of suturing gestures for needle driving attempts. METHODS:Using two independent raters, we manually annotated live suturing video clips to label timepoints and gestures. Identification (2,395 videos) and classification (511 videos) datasets were compiled to train computer vision models to produce 2- and 5-class label predictions, respectively. Networks were trained on inputs of raw red/blue/green pixels as well as optical flow for each frame. Each model was trained on 80/20 train/test splits. RESULTS:In this study, all models were able to reliably predict either the presence of a gesture (identification, area under the curve: 0.88) as well as the type of gesture (classification, area under the curve: 0.87) at significantly above chance levels. For both gesture identification and classification datasets, we observed no effect of recurrent classification model choice (long short-term memory unit versus convolutional long short-term memory unit) on performance. CONCLUSION:Our results demonstrate computer vision's ability to recognize features that not only can identify the action of suturing but also distinguish between different classifications of suturing gestures. This demonstrates the potential to utilize deep learning computer vision toward future automation of surgical skill assessment.

journal_name

Surgery

journal_title

Surgery

authors

Luongo F,Hakim R,Nguyen JH,Anandkumar A,Hung AJ

doi

10.1016/j.surg.2020.08.016

subject

Has Abstract

pub_date

2020-09-26 00:00:00

eissn

0039-6060

issn

1532-7361

pii

S0039-6060(20)30548-1

pub_type

杂志文章

相关文献

SURGERY文献大全
  • NBCA medical adhesive (n-butyl-2-cyanoacrylate) versus suture for patch fixation in Lichtenstein inguinal herniorrhaphy: a randomized controlled trial.

    abstract:BACKGROUND:We compared the effectiveness of n-butyl-2-cyanoacrylate (NBCA) and traditional suture for patch fixation in Lichtenstein tension-free herniorrhaphy for inguinal hernias. METHODS:A total of 110 patients with primary unilateral inguinal hernia were assigned randomly to either experimental or control groups. ...

    journal_title:Surgery

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.surg.2011.09.031

    authors: Shen YM,Sun WB,Chen J,Liu SJ,Wang MG

    更新日期:2012-04-01 00:00:00

  • Development of the ThyCAT: A clinically useful computerized adaptive test to assess quality of life in thyroid cancer survivors.

    abstract:BACKGROUND:Current quality of life assessment tools for thyroid cancer survivors are not clinically useful due to the length of available questionnaires. Computerized adaptive tests are easily administered electronically and can achieve highly accurate and efficient results in minimal time. We aimed to develop a qualit...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2017.09.009

    authors: Aschebrook-Kilfoy B,Ferguson BA,Angelos P,Kaplan EL,Grogan RH,Gibbons RD

    更新日期:2018-01-01 00:00:00

  • Internal biliary drainage improves decreased number of gut mucosal T lymphocytes and MAdCAM-1 expression in jaundiced rats.

    abstract:BACKGROUND:Although the effect of preoperative biliary drainage in patients with obstructive jaundice is controversial, bacterial or endotoxin translocation is one of the main postoperative problem in jaundiced patients. Failure in gut barrier functions causes bacterial translocation; homing and distribution of T lymph...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2004.02.001

    authors: Sano T,Ajiki T,Takeyama Y,Kuroda Y

    更新日期:2004-09-01 00:00:00

  • Abdominal vena caval injuries: outcomes remain dismal.

    abstract:BACKGROUND:The mortality rate for abdominal vena caval injuries remains high. We examined the experience of a level I trauma center to determine factors significant to the outcome in these injuries. METHODS:Forty-seven patients were identified in a retrospective review (1989 to 1999) of patients were identified with a...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1067/msy.2000.108054

    authors: Hansen CJ,Bernadas C,West MA,Ney AL,Muehlstedt S,Cohen M,Rodriguez JL

    更新日期:2000-10-01 00:00:00

  • Unilateral neck exploration under local anesthesia: the approach of choice for asymptomatic primary hyperparathyroidism.

    abstract:BACKGROUND:Conventional parathyroidectomy involves a bilateral neck exploration with the patient under general anesthesia with a thorough search for all parathyroid tissue. The purpose of this study was to assess the efficacy and safety of unilateral neck exploration under local anesthesia in patients with asymptomatic...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1067/msy.2099.101834

    authors: Inabnet WB,Fulla Y,Richard B,Bonnichon P,Icard P,Chapuis Y

    更新日期:1999-12-01 00:00:00

  • Personality traits of surgical house officers: faculty and resident views.

    abstract::Resident evaluation is highly subjective and continues to be a problem. Personality traits and characteristics account for 28% of factors considered; deficits in this area account for 22% of advanced residency terminations. Sixty-four faculty members and 51 residents in six university surgical departments were surveye...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Greenburg AG,McClure DK,Penn NE

    更新日期:1982-08-01 00:00:00

  • Management of of arteriosclerotic aneurysm of the innominate artery.

    abstract::Arteriosclerotic aneurysm of the innominate artery is an unusual lesion. A review of the literature has revealed many approaches to this problem in the past, but the mortality rate has remained significant and serious complications have been frequent. Computerized axial tomography and noninvasive cerebrovascular metho...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Schumacher PD,Wright CB

    更新日期:1979-05-01 00:00:00

  • A prospective study of the pathophysiology of carcinoid crisis.

    abstract:BACKGROUND:Sudden massive release of serotonin, histamine, kallikrein, and bradykinin is postulated to cause an intraoperative carcinoid crisis. The exact roles of each of these possible agents, however, remain unknown. Optimal treatment will require an improved understanding of the pathophysiology of the carcinoid cri...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2018.04.093

    authors: Condron ME,Jameson NE,Limbach KE,Bingham AE,Sera VA,Anderson RB,Schenning KJ,Yockelson S,Harukuni I,Kahl EA,Dewey E,Pommier SJ,Pommier RF

    更新日期:2019-01-01 00:00:00

  • Endoscopic insertion of endoprostheses in the treatment of postoperative cutaneous biliary fistula.

    abstract::We report a case in which a large, postoperative, biliary cutaneous fistula was successfully treated by means of endoscopic insertion of two endoprostheses into the common bile duct. Twenty-four hours after the procedure, bile flow from the cutaneous fistula ceased completely. The endoprostheses were removed after 6 w...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Goldin E,Libson E,Rachmilewitz D

    更新日期:1987-07-01 00:00:00

  • Prospective, randomized trial of nasogastric suction in patients with acute pancreatitis.

    abstract::The efficacy of nasogastric (NG) suction was evaluated in a prospective, randomized trial in 60 patients with acute pancreatitis of mild to moderate severity. Group I, NG (29 patients) was treated with NG suction, and group II, no NG (31 patients) was treated without NG suction. The presentation, cause of pancreatitis...

    journal_title:Surgery

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:

    authors: Sarr MG,Sanfey H,Cameron JL

    更新日期:1986-09-01 00:00:00

  • Treatment of superficial cancer of the esophagus: a summary of responses to a questionnaire on superficial cancer of the esophagus in Japan.

    abstract:BACKGROUND:Histopathologic characteristics and optimal treatment modality for superficial esophageal cancer were reevaluated on the basis of 2418 patients from 143 institutions through a nationwide questionnaire to the members of the Japanese Society for Esophageal Diseases. METHODS:A questionnaire was designed for pa...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Kodama M,Kakegawa T

    更新日期:1998-04-01 00:00:00

  • The natural resistance-associated macrophage protein gene is associated with Crohn's disease.

    abstract:BACKGROUND:Identification of the genes causing inflammatory bowel disease (IBD) would enhance the understanding of and the treatment options for this disease. A hyperreactive immune response toward the intestinal flora has been implicated in the pathology of IBD. The natural resistance-associated macrophage protein (NR...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/s0039-6060(97)90006-4

    authors: Hofmeister A,Neibergs HL,Pokorny RM,Galandiuk S

    更新日期:1997-08-01 00:00:00

  • Neuroendocrine ampullary tumors: spectrum of disease including the first report of a neuroendocrine carcinoma of non-small cell type.

    abstract::Primary neuroendocrine tumors of the ampulla of Vater are rare. These tumors, like those of the respiratory tract and remainder of the gastrointestinal tract, appear along a histologic spectrum of increasing malignancy from low-grade carcinoid tumors to high-grade small cell undifferentiated cancers. We herein describ...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Emory RE Jr,Emory TS,Goellner JR,Grant CS,Nagorney DM

    更新日期:1994-06-01 00:00:00

  • Topical flurbiprofen decreases burn wound-induced hypermetabolism and systemic lipid peroxidation.

    abstract::We studied the effect of the topical application of the nonsteroidal anti-inflammatory agent, flurbiprofen, on postburn hypermetabolism and systemic lipid peroxidation. Twelve sheep with a 15% total body surface third-degree burn were monitored over a 4-day postburn period. In six sheep, a single application of a 5% f...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: LaLonde C,Knox J,Daryani R,Zhu DG,Demling RH,Neumann M

    更新日期:1991-05-01 00:00:00

  • Regional oral tolerance in transgenic 2C mice.

    abstract:BACKGROUND:Antigen injected subcutaneously (SQ) results in a strong systemic immune response, whereas antigen infused orally or by the portal vein tends to induce tolerance. Nontransgenic C57BL/6J (H-2(b)), or B6, mice and transgenic 2C mice (that express a cytotoxic T cell receptor against major histocompatibility com...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2005.05.010

    authors: Margenthaler JA,Flye MW

    更新日期:2005-08-01 00:00:00

  • Deep inferior epigastric arteriovenous shunt for hemodialysis.

    abstract::The deep inferior epigastric artery and vein may be satisfactorily utilized for chronic hemodialysis in patients who have no extremity vessels available. ...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Kauffman HM Jr

    更新日期:1975-11-01 00:00:00

  • Tertiary hyperparathyroidism: is less than a subtotal resection ever appropriate? A study of long-term outcomes.

    abstract:BACKGROUND:Our aim was to examine the outcomes of patients with tertiary hyperparathyroidism (3-HPT) who had limited resection of 1 or 2 parathyroids. METHODS:We reviewed 140 patients with 3-HPT who underwent parathyroidectomy (PTX) at a single institution. Patients were analyzed according to their operation-limited P...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2009.09.026

    authors: Pitt SC,Panneerselvan R,Chen H,Sippel RS

    更新日期:2009-12-01 00:00:00

  • Daily propranolol prevents prolonged mobilization of hematopoietic progenitor cells in a rat model of lung contusion, hemorrhagic shock, and chronic stress.

    abstract:INTRODUCTION:Propranolol has been shown previously to decrease the mobilization of hematopoietic progenitor cells (HPCs) after acute injury in rodent models; however, this acute injury model does not reflect the prolonged period of critical illness after severe trauma. Using our novel lung contusion/hemorrhagic shock/c...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2015.06.031

    authors: Bible LE,Pasupuleti LV,Gore AV,Sifri ZC,Kannan KB,Mohr AM

    更新日期:2015-09-01 00:00:00

  • Risk factors for esophageal cancer and the multiple occurrence of carcinoma in the upper aerodigestive tract.

    abstract::The multiple occurrence of squamous cell carcinoma is frequent in the upper aerodigestive tract (UADT). Risk factors not only for esophageal cancer, but also for multiple cancer in the UADT, were reviewed. Both cigarettes smoking and alcohol drinking are will known risk factors for esophageal cancer. The joint effect ...

    journal_title:Surgery

    pub_type: 杂志文章,评审

    doi:10.1067/msy.2002.119287

    authors: Morita M,Saeki H,Mori M,Kuwano H,Sugimachi K

    更新日期:2002-01-01 00:00:00

  • Carotid endarterectomy in women: early and long-term results.

    abstract:BACKGROUND:Although many randomized trials and other multicenter studies have demonstrated the benefits of carotid endarterectomy (CEA) in selected symptomatic and asymptomatic patients, including women, there is a remarkable lack of reports regarding the outcome of CEA with respect to sex. To analyze and compare the o...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1067/msy.2000.103161

    authors: Ballotta E,Renon L,Da Giau G,Sarzo G,Abbruzzese E,Saladini M,Baracchini C,Meneghetti G

    更新日期:2000-03-01 00:00:00

  • A randomized, prospective, blinded comparison of postoperative pain, metabolic response, and perceived health after laparoscopic and small incision cholecystectomy.

    abstract:BACKGROUND:We have previously shown that in a randomized comparison of laparoscopic (LC) versus small incision (SC) cholecystectomy, postoperative hospital stay is comparable. This randomized prospective study compares the postoperative pain, analgesic and antiemetic consumption, perceived health, and metabolic and res...

    journal_title:Surgery

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1067/msy.1998.87552

    authors: Squirrell DM,Majeed AW,Troy G,Peacock JE,Nicholl JP,Johnson AG

    更新日期:1998-05-01 00:00:00

  • Matas, Antyllus, and endoaneurysmorrhaphy.

    abstract::Much can be learned about the history of vascular surgery by tracing the treatment of aneurysms. Rudolph Matas played a major role in the development of the current therapy for these lesions. In the centennial of the signal case that set him on the road to surgical immortality, the details and setting of this operatio...

    journal_title:Surgery

    pub_type: 传,历史文章,杂志文章

    doi:

    authors: Friedman SG,Friedman MS

    更新日期:1989-06-01 00:00:00

  • Fat absorption after longitudinal pancreaticojejunostomy.

    abstract::This study was undertaken to determine whether fat absorption is improved following longitudinal pancreaticojejunostomy. Ten consecutive patients with chronic pancreatitis underwent measurement of fat absorption (fecal fat, 14C-labeled phenylacetic dipalmitate oil absorption test) before and after operation. Fecal fat...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Bradley EL 3rd,Nasrallah SM

    更新日期:1984-06-01 00:00:00

  • The System for Telementoring with Augmented Reality (STAR): A head-mounted display to improve surgical coaching and confidence in remote areas.

    abstract:BACKGROUND:The surgical workforce particularly in rural regions needs novel approaches to reinforce the skills and confidence of health practitioners. Although conventional telementoring systems have proven beneficial to address this gap, the benefits of platforms of augmented reality-based telementoring in the coachin...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2019.11.008

    authors: Rojas-Muñoz E,Cabrera ME,Lin C,Andersen D,Popescu V,Anderson K,Zarzaur BL,Mullis B,Wachs JP

    更新日期:2020-04-01 00:00:00

  • Prevention of transplant renal artery stenosis.

    abstract::Transplant renal artery stenosis occurred in 17 of 142 consecutive transplants (12 percent). All stenoses were in the renal artery distal to the anastomosis and two separate forms are recognized: angulation and segmental stenosis. Successful surgical correction in 12 of 17 patients relieved the hypertension and result...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Kauffman HM,Sampson D,Fox PS,Doyle TJ,Maddison FE

    更新日期:1977-02-01 00:00:00

  • Clonidine reduces norepinephrine and improves bone marrow function in a rodent model of lung contusion, hemorrhagic shock, and chronic stress.

    abstract:BACKGROUND:Propranolol has been shown previously to restore bone marrow function and improve anemia after lung contusion/hemorrhagic shock. We hypothesized that daily clonidine administration would inhibit central sympathetic outflow and restore bone marrow function in our rodent model of lung contusion/hemorrhagic sho...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:10.1016/j.surg.2016.08.043

    authors: Alamo IG,Kannan KB,Ramos H,Loftus TJ,Efron PA,Mohr AM

    更新日期:2017-03-01 00:00:00

  • Healing of ischemic colonic anastomoses in the rat: role of antibiotic preparation.

    abstract::In this study we evaluated the relative effects of ischemia with and without antibiotic bowel preparation on colonic wound healing. Thirty-two Sprague-Dawley rats (185 to 300 gm) were divided into five study groups: Groups I and II (n = 14) had no colonic ischemia, half receiving antibiotic bowel preparation before co...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Cohen SR,Cornell CN,Collins MH,Sell JE,Blanc WA,Altman RP

    更新日期:1985-04-01 00:00:00

  • A preliminary report: urgent duodenoscopic sphincterotomy for acute gallstone pancreatitis.

    abstract::Eleven patients wtih gallstone-related acute pancreatitis underwent urgent duodenoscopy and diathermy sphincterotomy; six had stones impacted at the papilla of Vater, and the remainder had stones in the bile duct. One patient had a gallstone in the pancreatic duct. Endoscopic removal of the duct stones resulted in a p...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Safrany L,Cotton PB

    更新日期:1981-04-01 00:00:00

  • Comparative cardiopulmonary effects of carbon dioxide versus helium pneumoperitoneum.

    abstract::The recent surge in enthusiasm for laparoscopic surgery has created concern that abdominal insufflation with carbon dioxide produces a respiratory acidosis. This may be because of both transperitoneal gas absorption and impaired ventilation with increased dead space from elevated intraabdominal pressure. To examine th...

    journal_title:Surgery

    pub_type: 杂志文章

    doi:

    authors: Leighton TA,Liu SY,Bongard FS

    更新日期:1993-05-01 00:00:00

  • Manual versus mechanical esophagogastric anastomosis after resection for carcinoma: a controlled trial. French Associations for Surgical Research.

    abstract:BACKGROUND:Mechanical anastomosis has been claimed to reduce the rate of leakage compared with manual anastomosis. No randomized trials have been performed to date to prove this specifically in esophagogastric anastomosis. METHODS:One hundred fifty-four patients, 139 men and 15 women ranging in age from 36 to 83 years...

    journal_title:Surgery

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1016/s0039-6060(96)80066-3

    authors: Valverde A,Hay JM,Fingerhut A,Elhadad A

    更新日期:1996-09-01 00:00:00