Deep attention networks for the prediction of pouch of Douglas obliteration from transvaginal ultrasound sliding sign videos

TY - JOUR

T1 - Deep attention networks for the prediction of pouch of Douglas obliteration from transvaginal ultrasound sliding sign videos

AU - O'Shea, K.

AU - Leonardi, M.

AU - Bolton, R. A.

AU - Condous, G.

AU - Lu, C.

PY - 2019/9/30

Y1 - 2019/9/30

N2 - ObjectivesRecent studies have demonstrated that the transvaginal sonography sliding sign technique is an accurate method of determining whether the pouch of Douglas (POD) is obliterated in women with suspected endometriosis. In this work we extend earlier work in which state of the art machine learning approaches to image recognition, particularly deep neural networks, were used for automated interpretation of the ‘sliding sign’ videos for automated detection of POD obliteration.MethodsThe data set used for model development consists of 88 ultrasound recordings from different sonographic machines to determine POD obliteration of women presenting with chronic pelvic pain, using the dynamic real‐time ‘sliding sign’ technique. Long term recurrent attention‐based convolutional neural networks were developed for this video classification task. The trained neural networks would take a sequence of frames, and extract spatial‐temporal features hierarchically through multiple layers of information processing, and output scores for the whether the video is interpreted as negative or positive sliding sign.ResultsOur best performing model achieved an accuracy of 80.3%, sensitivity 78.7%, and specificity of 74.7% in hold‐one‐out cross‐validation for predicting POD obliteration.ConclusionsIn spite of the limited dataset, we have demonstrated the potential of using deep attention‐based neural networks for the preoperative prediction of POD obliteration from a number of ‘sliding‐sign’ studies. Further work is needed to improve and evaluate the models using larger datasets.

AB - ObjectivesRecent studies have demonstrated that the transvaginal sonography sliding sign technique is an accurate method of determining whether the pouch of Douglas (POD) is obliterated in women with suspected endometriosis. In this work we extend earlier work in which state of the art machine learning approaches to image recognition, particularly deep neural networks, were used for automated interpretation of the ‘sliding sign’ videos for automated detection of POD obliteration.MethodsThe data set used for model development consists of 88 ultrasound recordings from different sonographic machines to determine POD obliteration of women presenting with chronic pelvic pain, using the dynamic real‐time ‘sliding sign’ technique. Long term recurrent attention‐based convolutional neural networks were developed for this video classification task. The trained neural networks would take a sequence of frames, and extract spatial‐temporal features hierarchically through multiple layers of information processing, and output scores for the whether the video is interpreted as negative or positive sliding sign.ResultsOur best performing model achieved an accuracy of 80.3%, sensitivity 78.7%, and specificity of 74.7% in hold‐one‐out cross‐validation for predicting POD obliteration.ConclusionsIn spite of the limited dataset, we have demonstrated the potential of using deep attention‐based neural networks for the preoperative prediction of POD obliteration from a number of ‘sliding‐sign’ studies. Further work is needed to improve and evaluate the models using larger datasets.

U2 - 10.1002/uog.21819

DO - 10.1002/uog.21819

M3 - Meeting abstract

VL - 54

SP - 448

EP - 448

JO - Ultrasound in Obstetrics and Gynecology

JF - Ultrasound in Obstetrics and Gynecology

SN - 0960-7692

IS - S1

M1 - EP34.29

T2 - 29th World Congress on Ultrasound in Obstetrics and Gynecology

Y2 - 12 October 2019 through 16 October 2019

ER -