Improving realism in patient-specific abdominal ultrasound simulation using CycleGANs

VITALE, SANTIAGO; ORLANDO, JOSÉ IGNACIO; IARUSSI, EMMANUEL; LARRABIDE, IGNACIO

International Journal of Computer Assisted Radiology and Surgery

Springer

Año: 2019

1861-6410

PurposeIn this paper, we propose to apply generative adversarial neural networks trained with a cycle consistency loss, or CycleGANs, to improve realism in ultrasound (US) simulation from computed tomography (CT) scans.MethodsA ray-casting US simulation approach is used to generate intermediate synthetic images from abdominal CT scans. Then, an unpaired set of these synthetic and real US images is used to train CycleGANs with two alternative architectures for the generator, a U-Net and a ResNet. These networks are finally used to translate ray-casting based simulations into more realistic synthetic US images.ResultsOur approach was evaluated both qualitatively and quantitatively. A user study performed by 21 experts in US imaging shows that both networks significantly improve realism with respect to the original ray-casting algorithm ( 𝑝≪0.0001 ), with the ResNet model performing better than the U-Net ( 𝑝≪0.0001 ).ConclusionApplying CycleGANs allows to obtain better synthetic US images of the abdomen. These results can contribute to reduce the gap between artificially generated and real US scans, which might positively impact in applications such as semi-supervised training of machine learning algorithms and low-cost training of medical doctors and radiologists in US image interpretation.