Diagnosing Knee Injuries from MRI with Transformer Based Deep Learning

Sezen G., Öksüz İ.

5th International Workshop on Predictive Intelligence in Medicine (PRIME MICCAI), Singapore, Singapore, 22 September 2022, vol.13564, pp.71-78 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 13564
  • Doi Number: 10.1007/978-3-031-16919-9_7
  • City: Singapore
  • Country: Singapore
  • Page Numbers: pp.71-78
  • Keywords: MRNet, Knee MRI, ACL, Abnormal, Meniscus
  • Istanbul Technical University Affiliated: Yes

Abstract

Magnetic Resonance Images (MRI) examinations are widely used for diagnosing injuries in the knee. Automatic interpretable detection of meniscus, Anterior Cruciate Ligament (ACL) tears, and general abnormalities from knee MRI is an essential task for automating the clinical diagnosis of knee MRI. This paper proposes a combination of convolution neural network and sequential network deep learning models for detecting general anomalies, ACL tears, and meniscal tears on knee MRI. We combine information from multiple MRI views with transformer blocks for final diagnosis. Also, we did an ablation study which is training with only CNN, and saw the impact of the transformer blocks on the learning. On average, we achieve a performance of 0.905 AUC for three injury cases on MRNet data.