Diagnosing Knee Injuries from MRI with Transformer Based Deep Learning


Sezen G., Öksüz İ.

5th International Workshop on Predictive Intelligence in Medicine (PRIME MICCAI), Singapore, Singapur, 22 Eylül 2022, cilt.13564, ss.71-78 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 13564
  • Doi Numarası: 10.1007/978-3-031-16919-9_7
  • Basıldığı Şehir: Singapore
  • Basıldığı Ülke: Singapur
  • Sayfa Sayıları: ss.71-78
  • Anahtar Kelimeler: MRNet, Knee MRI, ACL, Abnormal, Meniscus
  • İstanbul Teknik Üniversitesi Adresli: Evet

Özet

Magnetic Resonance Images (MRI) examinations are widely used for diagnosing injuries in the knee. Automatic interpretable detection of meniscus, Anterior Cruciate Ligament (ACL) tears, and general abnormalities from knee MRI is an essential task for automating the clinical diagnosis of knee MRI. This paper proposes a combination of convolution neural network and sequential network deep learning models for detecting general anomalies, ACL tears, and meniscal tears on knee MRI. We combine information from multiple MRI views with transformer blocks for final diagnosis. Also, we did an ablation study which is training with only CNN, and saw the impact of the transformer blocks on the learning. On average, we achieve a performance of 0.905 AUC for three injury cases on MRNet data.