Peritoneal Carcinomatosis Detection Based on Improved YOLOv8 With Attention Mechanism and Optimized Backbone Integration

Open

Naim Rochmawati, Chastine Fatichah, Bilqis Amaliah, Agus Budi Raharjo, Frederic Dumont, Emilie Thibaudeau, Cedric Dumas

2026 IEEE Access Vol. 14 Article Cited by 0 SDG 3SDG 17 Quartile

Abstract

Peritoneal Carcinomatosis (PC) represents a severe form of metastatic cancer, with lesions spreading across the peritoneum and often leading to a poor prognosis. Early detection of PC lesions is essential for timely treatment, yet identifying smaller lesions in medical images remains challenging due to their subtle appearance and varied sizes. Traditional detection techniques often fall short in this area, underscoring the need for more advanced solutions. This study introduces improvements to the YOLOv8 architecture aimed at enhancing the detection of small PC lesions in laparoscopic images. The proposed modifications include adding a Convolutional Block Attention Module (CBAM) to improve feature extraction, incorporating a P2 layer for better detection of small objects, and using a CIoU loss function for more effective training. CIoU demonstrated superior performance in our ablation study compared to DIoU, WIoU, GIoU, EIoU, and SIoU. Experimental results across Nano, Small, and Medium model scales demonstrated significant gains in Precision, Recall, mAP50, and F1 Score over the original YOLOv8. The modified model achieved a Precision of 0.887, Recall of 0.769, mAP50 of 0.861, and an F1 Score of 0.824. Ablation studies validated the benefits of each modification, with the enhanced model outperforming other YOLO versions (v5–v10) and transformer-based detectors such as RT-DETR, as well as alternative attention mechanisms including ECA and SA. These findings highlight the effectiveness of the proposed YOLOv8 modifications for detecting small lesions in medical imaging. © 2013 IEEE.

Affiliations

Institut Teknologi Sepuluh Nopember, Faculty of Intelligent Electrical and Informatics Technology, Department of Informatics, Surabaya, 60111, Indonesia; Universitas Negeri Surabaya, Faculty of Engineering, Department of Informatics, Surabaya, 60231, Indonesia; Institut de Cancérologie de l’Ouest, Saint-Herblain, 44800, France; Institut Mines-Télécom Atlantique, IMT Atlantique, Nantes, 44300, France

Research at a Glance

Premium content — register to unlock

Research at a Glance

Register to unlock

Topics & SDG Alignment

Premium content — register to unlock

Topics & SDG Alignment

Register to unlock

Collaboration

Premium content — register to unlock

Collaboration

Register to unlock

Author Profile (Selected)

Premium content — register to unlock

Author Profile (Selected)

Register to unlock

References Overview

Premium content — register to unlock

References Overview

Register to unlock

Journal & Source

Premium content — register to unlock

Journal & Source

Register to unlock

Metadata & Integrity

Premium content — register to unlock

Metadata & Integrity

Register to unlock