A New and Efficient Approach to Cell Segmentation and Tumor Detection in Histopathological Images
Received: 17 November 2025 | Revised: 28 December 2025 | Accepted: 3 January 2026 | Online: 2 February 2026
Corresponding author: Layal Kazma
Abstract
Detecting and segmenting cells or tumors in histopathological images is a very challenging task. This study presents a novel technique for detecting tumors and segmenting cells in histopathological images. The EBHI-SEG dataset contains 5170 images of six types of tumor differentiation stages and the corresponding ground truth images. Normalization was applied using a specific target image. Then, the Gaussian blur technique was applied to reduce the noise in the original image. The Otsu's thresholding method was applied to obtain binary images, followed by morphological operations. The results obtained were evaluated using the Jaccard index, Intersection Over Union (IOU), Precision, Recall, F1-score, and Structural Similarity Index (SSIM), showing satisfactory results. A comparison with six other well-known methods showed that the proposed approach provides promising and sufficient results.
Keywords:
histopathological images, histology, image segmentation, tumor detection, biomedical image analysis, Otsu thresholding, Gaussian filter, morphological operationsDownloads
References
R. Gurumoorthy and M. Kamarasan, "Breast Cancer Classification from Histopathological Images using Future Search Optimization Algorithm and Deep Learning," Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 12831–12836, Feb. 2024. DOI: https://doi.org/10.48084/etasr.6720
Z. Chen et al., "Weakly Supervised Histopathology Image Segmentation With Sparse Point Annotations," IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 5, pp. 1673–1685, Feb. 2021. DOI: https://doi.org/10.1109/JBHI.2020.3024262
C. Sun et al., "Gastric histopathology image segmentation using a hierarchical conditional random field," Biocybernetics and Biomedical Engineering, vol. 40, no. 4, pp. 1535–1555, Oct. 2020. DOI: https://doi.org/10.1016/j.bbe.2020.09.008
P. Qin, J. Chen, J. Zeng, R. Chai, and L. Wang, "Large-scale tissue histopathology image segmentation based on feature pyramid," EURASIP Journal on Image and Video Processing, vol. 2018, no. 1, Aug. 2018, Art. no. 75. DOI: https://doi.org/10.1186/s13640-018-0320-8
L. Khrissi, N. El Akkad, H. Satori, and K. Satori, "Clustering method and sine cosine algorithm for image segmentation," Evolutionary Intelligence, vol. 15, no. 1, pp. 669–682, Mar. 2022. DOI: https://doi.org/10.1007/s12065-020-00544-z
A. Kanadath, J. A. A. Jothi, and S. Urolagin, "Histopathology Image Segmentation Using MobileNetV2 based U-net Model," in 2021 International Conference on Intelligent Technologies (CONIT), Hubli, India, June 2021, pp. 1–8. DOI: https://doi.org/10.1109/CONIT51480.2021.9498341
Y. Kurmi, V. Chaurasia, and N. Kapoor, "Design of a histopathology image segmentation algorithm for CAD of cancer," Optik, vol. 218, Sept. 2020, Art. no. 164636. DOI: https://doi.org/10.1016/j.ijleo.2020.164636
L. Khrissi, N. E. Akkad, H. Satori, and K. Satori, "An Efficient Image Clustering Technique based on Fuzzy C-means and Cuckoo Search Algorithm," International Journal of Advanced Computer Science and Applications, vol. 12, no. 6, pp. 423-432, 2021. DOI: https://doi.org/10.14569/IJACSA.2021.0120647
A. Ben Hamida et al., "Deep learning for colon cancer histopathological images analysis," Computers in Biology and Medicine, vol. 136, Sept. 2021, Art. no. 104730. DOI: https://doi.org/10.1016/j.compbiomed.2021.104730
S. Lal, D. Das, K. Alabhya, A. Kanfade, A. Kumar, and J. Kini, "NucleiSegNet: Robust deep learning architecture for the nuclei segmentation of liver cancer histopathology images," Computers in Biology and Medicine, vol. 128, Jan. 2021, Art. no. 104075. DOI: https://doi.org/10.1016/j.compbiomed.2020.104075
L. Khrissi, N. El Akkad, H. Satori, and K. Satori, "A Performant Clustering Approach Based on An Improved Sine Cosine Algorithm," International Journal of Computing, pp. 159–168, June 2022. DOI: https://doi.org/10.47839/ijc.21.2.2584
X. Li et al., "A comprehensive review of computer-aided whole-slide image analysis: from datasets to feature extraction, segmentation, classification and detection approaches," Artificial Intelligence Review, vol. 55, no. 6, pp. 4809–4878, Aug. 2022. DOI: https://doi.org/10.1007/s10462-021-10121-0
M. Salvi, U. R. Acharya, F. Molinari, and K. M. Meiburger, "The impact of pre- and post-image processing techniques on deep learning frameworks: A comprehensive review for digital pathology image analysis," Computers in Biology and Medicine, vol. 128, Jan. 2021, Art. no. 104129. DOI: https://doi.org/10.1016/j.compbiomed.2020.104129
H. Ziang, J. Zhang, and L. Li, "Framework for lung CT image segmentation based on UNet++." arXiv, Jan. 05, 2025.
N. Kumar et al., "A Multi-Organ Nucleus Segmentation Challenge," IEEE Transactions on Medical Imaging, vol. 39, no. 5, pp. 1380–1391, May 2020.
F. G. Zanjani, S. Zinger, B. E. Bejnordi, J. A. van der Laak, and P. H. N. de With, "Histopathology Stain-Color Normalization Using Deep Generative Models," presented at the Medical Imaging with Deep Learning, July 2022.
Md. Z. Hoque, A. Keskinarkaus, P. Nyberg, and T. Seppänen, "Retinex model based stain normalization technique for whole slide image analysis," Computerized Medical Imaging and Graphics, vol. 90, June 2021, Art. no. 101901. DOI: https://doi.org/10.1016/j.compmedimag.2021.101901
S. Vijh, M. Saraswat, and S. Kumar, "A new complete color normalization method for H&E stained histopatholgical images," Applied Intelligence, vol. 51, no. 11, pp. 7735–7748, Nov. 2021. DOI: https://doi.org/10.1007/s10489-021-02231-7
Z. Yildirim, E. Hancer, R. Samet, M. T. Mali, and N. Nemati, "Effect of Color Normalization on Nuclei Segmentation Problem in H&E Stained Histopathology Images," in 2022 30th Signal Processing and Communications Applications Conference (SIU), Safranbolu, Turkey, May 2022, pp. 1–4. DOI: https://doi.org/10.1109/SIU55565.2022.9864814
F. Pérez-Bueno et al., "Blind color deconvolution, normalization, and classification of histological images using general super Gaussian priors and Bayesian inference," Computer Methods and Programs in Biomedicine, vol. 211, Nov. 2021, Art. no. 106453. DOI: https://doi.org/10.1016/j.cmpb.2021.106453
I. Hirra et al., "Breast Cancer Classification From Histopathological Images Using Patch-Based Deep Learning Modeling," IEEE Access, vol. 9, pp. 24273–24287, 2021. DOI: https://doi.org/10.1109/ACCESS.2021.3056516
M. T. Nyo, F. Mebarek-Oudina, S. S. Hlaing, and N. A. Khan, "Otsu’s thresholding technique for MRI image brain tumor segmentation," Multimedia Tools and Applications, vol. 81, no. 30, pp. 43837–43849, Dec. 2022. DOI: https://doi.org/10.1007/s11042-022-13215-1
A. T. H. Al-Rahlawee and J. Rahebi, "Multilevel thresholding of images with improved Otsu thresholding by black widow optimization algorithm," Multimedia Tools and Applications, vol. 80, no. 18, pp. 28217–28243, July 2021. DOI: https://doi.org/10.1007/s11042-021-10860-w
J. Jose et al., "An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion," Biomedical Signal Processing and Control, vol. 66, Apr. 2021, Art. no. 102480. DOI: https://doi.org/10.1016/j.bspc.2021.102480
D. Müller, I. Soto-Rey, and F. Kramer, "Towards a guideline for evaluation metrics in medical image segmentation," BMC Research Notes, vol. 15, no. 1, June 2022, Art. no. 210. DOI: https://doi.org/10.1186/s13104-022-06096-y
H. Kim et al., "Deep learning-based histopathological segmentation for whole slide images of colorectal cancer in a compressed domain," Scientific Reports, vol. 11, no. 1, Nov. 2021, Art. no. 22520. DOI: https://doi.org/10.1038/s41598-021-01905-z
L. Hou et al., "Dataset of segmented nuclei in hematoxylin and eosin stained histopathology images of ten cancer types," Scientific Data, vol. 7, no. 1, June 2020, Art. no. 185. DOI: https://doi.org/10.1038/s41597-020-0528-1
S. Wazir and M. M. Fraz, "HistoSeg: Quick attention with multi-loss function for multi-structure segmentation in digital histology images," in 2022 12th International Conference on Pattern Recognition Systems (ICPRS), Saint-Etienne, France, June 2022, pp. 1–7. DOI: https://doi.org/10.1109/ICPRS54038.2022.9854067
L. Shi et al., "EBHI-Seg: A novel enteroscope biopsy histopathological hematoxylin and eosin image dataset for image segmentation tasks," Frontiers in Medicine, vol. 10, Jan. 2023. DOI: https://doi.org/10.3389/fmed.2023.1114673
Downloads
How to Cite
License
Copyright (c) 2026 Hanae Moussaoui, Nabil El Akkad, Mohamed Benslimane, Walid El-Shafai, Layal Kazma, Ahmad Taher Azar

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
