The New Dataset MITWPU-1K for Object Recognition and Image Captioning Tasks

Authors

Volume: 12 | Issue: 4 | Pages: 8803-8808 | August 2022 | https://doi.org/10.48084/etasr.5039

Abstract

In the domain of image captioning, many pre-trained datasets are available. Using these datasets, models can be trained to automatically generate image descriptions regarding the contents of an image. Researchers usually do not spend much time in creating and training the new dataset before using it for a specific application, instead, they simply use existing pre-trained datasets. MS COCO, ImageNet, Flicker, and Pascal VOC, are well-known datasets that are widely used in the task of generating image captions. In most available image captioning datasets, image textual information, which can play a vital role in generating more precise image descriptions, is missing. This paper presents the process of creating a new dataset that consists of images along with text and captions. Images of the nearby vicinity of the campus of MIT World Peace University-MITWPU, India, were taken for the new dataset named MITWPU-1K. This dataset can be used in object detection and caption generation of images. The objective of this paper is to highlight the steps required for creating a new dataset. This necessitated a review of the existing dataset models prior to creating the new dataset. A sequential convolutional model for detecting objects on a new dataset is also presented. The process of creating a new image captioning dataset and the gained insights are described.

Keywords:

convolutional model, dataset, image captioning, image labelling, object detection

Downloads

Download data is not yet available.

References

T.-Y. Lin et al., "Microsoft COCO: Common Objects in Context," in Computer Vision – ECCV 2014, 2014, pp. 740–755. DOI: https://doi.org/10.1007/978-3-319-10602-1_48

M. Everingham, S. M. A. Eslami, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The Pascal Visual Object Classes Challenge: A Retrospective," International Journal of Computer Vision, vol. 111, no. 1, pp. 98–136, Jan. 2015. DOI: https://doi.org/10.1007/s11263-014-0733-5

J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database," in 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, Jun. 2009, pp. 248–255. DOI: https://doi.org/10.1109/CVPR.2009.5206848

R. Doon, T. Kumar Rawat, and S. Gautam, "Cifar-10 Classification using Deep Convolutional Neural Network," in 2018 IEEE Punecon, Pune, India, Aug. 2018. DOI: https://doi.org/10.1109/PUNECON.2018.8745428

J. Redmon and A. Farhadi, "YOLO9000: Better, Faster, Stronger," in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, Jul. 2017, pp. 6517–6525. DOI: https://doi.org/10.1109/CVPR.2017.690

Y. Jia et al., "Caffe: Convolutional Architecture for Fast Feature Embedding," in MM ’14: Proceedings of the 22nd ACM international conference on Multimedia, New York, NY, USA, Aug. 2014, pp. 675–678. DOI: https://doi.org/10.1145/2647868.2654889

V. Sharma and R. N. Mir, "A comprehensive and systematic look up into deep learning based object detection techniques: A review," Computer Science Review, vol. 38, Nov. 2020, Art. no. 100301. DOI: https://doi.org/10.1016/j.cosrev.2020.100301

M. D. Z. Hossain, F. Sohel, M. F. Shiratuddin, and H. Laga, "A Comprehensive Survey of Deep Learning for Image Captioning," ACM Computing Surveys, vol. 51, no. 6, pp. 118:1-118:36, Oct. 2019. DOI: https://doi.org/10.1145/3295748

G. Tanner, "Creating your own object detector," Towards Data Science, Feb. 06, 2019. https://towardsdatascience.com/creating-your-own-object-detector-ad69dda69c85.

M. Bhalekar and M. Bedekar, "D-CNN: A New model for Generating Image Captions with Text Extraction Using Deep Learning for Visually Challenged Individuals," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8366–8373, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4772

B. Ahmed, G. Ali, A. Hussain, A. Baseer, and J. Ahmed, "Analysis of Text Feature Extractors using Deep Learning on Fake News," Engineering, Technology & Applied Science Research, vol. 11, no. 2, pp. 7001–7005, Apr. 2021. DOI: https://doi.org/10.48084/etasr.4069

S. Nuanmeesri, "A Hybrid Deep Learning and Optimized Machine Learning Approach for Rose Leaf Disease Classification," Engineering, Technology & Applied Science Research, vol. 11, no. 5, pp. 7678–7683, Oct. 2021. DOI: https://doi.org/10.48084/etasr.4455

Downloads

How to Cite

[1]
M. Bhalekar and M. Bedekar, “The New Dataset MITWPU-1K for Object Recognition and Image Captioning Tasks”, Eng. Technol. Appl. Sci. Res., vol. 12, no. 4, pp. 8803–8808, Aug. 2022.

Metrics

Abstract Views: 241
PDF Downloads: 126

Metrics Information
Bookmark and Share

Most read articles by the same author(s)