IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v8y2020i12p2258-d465812.html
   My bibliography  Save this article

Auto-Colorization of Historical Images Using Deep Convolutional Neural Networks

Author

Listed:
  • Madhab Raj Joshi

    (Department of IT, Kathmandu Regional Office, Nepal Telecom, Kathmandu 44600, Nepal)

  • Lewis Nkenyereye

    (Department of Computer & Information Security, Sejong University, Seoul 05006, Korea)

  • Gyanendra Prasad Joshi

    (Department of Computer Science and Engineering, Sejong University, Seool 05006, Korea)

  • S. M. Riazul Islam

    (Department of Computer Science and Engineering, Sejong University, Seool 05006, Korea)

  • Mohammad Abdullah-Al-Wadud

    (Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia)

  • Surendra Shrestha

    (Department of Electronics & Computer Engineering, Pulchowk Campus, Institute of Engineering, Tribhuvan University, Lalitpur 44700, Nepal)

Abstract

Enhancement of Cultural Heritage such as historical images is very crucial to safeguard the diversity of cultures. Automated colorization of black and white images has been subject to extensive research through computer vision and machine learning techniques. Our research addresses the problem of generating a plausible colored photograph of ancient, historically black, and white images of Nepal using deep learning techniques without direct human intervention. Motivated by the recent success of deep learning techniques in image processing, a feed-forward, deep Convolutional Neural Network (CNN) in combination with Inception- ResnetV2 is being trained by sets of sample images using back-propagation to recognize the pattern in RGB and grayscale values. The trained neural network is then used to predict two a* and b* chroma channels given grayscale, L channel of test images. CNN vividly colorizes images with the help of the fusion layer accounting for local features as well as global features. Two objective functions, namely, Mean Squared Error (MSE) and Peak Signal-to-Noise Ratio (PSNR), are employed for objective quality assessment between the estimated color image and its ground truth. The model is trained on the dataset created by ourselves with 1.2 K historical images comprised of old and ancient photographs of Nepal, each having 256 × 256 resolution. The loss i.e., MSE, PSNR, and accuracy of the model are found to be 6.08%, 34.65 dB, and 75.23%, respectively. Other than presenting the training results, the public acceptance or subjective validation of the generated images is assessed by means of a user study where the model shows 41.71% of naturalness while evaluating colorization results.

Suggested Citation

  • Madhab Raj Joshi & Lewis Nkenyereye & Gyanendra Prasad Joshi & S. M. Riazul Islam & Mohammad Abdullah-Al-Wadud & Surendra Shrestha, 2020. "Auto-Colorization of Historical Images Using Deep Convolutional Neural Networks," Mathematics, MDPI, vol. 8(12), pages 1-17, December.
  • Handle: RePEc:gam:jmathe:v:8:y:2020:i:12:p:2258-:d:465812
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/8/12/2258/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/8/12/2258/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:8:y:2020:i:12:p:2258-:d:465812. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.