IDEAS home Printed from https://ideas.repec.org/a/gvu/iroiip/v8y2026i2id2162.html

Self-Supervised Semantic Prior Generative Adversarial Network for Heritage Image Restoration

Author

Listed:
  • Suma N.
  • Kusuma Kumari B M.

Abstract

The heritage images are subjected to large and irregular missing regions due to long-term degradation. In order to repair the gaps, a filling process is used which creates visible seams. High computational expense and prolonged inference time are involved in diffusion and transformer models. A framework for restoration based on GAN is built to handle the irregular missing regions while preserving delicate brush strokes and structural lines with faster speed. The proposed framework makes use of the Adaptive Semantic Prior Injection (ASPI), Topology-Aware Semantic Refinement (TASR) and Entropy-Guided Self-Supervision (EGSS). ASPI contextualizes guidance while TASR provides line and edge continuity, and EGSS emphasizes uncertain regions during training. SSPL learns semantics from masked images with no labels and is used to aid the performance of irregular restoration. The Kaggle Damaged Paintings dataset is used to train the model with an image resolution of 256×256 for 50 epochs. Masked WikiArt images are utilized for self-supervised prior learning. The Indian Heritage Monuments pictures are validated for model performance. The model recorded a Peak Signal-to-Noise Ratio (PSNR) of 32.6 dB, a Structural Similarity Index Measure (SSIM) of 0.92, and a Fréchet Inception Distance (FID) of 18.7. According to the results, diffusion and transformer-based baselines are consistently outperformed. Addditionally, more texture continuity is gained when compared to exemplar based inpainting and Conditional GAN (cGAN) using partial convolution-based models. The ablation study shows that TASR mainly promotes structural fidelity while ASPI and EGSS provide additional benefits. The architecture remains efficient with 34.8 million parameters, 108.5 Giga Floating Point Operations (GFLOPs), and an inference time of 0.118 seconds per image Despite the improvements, the model remains unable to manage thin cracks and the edges of the restored region can hardly be seen. Additionally, significant omissions may not completely correspond to the original in the final restoration. Future studies will focus on training at greater resolutions and applying diffusion priors appropriately.

Suggested Citation

Handle: RePEc:gvu:iroiip:v:8:y:2026:i:2:id:2162
DOI: 10.36548/jiip.2026.2.001
as

Download full text from publisher

File URL: https://irojournals.com/iroiip/article/view/2162
File Function: Abstract page
Download Restriction: no

File URL: https://irojournals.com/iroiip/article/download/2162/1975
File Function: Full text
Download Restriction: no

File URL: https://libkey.io/10.36548/jiip.2026.2.001?utm_source=ideas
LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
---><---

More about this item

Keywords

;
;
;
;
;
;
;
;

Statistics

Access and download statistics

Corrections

All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gvu:iroiip:v:8:y:2026:i:2:id:2162. See general information about how to correct material in RePEc.

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

We have no bibliographic references for this item. You can help adding them by using this form .

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journal Manager (email available below). General contact details of provider: https://irojournals.com/iroiip .

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.