Research Article

Novel GAN-Based Image Completion: Addressing Structure and Texture Consistency in Missing Regions

Authors

  • Seyyed Ahmad Edalatpanah * Department of Applied Mathematics, Ayandegan Institute of Higher Education, Tonekabon, Iran.
  • Dragan Marinkovic Faculty of Mechanical Engineering and Transport Systems, TU Berlin, Germany.
  • Zeynab Parandavar Department of Computer Engineering, Ayandegan Institute of Higher Education, Tonekabon, Iran

https://doi.org/10.48314/ceti.v1i1.20

Abstract

The use of Deep Neural Networks (DNNs) to solve Image Completion (IC) has emerged as a popular research topic, as this study demonstrates. Completion algorithms must handle structure and texture properly in order to generate realistic results because they are two essential components of images. To fix an image, several modern techniques employ the end-to-end framework, which ignores texture and structure in particular. From the outcomes, deformed structures and uneven textures are frequently obtained. The sketch completion network and a texture completion network are contained in a novel IC method is suggested. The objective of Generative Adversarial Network (GAN) is to restore the sketch structures in the missed portion of an image. By representing the two components separately in a DNN, the proposed approach not only successfully synthesizes semantically valid and visually reliable data in the missing region but also allows a user to change the structure characteristics in that region dynamically. Graph Neural Network (GNN) creates consistent texture data in the missing area with the sketch output and the surrounding partial image.   

Keywords

Image completion Deep learning Generative adversarial networks Texture synthesis Structure reconstruction Convolutional neural networks
References (34)
  1. [1] Alkobi, N., Shaham, T. R., & Michaeli, T. (2023). Internal diverse image completion. Proceedings of the

  2. [2] IEEE/CVF conference on computer vision and pattern recognition (pp. 648–658). IEEE. https://doi.org/10.1109/CVPRW59228.2023.00072

  3. [3] Chen, Q., Li, G., Xiao, Q., Xie, L., & Xiao, M. (2020). Image completion via transformation and structural constraints. EURASIP journal on image and video processing, 2020(44), 1–18. https://doi.org/10.1186/s13640-020-00533-3

  4. [4] Peng, X., Zhao, H., Wang, X., Zhang, Y., Li, Z., Zhang, Q., Wang, G., Peng, G., & Liang, H. (2023). C3N: content-constrained convolutional network for mural image completion. Neural computing and applications, 35(2), 1959–1970. https://doi.org/10.1007/s00521-022-07806-0

  5. [5] Wan, Z., Zhang, J., Chen, D., & Liao, J. (2021). High-fidelity pluralistic image completion with transformers. Proceedings of the IEEE/CVF international conference on computer vision (pp. 4692–4701). IEEE. https://doi.org/10.1109/ICCV48922.2021.00465

Article Metrics

How to Cite

Edalatpanah, S. A. ., Marinkovic, D. ., & Parandavar, Z. . (2024). Novel GAN-Based Image Completion: Addressing Structure and Texture Consistency in Missing Regions. Computational Engineering and Technology Innovations, 1(1), 1-10. https://doi.org/10.48314/ceti.v1i1.20

Similar Articles

1-10 of 65

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)