Faculty Publications

Now showing 1 - 3 of 3

A self-attention driven retinex-based deep image prior model for satellite image restoration
(Elsevier Ltd, 2024) Shastry, A.; Padikkal, J.; George, S.; Bini, A.A.
A self attention driven Deep Image Prior (DIP) framework has been proposed in this work for restoring satellite images corrupted by speckled interference and contrast deficiency. The retinex-based framework incorporated here-in leverages the benefits of DIP approach for image restoration, thus requiring only a single input image, eliminating the need for ground truth or training data. An attention framework is incorporated into the architecture of DIP networks to effectively capture fine textures, enhancing the restoration capability of the model. Two generative networks are employed to obtain the luminance and reflectance maps, with the model's loss functions specifically designed to tackle speckle interference and contrast distortions present in the input. These generated maps eventually reconstruct the enhanced version of the image. Satellite images from different sensors are used to demonstrate and compare the performance of the model. Various state-of-the-art models are evaluated and compared with the proposed strategy using different image quality metrics and statistical tests. The experimental results, incorporating both visual and statistical inferences, demonstrate the superiority and efficiency of the model. Additionally, an ablation analysis is performed to determine optimal regularization parameters, and the significance of integrating attention modules at different architecture layers is also demonstrated. © 2023 Elsevier Ltd
A weighted nuclear norm (WNN)-based retinex DIP framework for restoring aerial and satellite images corrupted by gamma distributed speckle noise
(Springer, 2024) Shastry, A.; Padikkal, J.; George, S.; Bini, A.A.
Restoration and enhancement are crucial preprocessing steps in the satellite domain. Mainly in active remote sensing such as Synthetic Aperture Radar (SAR), the images are more prone to speckle distortions and their reduction is not so trivial. Traditional deep learning models require large training datasets, limiting their applicability. This paper introduces a novel approach that combines the Deep Image Prior (DIP) model with a weighted nuclear norm (WNN) within a variational retinex framework to address these challenges. DIP leverages prior knowledge about noise distribution and works effectively with a single noisy image, eliminating the need for a large number of training images or ground truth. The WNN assigns non-negative weights to singular values, capturing the significance of each value and preserving crucial information during restoration. This approach offers a promising solution for satellite image restoration without relying on huge training data. The proposed method is evaluated through extensive experiments using various image quality metrics, including PSNR, SSIM, ENL, CNR, Entropy, and GCF. The comparative studies provide compelling evidence that the proposed method surpasses existing techniques in effectively restoring and enhancing speckled input images. Furthermore, statistical analysis performed using the Friedman test demonstrates the superior denoising performance of the model. Additionally, an ablation study is conducted to empirically determine the optimal regularization parameters, ensuring the optimal performance of the model. However, the theoretical selection of parameters for achieving optimal results remains an area that requires further exploration. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023.
A retinex inspired deep image prior model for despeckling and deblurring of aerial and satellite images using proximal gradient method
(Taylor and Francis Ltd., 2025) Shastry, A.; Bini, A.A.; Padikkal, J.
Unsupervised learning models, particularly in the remote sensing domain, have gained significant attention in recent years. Various degradations in the satellite images, primarily occurring during acquisition, pose a substantial hurdle in obtaining reliable ground truth and extensive training data. The Deep Image Prior model (DIP) addresses these issues by performing restoration tasks using a single image, relying on the implicit regularization inherent in the network architecture. In this paper, we propose a novel approach, integrating the DIP model within the retinex framework to restore aerial and satellite images from the Gamma distributed speckles and linear shift-invariant Gaussian blur along with contrast enhancement using the alternating proximal gradient descent ascent (PGDA) method. Our proposed methodology combines implicit regularization with explicit total variational (TV) regularization, incorporating automated estimation of local regularization parameters. The data-fidelity component in the optimization function is formulated using the Bayesian Maximum A posteriori (MAP) estimate, assuming the speckles follow the Gamma distribution. Demonstration of despeckling and deblurring alone and in addition as a combined task is carried out on aerial and Synthetic Aperture Radar (SAR) images with different resolutions and polarization from various sources. Results obtained are compared with various state-of-the-art despeckling and deblurring models using distinct image quality metrics such as Equivalent Number of Looks (ENL), Contrast to Noise Ratio (CNR), Edge Preserving Index (EPI), Entropy, Global Contrast Factor (GCF), Natural Image Quality Evaluator (NIQE), Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE) and Bradley-Terry (B-T) score based on the various factors. The quality of restored images depicted superior performance of the proposed method over the existing models under study. © 2024 Informa UK Limited, trading as Taylor & Francis Group.

Faculty Publications

Browse

Filters

Settings

Sort By

Results per page

Search Results