Download pdf
Denoising astronomical images using an enhanced Pix2Pix model
- 1 University of Minnesota Twin Cities
* Author to whom correspondence should be addressed.
Abstract
Astronomical images are frequently affected by sensor noise, which can negatively impact the accuracy of subsequent data analysis. To address this issue, this study proposes an enhanced Pix2Pix generative adversarial network model that incorporates Residual Blocks and Self-Attention mechanisms to improve denoising performance. The effectiveness of the proposed model is evaluated by comparing it with traditional denoising methods, standard Pix2Pix, Pix2Pix with Residual Blocks, and Pix2Pix with Self-Attention using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) metrics. The findings demonstrate that the Pix2Pix model, when combined with both Residual Blocks and Self-Attention, significantly outperforms other models in noise reduction and detail preservation. This improved approach offers a robust solution for high-quality processing of astronomical images, providing clearer and more reliable data for scientific analysis. The results highlight the potential of advanced deep learning techniques in overcoming the challenges posed by sensor noise in astronomical imaging.
Keywords
Astronomical Image Denoising, Pix2Pix, Residual Blocks, Self-Attention, Sensor Noise
[1]. Kastner, J. H. 1998. Imaging science in astronomy. Pattern Recognition, pp. 172-174.
[2]. Misra, D., Mishra, S., and Appasani, B. 2018. Advanced Image Processing for Astronomical Images. arXiv preprint arXiv:1812.09702. DOI: https://doi.org/10.48550/arXiv.1812.09702
[3]. Zhu, H.J., Han, B.C., and Qiu, B. 2015. Survey of Astronomical Image Processing Methods. In Zhang, Y.J. (ed) Image and Graphics. Lecture Notes in Computer Science, vol. 9219. Springer, Cham. DOI: https://doi.org/10.1007/978-3-319-21969-1_37
[4]. Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A. A. 2016. Image-to-Image Translation with Conditional Adversarial Networks. arXiv preprint arXiv:1611.07004. DOI: https://doi.org/10.48550/arXiv.1611.07004
[5]. Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. 2014. Generative Adversarial Networks. arXiv preprint arXiv:1406.2661. DOI: https://doi.org/10.48550/arXiv.1406.2661
[6]. He, K., Zhang, X., Ren, S., and Sun, J. 2015. Deep Residual Learning for Image Recognition. arXiv preprint arXiv:1512.03385. DOI: https://doi.org/10.48550/arXiv.1512.03385
[7]. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I. 2017. Attention Is All You Need. arXiv preprint arXiv:1706.03762. DOI: https://doi.org/10.48550/arXiv.1706.03762
[8]. Wang, X., Girshick, R., Gupta, A., and He, K. 2018. Non-local Neural Networks. arXiv preprint arXiv:1711.07971. DOI: https://doi.org/10.48550/arXiv.1711.07971
[9]. Gonzalez, R. C., and Woods, R. E. 2008. Digital Image Processing. 3rd ed. Prentice-Hall, Inc., Upper Saddle River, NJ, USA.
[10]. Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 4 (April 2004), 600-612. DOI: https://doi.org/10.1109/TIP.2003.819861
[11]. Singh, G., Mittal, A., and Aggarwal, N. 2020. ResDNN: Deep Residual Learning for Natural Image Denoising. IET Image Processing, 14, 11 (Sep. 2020), 2425–2434. DOI: https://doi.org/10.1049/iet-ipr.2019.0623
[12]. Li, M., Hsu, W., Xie, X., Cong, J., and Gao, W. 2020. SACNN: Self-Attention Convolutional Neural Network for Low-Dose CT Denoising With Self-Supervised Perceptual Loss Network. IEEE Transactions on Medical Imaging, 39, no. 7, pp. 2289-2301. DOI: 10.1109/TMI.2020.2968472
[13]. Zuo, Z., Chen, X., Xu, H., Li, J., Liao, W., Yang, Z-X., and Wang, S. 2022. IDEA-Net: Adaptive Dual Self-Attention Network for Single Image Denoising. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops, pp. 739-748.
[14]. Shen, L.-C., Liu, Y., Song, J., and Yu, D.-J. 2021. SAResNet: Self-Attention Residual Network for Predicting DNA-Protein Binding. Briefings in Bioinformatics, 22, Issue 5, September 2021, bbab101. DOI: https://doi.org/10.1093/bib/bbab101
[15]. Zhang, H., Lian, Q., Zhao, J., Wang, Y., Yang, Y., and Feng, S. 2022. RatUNet: Residual U-Net Based on Attention Mechanism for Image Denoising. PeerJ Computer Science, 8 DOI: https://doi.org/10.7717/peerj-cs.970
[16]. ESA Webb. ESA Official TIF Astronomical Images. Available at: https://esawebb.org/images/
[17]. Aladdin Persson. Machine Learning Collection. Available at: https://github.com/aladdinpersson/Machine-Learning-Collection
[18]. Gotmare, A., Keskar, N. S., Xiong, C., and Socher, R. 2018. A Closer Look at Deep Learning Heuristics: Learning Rate Restarts, Warmup and Distillation. arXiv preprint arXiv:1810.13243.
[19]. Zhang, J., He, T., Sra, S., and Jadbabaie, A. 2019. Why Gradient Clipping Accelerates Training: A Theoretical Justification for Adaptivity. arXiv preprint arXiv:1905.11881.
[20]. Daubechies, I., DeVore, R., Foucart, S., Hanin, B., and Petrova, G. 2022. Nonlinear Approximation and (Deep) ReLU Networks. Constructive Approximation, 55(1), pp. 127-172.
[21]. Xu, J., Li, Z., Du, B., Zhang, M., and Liu, J. 2020. Reluplex Made More Practical: Leaky ReLU. In 2020 IEEE Symposium on Computers and Communications (ISCC), pp. 1-7.
[22]. Xu, J., Sun, X., Zhang, Z., Zhao, G., and Lin, J. 2019. Understanding and Improving Layer Normalization. Advances in Neural Information Processing Systems, 32.
[23]. Nam, H., and Kim, H. E. 2018. Batch-Instance Normalization for Adaptively Style-Invariant Neural Networks. Advances in Neural Information Processing Systems, 31.
[24]. Apicella, A., Donnarumma, F., Isgrò, F., and Prevete, R. 2021. A Survey on Modern Trainable Activation Functions. Neural Networks, 138, pp. 14-32.
[25]. Kalman, B. L., and Kwasny, S. C. 1992. Why tanh: Choosing a Sigmoidal Function. In Proceedings 1992 IJCNN International Joint Conference on Neural Networks, Vol. 4, pp. 578-581.
Cite this article
Xu,M. (2024). Denoising astronomical images using an enhanced Pix2Pix model. Applied and Computational Engineering,88,253-260.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 6th International Conference on Computing and Data Science
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).