基于改进CycleGAN的花粉灰度图像着色方法

    Pollen Gray-scale Image Colorizing Method Based on Improved CycleGAN

    • 摘要: 针对生成式对抗网络对灰度图像着色时出现的颜色溢出和着色图像细节不足等问题, 提出一种基于循环一致生成对抗网络(cycle-consistent generative adversarial networks, CycleGAN)的花粉灰度图像着色方法。该方法从无监督学习的角度出发, 采用CycleGAN对图像进行着色。为解决花粉灰度图像着色中的着色不连续和着色图像不细腻等问题, 引入非局部模块, 以便有效获取图像的全局信息表征。此外, 还引入自注意力机制, 以此帮助网络更准确地判断像素点之间的空间位置关系, 进而增强着色模型的学习能力。实验结果表明, 该方法获得的峰值信噪比、结构相似性指数和平均主观意见分分别为28.673、0.956、4.567, 在测试集上生成的彩色图像质量更好。该方法不仅有效地解决了颜色溢出和着色不连续等问题, 还丰富了图像的细节信息。

       

      Abstract: To solve the problems of color overflow and insufficient detail preservatio in gray-scale image coloring using generative adversarial network, a pollen gray-scale image coloring method based on the cycle-consistent generative adversarial networks (CycleGAN) is proposed in this paper. This method colors grayscale images using CycleGAN from the perspective of unsupervised learning. To solve the problems of discontinuous coloring and non delicate coloring in pollen gray-scale images, non-local modules were introduced to effectively obtain global information representation of the image. In addition, a self-attentive mechanism was introduced to help the network more accurately determine the spatial position relationship between pixels, thereby enhancing the learning ability of the coloring model. Experiment results show that the peak signal-to-noise ratio, structural similarity, and mean opinion score obtained by this method are 28.673, 0.956, and 4.567, respectively. The proposed gray-scale coloring method produces better color image quality on the test image set. This method not only effectively solves the problems of color overflow and discontinuous coloring, but also enriches the image details.

       

    /

    返回文章
    返回