改进CycleGAN的钢材表面缺陷图像生成方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

河北省重点研发计划项目(22311802D);河北省硕士在读研究生创新能力培养资助项目(CXZZSS2023095);石家庄市科技计划项目(226080477A)


Image generation method for steel surface defects on improved CycleGAN
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对工业钢材表面缺陷检测过程中存在的样本采集困难、成本较高,以及缺陷种类较多难以覆盖全部导致的小样本问题,提出一种改进循环生成对抗网络(cycle-consistent generative adversarial networks, CycleGAN)的钢材表面缺陷图像生成方法。首先,将通道注意力(class activation map, CAM)和空间注意力(spatial attention map, SAM)机制嵌入到CycleGAN模型中,增强模型的特征提取能力;其次,引入权重解调(weight demodulation, WD)机制修复特征伪影和白斑,进一步提高生成图像的质量;再次,引入形状一致性损失对生成器训练过程进行监督,解决图像几何变换过程中内在模糊性问题;最后,将改进前后的模型在NEU-DET数据集上进行试验。结果表明,改进后的模型在缺陷图像生成的效果上更具多样性和准确性,PSNR,SSIM分别提高了13.0%和7.8%,FID值降低了33.1%。该方法能够稳定地生成高质量的各类钢材表面缺陷图像,可以达到增加训练数据的目的,对于其他缺陷数据集的扩增具有参考价值。

    Abstract:

    Aiming at the difficulty of sample collection, high cost, and small sample problems caused by many types of defects and difficulty in covering all small samples in the process of industrial steel surface defect detection, a steel surface defect image generation method improved by cycle-consistent generation adversarial network (CycleGAN) was proposed. Firstly, channel attention map (CAM) and spatial attention map (SAM) were embedded in the CycleGAN model to enhance the feature extraction ability of the model. Secondly, the Weight Demodulation (WD) mechanism was introduced to fix feature artifacts and white spots, further improving the quality of the generated images. Thirdly, shape consistency loss was introduced to supervise the generator training process to solve the problem of inherent ambiguity in the process of image geometric transformation. Finally,the model before and after the improvement were experimented on the NEU-DET dataset. The results show that the improved model has more diversity and accuracy in the effect of defect image generation. PSNR and SSIM increase by [DK(]13.0%[DK)] and [DK(]7.8%[DK)] respectively, and FID values are reduced by [DK(]33.1%[DK)]. This method can stably generate high-quality images of various steel surface defects, which can achieve the purpose of increasing training data, and also has reference value for the amplification of other defect datasets.

    参考文献
    相似文献
    引证文献
引用本文

张付祥,徐兆洋,李俊慧,黄风山,李文忠.改进CycleGAN的钢材表面缺陷图像生成方法[J].河北科技大学学报,2023,44(6):571-579

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-07-18
  • 最后修改日期:2023-11-01
  • 录用日期:
  • 在线发布日期: 2023-12-30
  • 出版日期:
文章二维码