融合结构与纹理特征的破损壁画缺陷修复
DOI:
作者:
作者单位:

1.中北大学;2.信息探测与处理山西省重点实验室

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

国家重点研发计划“制造基础技术关键部位”重点专项:子课题“曲面基底高温薄膜传感器研究”(2020YFB2009102)项目资助;信息探测与处理山西省重点实验室开放研究资助


Defect repair of damaged murals guided by fusion structure and features
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对现有算法在修复花纹复杂的壁画时存在结构混乱和纹理模糊等缺陷,提出一种融合结构与纹理特征引导的双重生成对抗网络模型。首先将U-Net引入双重生成网络,利用方向和通道双注意力机制提取到的纹理和结构信息分别引导结构、纹理解码器完成对结构与纹理的特征重构,并结合空洞残差块与跳跃连接实现多尺度特征融合提取。其次将两个分支输出的特征图通过双门控特征融合模块深度融合,完成特征信息交互。最后通过联合判别器对抗完成修复。实验以五台山某处非国宝级真实破损壁画作为对象,结果表明在多个方面均超过了对比方法,且视觉效果更清晰自然。

    Abstract:

    Aiming at the defects of existing algorithms such as structural confusion and texture blurring in repairing complex murals, a dual-generation adversarial network model incorporating structural and textural feature guidance is proposed. Firstly, U-Net is introduced into the dual-generation network, and the texture and structure information extracted by using the direction and channel dual-attention mechanism guides the structure and texture decoders to complete the feature reconstruction of structure and texture respectively, and combines the void residual block and jump connection to achieve multi-scale feature fusion extraction. Secondly, the feature maps output from the two branches are deeply fused by the dual gated feature fusion module to complete the feature information interaction. Finally the restoration is completed through the joint discriminator confrontation. The experiment takes a non-national treasure real broken mural somewhere in Wutai Mountain as the object, and the results show that it exceeds the comparison method in several aspects, and the visual effect is clearer and more natural.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-05-09
  • 最后修改日期:2024-07-24
  • 录用日期:2024-07-24
  • 在线发布日期:
  • 出版日期: