Multimodal Generalized Zero-Shot Fault Diagnosis: A New Paradigm via Relation Graph-Guided Semantic Refinement
编号:164
访问权限:仅限参会人
更新:2026-10-19 18:04:13 浏览:19次
口头报告
摘要
Generalized zero-shot learning has shown great promise in fault diagnosis by enabling the simultaneous identification of known and un known faults using only known category data. However, existing methods remain constrained by two fundamental challenges: the information silo resulting from underutilized multimodal signals, and the semantic shift between static predefined prototypes and dynamic deep features. To overcome these bottlenecks, this paper establishes a novel diagnostic paradigm, multimodal generalized zero-shot fault diagnosis, and proposes a relation graph-guided semantic refinement framework. Specifically, a modal relation-induced fusion network models inter-sensor dependencies via a learnable graph structure to achieve effective multimodal fusion while preserving modality-specific characteristics. In addition, a multimodal semantic reconstruction and refinement mechanism is developed to resolve semantic shift. It reconstructs semantic prototypes using known multimodal features guided by mutual information, and subsequently performs dynamic alignment via optimal matching during inference to closely approximate the true distribution of unseen classes. Extensive experiments on rotating machinery experimental platform demonstrate that the proposed model significantly outperforms six state-of-the-art zero-shot and multimodal baseline methods.
关键词
Fault diagnosis; Graph neural network; Multimodal Learning; Open-set learning; Zero-shot learning
稿件作者
Lv Wang
Chongqing university
Yi Qin
Chongqing university
发表评论