Siamese Multi-View Masked Autoencoders for Skeleton-based Action Representation Learning
编号:30 访问权限:仅限参会人 更新:2024-10-23 11:32:49 浏览:206次 口头报告

报告开始:2024年11月02日 08:50(Asia/Shanghai)

报告时间:20min

所在会场:[P5] Parallel Session 5 [P5-2] Parallel Session 5(November 2 AM)

暂无文件

摘要
  In recent years, supervised skeleton-based action recognition has achieved notable results. However, these methods rely on labeled data, which is both resource-intensive and time-demanding to obtain. Self-supervised methods do not require data labels and has attracted considerable interest within the academic community. Masked Autoencoders are a self-supervised learning paradigm, and Siamese networks are a common structure in computer vision tasks. Combining these two approaches is natural. However, most existing research has applied these methods to image or video tasks, while relatively limited attention has been given to skeleton-based action recognition. Additionally, current methods tend to ignore differences in how the same action appears from different views, which limits the model's spatial representation capabilities. To address this, we introduce the Siamese Masked Autoencoders framework into skeleton-based action representation learning, named SiamMVMAE. To encourage the model to capture action features across various viewpoints, both the original skeleton sequences and rotation-augmented sequences are used as independent inputs for the Siamese networks. These inputs are then processed with a transformer encoder and decoder, enabling effective learning of action representations. Experiments on the NTU-RGB+D 60, NTU-RGB+D 120, and PKU-MMD benchmark datasets show that our method is highly competitive compared to existing approaches.
关键词
action recognition, masked autoencoders, self-supervised learning, Siamese networks
报告人
LiuRonggui
None Dongguan University of Technology

稿件作者
LiuRonggui Dongguan University of Technology
RenZiliang Dongguan University of Technology
WeiWenhong Dongguan University of Technology
ZhengZiyang Dongguan University of Technology
ZhangQieshi Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences
发表评论
验证码 看不清楚,更换一张
全部评论
重要日期
  • 会议日期

    10月31日

    2024

    11月03日

    2024

  • 09月30日 2024

    初稿截稿日期

  • 11月12日 2024

    注册截止日期

主办单位
Anhui University
Xi’an Jiaotong University
Harbin Institute of Technology
IEEE Instrumentation & Measurement Society
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询