基于多维特征的舰载机舰面作业识别

Carrier aircraft deck operation recognition based on multi-dimensional feature

  • 摘要:
    目的 针对舰载机舰面作业场景特殊、公开数据稀缺的问题,提出一种基于多维特征的舰载机舰面作业识别方法。
    方法 首先,精准选取航道边界和静态障碍物等关键点来表征环境信息,并通过图卷积网络构建动态个体与静态环境对象的交互关系,进而深度挖掘作业对象交互的潜在联系。然后,设计多尺度时空特征提取模块,引入扩张注意力机制,并通过设置不同的扩张率来关注全局和局部空间中的关键个体交互关系;同时,采用时序卷积网络(TCN)和注意力机制提取时间维度上的个体间交互特征,从而有效捕捉个体间长短序的动态关系。最后,将多尺度时空特征提取模块进行多次堆叠,以自适应提取多维度特征,从而提高舰载机舰面作业的识别准确率。
    结果 实验结果表明,在自建的不同视角异构个体的舰载机舰面作业识别数据集上,所提方法的准确率明显高于ARG,DIN,AT,GroupFormer等群体活动识别方法,实现了97.8%的识别精度。
    结论 研究成果可为舰载机舰面作业的高精度识别提供参考。

     

    Abstract:
    Objectives Aiming at the challenges of special scenarios and scarce public data in carrier aircraft deck operations, this study proposes a multi-dimensional feature-based recognition method for carrier aircraft deck operations.
    Methods Firstly, key points such as channel boundaries and static obstacles are accurately selected to represent the environmental information, and the interactions between dynamic individuals and static environmental objects are modelled by graph convolutional networks, to deeply explore the potential connections of operational object interactions. Then, a multi-scale spatio-temporal feature extraction module is designed to introduce the dilated attention mechanism, which focuses on the key individual interactions in global and local space by setting different dilation rates; at the same time, temporal sequential convolutional networks (TCN) and the attention mechanism are used to extract the interaction features between individuals in the temporal dimension, so as to efficiently capture the dynamic relationships between individuals in the long and short sequences. Finally, the multi-scale spatio-temporal feature extraction module is stacked multiple times to adaptively extract multi-dimensional feature, thereby improving the recognition accuracy of carrier aircraft deck operations.
    Results Experimental results show that, on a self-built dataset of heterogeneous object carrier aircraft deck operation recognition from different perspectives, the proposed method significantly outperforms group activity recognition methods such as ARG, DIN, AT, and GroupFormer in terms of accuracy, achieving a recognition precision of 97.8%.
    Conclusions This work can provide reference for high-precision recognition of carrier aircraft deck operations.

     

/

返回文章
返回