阮晓钢, 周晨, 黄静. 室内动态场景下基于目标检测算法的语义视觉SLAM[J]. 北京工业大学学报, 2023, 49(8): 842-850. DOI: 10.11936/bjutxb2021090025
    引用本文: 阮晓钢, 周晨, 黄静. 室内动态场景下基于目标检测算法的语义视觉SLAM[J]. 北京工业大学学报, 2023, 49(8): 842-850. DOI: 10.11936/bjutxb2021090025
    RUAN Xiaogang, ZHOU Chen, HUANG Jing. Semantic Visual SLAM Based on Target Detection Algorithm in Indoor Dynamic Scenes[J]. Journal of Beijing University of Technology, 2023, 49(8): 842-850. DOI: 10.11936/bjutxb2021090025
    Citation: RUAN Xiaogang, ZHOU Chen, HUANG Jing. Semantic Visual SLAM Based on Target Detection Algorithm in Indoor Dynamic Scenes[J]. Journal of Beijing University of Technology, 2023, 49(8): 842-850. DOI: 10.11936/bjutxb2021090025

    室内动态场景下基于目标检测算法的语义视觉SLAM

    Semantic Visual SLAM Based on Target Detection Algorithm in Indoor Dynamic Scenes

    • 摘要: 为了解决基于静态环境假设的同步定位与地图构建(simultaneous localization and mapping,SLAM)在处理动态物体时系统定位精度降低、鲁棒性变差的问题,提出一种面向室内动态环境的语义视觉SLAM系统。该系统以ORB_SLAM2为基础,添加了动态目标检测线程。对输入图像提取ORB特征的同时,通过使用YOLOv5s网络进行动态目标检测,并结合光流法和对极几何约束方法,共同筛选动态特征点,最后,使用静态特征点进行位姿估计。通过使用慕尼黑工业大学(Technical University of Munich,TUM)数据集将该系统和ORB_SLAM2进行比较,结果表明,该系统显著降低了轨迹误差。与DS-SLAM、DynaSLAM等动态环境下的系统相比,该系统可有效平衡语义视觉SLAM系统位姿估计的准确性、鲁棒性和快速性。

       

      Abstract: To solve the problem of decreased positioning accuracy and poor robustness of simultaneous localization and mapping (SLAM) systems based on static environment assumptions when processing dynamic objects, a semantic vision SLAM system for indoor dynamic environments was proposed, which was based on ORB_SLAM2, and added with a dynamic target detection thread. While extracting ORB features from the input image, YOLOv5s network was used for dynamic target detection, combining optical flow method and epipolar geometric constraints to screen dynamic feature points, and finally static feature points were used for pose estimation. Using the data set of Technical University of Munich (TUM) to compare with ORB_SLAM2, results show that the system significantly reduces the trajectory error. Compared with the system in the dynamic environment such as DS-SLAM and DynaSLAM, this system can effectively balance the accuracy, robustness and rapidity of the pose estimation of the semantic visual SLAM system.

       

    /

    返回文章
    返回