基于RGB相机的无标志物TMS机器人辅助定位方法

    Markerless TMS Coil Robot-assisted Localization Method Based on RGB Camera

    • 摘要: 经颅磁刺激(transcranial magnetic stimulation, TMS)是一种神经调制方法,临床中凭借医生经验手动确定TMS线圈摆放位姿,导致线圈摆放位置和姿态不准确且重复定位精度差。针对上述问题,提出一种TMS线圈机器人辅助定位系统,使用RGB相机替代导航系统中双目红外相机,采用一种基于神经网络的无标志物TMS线圈机器人辅助定位方法。搭建神经网络实现相机空间线圈姿态到操作臂空间关节角度的映射,并通过仿真数据训练验证了该神经网络架构适用于TMS线圈位姿摆放问题。随后,通过实验验证了该方法的可行性,同时表明训练的神经网络针对TMS线圈定位任务具有良好的泛化能力。最后,在笛卡儿空间的位姿验证结果显示TMS线圈三维位置平均误差为2.16 mm,总体姿态误差为0.055 rad,使用RGB相机的TMS线圈机器人辅助定位系统在精度上达到了与其他使用双目红外相机的科研或商用系统相同的水平,满足TMS临床治疗要求,具备临床应用的可行性。

       

      Abstract: Transcranial magnetic stimulation (TMS) is a neuro-modulation method. In clinical practice, the placement and orientation of TMS coils are manually determined by doctors based on their experience, resulting in inaccurate coil positioning and poor repeatability. To address these issues, this paper proposed a TMS coil robot-assisted positioning system that utilized an RGB camera instead of dual infrared cameras in the navigation system. Additionally, a markerless TMS coil robot-assisted positioning method based on neural networks was introduced. A neural network was built to map the coil attitude of camera space to the joint angle of manipulator space and trained using simulation data to verify that the neural network architecture was suitable for TMS coil pose placement. Subsequently, experimental verification confirmed the feasibility of this method while demonstrating that the trained neural network had good generalization ability in the task of TMS coil localization. Finally, validation results in Cartesian space show an average position error of 2.16 mm for the TMS coil's three-dimensional location and an overall attitude error of 0.055 rad, indicating that the proposed TMS coil robot-assisted positioning system using RGB camera achieves similar accuracy levels as other research or commercial systems employing dual infrared cameras, meeting clinical requirements for TMS treatment and demonstrating its feasibility for clinical applications.

       

    /

    返回文章
    返回