计算机集成制造系统 ›› 2023, Vol. 29 ›› Issue (3): 951-963.DOI: 10.13196/j.cims.2023.03.024

• • 上一篇    下一篇

基于数字孪生的遥操作机器人在线示教系统

陈成军1,丁旭彤1,潘勇1,张浩1,洪军2   

  1. 1.青岛理工大学机械与汽车工程学院
    2.西安交通大学机械工程学院
  • 出版日期:2023-03-31 发布日期:2023-04-19
  • 基金资助:
    国家自然科学基金资助项目(52175471)。

Online teaching system of teleoperation robot based on digital twin model

CHEN Chengjun1,DING Xutong1,PAN Yong1,ZHANG Hao1,HONG Jun2   

  1. 1.School of Mechanical and Automotive Engineering,Qingdao University of Technology
    2.School of Mechanical Engineering,Xi’an Jiaotong University
  • Online:2023-03-31 Published:2023-04-19
  • Supported by:
    Project supported by the National Natural Science Foundation,China(No.52175471).

摘要: 为提高遥操作机器人的示教编程效率和在线示教的安全性,提出了面向遥操作机器人在线示教的数字孪生框架,建立了机器人及其工作场景的虚拟模型,实现了物理实体到数字孪生模型的映射;设计并实现了基于RGB-D图像和姿态示教器的遥示教方式,通过鼠标和姿态示教器规划虚拟机器人末端执行器的路径和姿态,并利用增强现实技术,实现了虚实融合示教,提高了遥操作机器人在线示教的人机交互性;构建了机器人及其工作场景的八叉树模型,在机器人按照规划的路径和姿态运动时,可以预测机器人与工作场景之间的碰撞干涉;系统将未发生碰撞干涉的规划路径和姿态指令发送给物理机器人控制器控制物理机器人运动,从而实现基于数字孪生遥操作机器人在线示教功能,提高在线示教系统的安全性。

关键词: 遥操作机器人, 在线示教, 数字孪生, 增强现实, 人机交互, 碰撞检测

Abstract: To improve the teaching efficiency and safety of teleoperation robot,a digital twin framework for teleoperation robot was proposed.To map physical entity to the digital twin model,the virtual models of both robot and its working scene were established.A teleoperation method based on RGB-D image and posture teaching device was designed and implemented.In this method,the paths and postures of the virtual robot end-effector were controlled by mouse and posture teaching device.In addition,the Augmented Reality (AR) technology was used to combine the virtual modes with physical scene,and the AR-based teaching of teleoperation robot was realized.The octree models of the virtual robot and its working scene were also constructed to predict the collision interference between the virtual robot and the working scene.By collision detection technology,the system sent the planned paths and postures without collision interference to the physical robot controller to control the movement of the physical robot,so as to realize the robot online teaching of the teleoperation robot.

Key words: teleoperation robot, online teaching, digital twin, augmented reality, human-computer interaction, collision detection

中图分类号: