菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-21
📄 Abstract - AI-Enabled Image-Based Hybrid Vision/Force Control of Tendon-Driven Aerial Continuum Manipulators

This paper presents an AI-enabled cascaded hybrid vision/force control framework for tendon-driven aerial continuum manipulators based on constant-strain modeling in $SE(3)$ as a coupled system. The proposed controller is designed to enable autonomous, physical interaction with a static environment while stabilizing the image feature error. The developed strategy combines the cascaded fast fixed-time sliding mode control and a radial basis function neural network to cope with the uncertainties in the image acquired by the eye-in-hand monocular camera and the measurements from the force sensing apparatus. This ensures rapid, online learning of the vision- and force-related uncertainties without requiring offline training. Furthermore, the features are extracted via a state-of-the-art graph neural network architecture employed by a visual servoing framework using line features, rather than relying on heuristic geometric line extractors, to concurrently contribute to tracking the desired normal interaction force during contact and regulating the image feature error. A comparative study benchmarks the proposed controller against established rigid-arm aerial manipulation methods, evaluating robustness across diverse scenarios and feature extraction strategies. The simulation and experimental results showcase the effectiveness of the proposed methodology under various initial conditions and demonstrate robust performance in executing manipulation tasks.

顶级标签: robotics machine learning computer vision
详细标签: continuum manipulators hybrid vision/force control sliding mode control neural network visual servoing 或 搜索:

基于AI的图像混合视觉/力控制:肌腱驱动空中连续体机械臂 / AI-Enabled Image-Based Hybrid Vision/Force Control of Tendon-Driven Aerial Continuum Manipulators


1️⃣ 一句话总结

本文提出了一种结合人工智能的混合视觉与力控制框架,使带有柔性机械臂的飞行机器人能够自主与静态环境交互,通过神经网络在线学习图像和力传感器的不确定性,无需离线训练,并在接触任务中同时稳定视觉特征和期望接触力。

源自 arXiv: 2604.18961