FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors
<|reference_start|>FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors: In this paper, we tackle the problem of estimating 3D contact forces using vision-based tactile sensors. In particular, our goal is to estimate contact forces over a large range (up to 15 N) on any objects while generalizing across different vision-based tactile sensors. Thus, we collected a dataset of over 200K indentations using a robotic arm that pressed various indenters onto a GelSight Mini sensor mounted on a force sensor and then used the data to train a multi-head transformer for force regression. Strong generalization is achieved via accurate data collection and multi-objective optimization that leverages depth contact images. Despite being trained only on primitive shapes and textures, the regressor achieves a mean absolute error of 4\% on a dataset of unseen real-world objects. We further evaluate our approach's generalization capability to other GelSight mini and DIGIT sensors, and propose a reproducible calibration procedure for adapting the pre-trained model to other vision-based sensors. Furthermore, the method was evaluated on real-world tasks, including weighing objects and controlling the deformation of delicate objects, which relies on accurate force feedback. Project webpage: http://prg.cs.umd.edu/FeelAnyForce<|reference_end|>
@article{shahidzadeh2024feelanyforce:,
    title={FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation
  for Vision-Based Tactile Sensors},
    author={Amir-Hossein Shahidzadeh, Gabriele Caddeo, Koushik Alapati, Lorenzo
  Natale, Cornelia Ferm"uller, Yiannis Aloimonos},
    journal={arXiv preprint arXiv:2410.02048},
    year={2024},
    archivePrefix={arXiv},
    eprint={2410.02048},
    primaryClass={cs.RO cs.CV}
}