Active haptic exploration and manipulation
ESR14
Objectives
In this project the ESR will develop the haptic exploration strategies to maximize information on the environment using a robotics. For instance, movements along an edge will likely be favored as an edge provides more change in tactile information than a surface. To determine the haptic exploration, the various next moves will be encoded in a Marko chain related by the expected information gain, which can be compared to the chain of haptic by blinded humans exploring the same environment. Various criteria will be set for the robot, only some of which corresponding to the human behavior. Importantly, the exploration will for the first time also incorporate mechanical impedance and interaction force.
Expected Results
Human-like algorithms and implementation of haptic exploration for robots.
Placement
Host institution: Bayerische Motoren Werke Aktiengesellschaft
Enrolments (in Doctoral degree): Imperial Collage of Science, Technology & Medicine
Supervisors
Mohsen Kaboli, Etienne Burdet
Presentation of ESR14
PhD defense: Tentative period April 2025
Hello, I am Anirvan Dutta from India. I completed my bachelor’s studies in Electronics and Communications from Birla Institute of Technology, Mesra, India and master’s studies in Systems, Control and Robotics at KTH Royal Institute, Stockholm, Sweden.
My long term career objective is to pursue a research-oriented profession. I am highly passionate to learn about new technologies and excelling in innovative applications. I am interested in the field of “versatile and robust manipulation strategies for robotics”. I have a good grasp of fundamentals in motion planning, control and machine learning.
Through the INTUITIVE project, I wish to understand and get inspired by human multimodal visio-tactile perception and how they use it to explore and manipulate objects in unstructured environments. I aim to apply a similar visio-tactile exploration strategy in robotic manipulation and make some viable contribution in the domain.
Abstract of PhD goals
Robotic manipulators are increasingly utilized in unstructured and novel environments. To interact with objects in the environment, it becomes critical to know their properties such as geometry, mass, surface friction coefficient, stiffness etc. Acquiring knowledge about these properties of novel objects could help in manipulating them stably and accurately, as well as predict the effects of various manipulation actions in advance. Perception of objects’ properties from visual and haptic sensing is a challenging problem, as these properties must be inferred indirectly from raw visual and tactile sensory information. In addition, often each property is only revealed under specific interactions, making it an interactive perception problem. To approach such a challenging problem, my research work takes inspiration from the human cognitive process involving interactive perception and active inference. A novel ‘predictive coding’ framework is developed under the scheme of Bayesian Inference. The key aspect of the framework is encoding interactions as the Probabilistic Markov Model along with learning schemes to learn the interaction model. Two key frameworks are developed – Active Differentiable Filter and Active Latent Filter to address the inference problem of diverse object properties like mass, center of mass, friction (characteristic) as well as texture, and softness (non-characteristic). Using the proposed approach, the robotic system I have set up can autonomously explore objects using raw and complementary vision and tactile information. The developed framework provides a step towards developing generalizable robotic manipulation skills and will be crucial to performing downstream robotic manipulation tasks efficiently.
Results
D5.4 Human-like haptic exploration and manipulation
Comparison of robotic and human manipulation and haptic exploration
Journal Article – Upcoming
Dutta, A.; Burdet, E.; Kaboli, M.
A predictive visuo-tactile interactive perception framework for active exploration of object properties
Conference Article – Upcoming
Dutta, A.; Burdet, E.; Kaboli, M.
Active visuo-tactile shared perception for object shape estimation
Conference Article
Dutta, A.; Burdet, E.; Kaboli, M.
Push to Know! – Visuo-Tactile Based Active Object Parameter Inference with Dual Differentiable Filtering
IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, 2023
DOI: 10.1109/IROS55552.2023.10341832