📋 Tender Overview
Fame: Open-Ended Manipulation Task Learning With Fame (Future-Oriented Cognitive1 Action Modelling Engine)
Enabling Robots To Contextualise Underdetermined Manipulation Task Requeststhe Formidable Challenge Of Creating Computational Models For Versatile Manipulation Tasks, Applicable To Any Object And Purpose, Would Revolutionise Ai And Robotics. The Erc-Funded Fame Project Aims To Equip Robots With A Kr&R Framework Based On Machine-Interpretable Inner-World Models, Enabling Them To Contextualise Underdetermined Manipulation Task Requests On The First Attempt. The Project Will Design, Implement, And Evaluate The Future-Orientated Cognitive Action Modelling Engine (Fame), A Hybrid Symbolic/Sub-Symbolic Kr&R Framework. The Project Aims To Achieve The Modelling And Parameterisation Of Manipulation Motion Patterns, The Ability To Mentally Simulate Imagined And Observed Manipulation Tasks, And The On-Demand Acquisition Of Task-Specific Causal Models For Novel Manipulation Tasks Through Mental Physics-Based Simulations.
Funded Under
European Research Council (Erc)
Total Cost
€ 2 499 063,00
Eu Contribution
€ 2 499 063,00
Coordinated By
Universitaet Bremen
Germany
Start Date
1 September 2023
End Date
31 August 2028
Objective
The realization of computational models for accomplishing everyday manipulation tasks for any object and any purpose would be a
disruptive breakthrough in the creation of versatile, general-purpose robot agents; and it is a grand challenge for AI and robotics.
Humans are able to accomplish tasks such as cut up the fruit for many types of fruit by generating a large variety of context-specific
manipulation behaviors. They can typically accomplish the tasks on the first attempt despite uncertain physical conditions and novel
objects. Acting so effectively requires comprehensive reasoning about the possible consequences of intended behavior before
physically interacting with the real world.
In the FAME project, I will investigate the research hypothesis that a knowledge representation and reasoning (KR&R) framework
based on explictly-represented and machine-interpretable inner-world models can enable robots to contextualize underdetermined
manipulation task requests on the first attempt. To this end, I will design, implement, and evaluate FAME (Future-oriented cognitive
Action Modelling Engine), a hybrid symbolic/subsymbolic KR&R framework that will contextualize actions by reasoning symbolically
in an abstract and generalized manner but also by reasoning with one’s eyes and hands through mental simulation and imagistic
reasoning. Realizing FAME requires three breakthrough research results:
(1) modelling and parameterization of manipulation motion patterns and understanding the resulting effects under
uncertain conditions;
(2) the ability to mentally simulate imagined and observed manipulation tasks to link them to the robot’s knowledge and experience;
and
(3) the on-demand acquisition of task-spe
