Nottale, Matthieu (2008) Ancrage d'un lexique partagé entre robots autonomes dans un environnement non-contraint Thesis, ENSTA.

Restricted to Repository staff only



The Talking Heads is a developmental robotics experiment conducted by Luc Steels and Frederic Kaplan in 1995, at Sony CSL lab. In this experiment, agents acquire a shared grounded lexicon of words associated with visual properties of objects in their environnement through language game interactions. The grounding of symbols in the agent's perception is ensured by the way the interactions are designed, thus providing an answer to the grounding problem formulated by Brooks and others, illustrated by the Chinese room experiment. The Talking Heads are also capable of building a shared lexicon with a population of thousands of agents in an unsupervised way. They implement a model of how a language could emerge in a population of agents capable of communication. This experiment has been extended in multiple areas : the lexicon has been extended with a grammar, and the static environnement has been modified to include scenes with moving objects. Yet the limited environnement is now limiting some interesting extensions of these experiments. The aim of this thesis is to reimplement the Talking Heads using autonomous robots and using an unconstrained environment: our laboratory. This would first show that the Talking Heads models are able to scale to a more complex environment, and allow the development of future experiments with more complex cognitive models giving more autonomy to the agents and that would require this richer environnement. We first focus on the new problems introduced by mobile robots: the detection of an other robot, the problem of positionning a robot, and the problem of pointing a region of the environnement to another robot. We then explore a first model using image segmentation algorithms to stay very close to the original Talking Heads, and show why this model is failing to obtain lexicon convergence between the agents. We finally introduce a second model using the state of the art in the object detection field to build object models based on the detection of recurring patterns in the environnement. We first show that this model can successfully be used for classification tasks on object databases, then apply it to the Talking Heads setup. Our results show that the agents are able to exchange symbols associated with regions of their environnement, although the overall game success rate stays low.

Item Type:Thesis (Thesis)
Uncontrolled Keywords:Computer vision
Subjects:Information and Communication Sciences and Technologies
ID Code:4260
Deposited By:Sophie Chouaf
Deposited On:21 nov. 2008 01:20
Dernière modification:05 juin 2013 09:14

Repository Staff Only: item control page