Many fields are now snowed under with an avalanche of data, which raises considerable challenges for computer scientists. Meanwhile, robotics (among other fields) can often only use a few dozen data points because acquiring them involves a process that is expensive, time-consuming, and potentially dangerous. How can a robot learn with only a few data points?
Watching a child learn reveals how well humans can learn: a child may only need a few examples of a concept to “learn it”. By contrast, the impressive results achieved with modern machine learning (in particular, by deep learning) are made possible largely by the use of huge datasets. For instance, the ImageNet database used in image recognition contains about 1.2 million labelled examples; DeepMinds's AlphaGo used more than 38 million positions to train their algorithm to play Go; and the same company used more than 38 days of play to train a neural network to play Atari 2600 games, such as Space Invaders or Breakout.
Like children, robots have to face the real world, in which trying something might take seconds, hours, or days. And seeing the consequence of this trial might take much more. When robots share our world, they are expected to learn like humans or animals, that is, in far fewer than a million trials. Robots are not alone to be cursed by the price of data: Any learning process that involves physical tests or precise simulations (e.g., computational fluid dynamics) comes up against the same issue. In short, while data might be abundant in the virtual world, it is often a scarce resource in the physical world. We refer to this challenge as "micro-data learning".
Tremendous progresses have been achieved in robot learning during the last two decades. However, we do not see a large adoption of these robot learning methods in the robotics community. We believe that one of the main reasons is that robot learning still needs hundred, if not thousands of trials: in most cases, this is not a practical solutions, which explains why most robot learning experiments are primarily achieved in simulation, with often very few demonstrations on actual robots.
Researchers on robot learning are well aware that learning algorithms for robots need to be as data-efficient as possible. Still, they are only starting to address the challenge of micro-data explicitly. The objective of this workshop is to directly address the challenge of learning with a robot in only a handful of trials / a few seconds of interaction time. We hope to organize this workshop every year to constitute a community of researchers interested in this question.
09月24日
2017
会议日期
注册截止日期
留言