Learning of intelligent swarm behavior

Principal Investigators:

Henning Sprekeler
Pawel Romanczuk
David Bierbach (Co-PI)
mail: bierbacd@hu-berlin.de

Team members:

Luis Alberto Gómez Nava (Postdoctoral researcher)
Robert Tjarko Lange (doctoral researcher)

When is it ecologically beneficial to act as a collective, or to develop diversity within a swarm? When is it best to act alone?

Research Unit 1, SCIoI Project 12

A central challenge in both understanding and developing swarm intelligence is the relation between the behavior of a swarm of agents and its ecological niche. The goal of this project is to combine analytical behavioral characterizations of biological swarms (specifically, fish) in different ecological settings with synthetic state-of-the-art machine learning methods that optimize the behavior of a multi-agent system for a given task (e.g., (deep) multi-agent reinforcement learning).

The ideal outcome on the analytical side would be a normative, ecological interpretation of observed swarm behavior as an adaptation to an ecological niche, rather than classical phenomenological models that derive collective behavior from the behavior of the individuals.

For example, the suggested optimization approach to swarm behavior can provide insights regarding when it is ecologically beneficial to act as a collective, when to develop diversity within a swarm, and when to act alone.

The ideal synthetic outcome would be the development of novel learning algorithms for artificial swarms of, e.g., robotic agents, that allow a behavioral optimization for a given ecological niche, i.e., an ensemble of tasks. The project aims at establishing essential methods for the implementation of the “collective shepherding” behavior. The developed methodology will serve as a starting point for incorporating priors for specific ecological niches, as well as the sensory and motor aspects of the agents in the swarm.



Related Publications