Dynamical Collective Adaptation and Learning

Principal Investigators:

Jörg Raisch
Pawel Romanczuk
David Bierbach (Co-PI)

Team members:

Fritz Francisco (Doctoral researcher)
Dustin Lehmann (Doctoral researcher)
Thomas Seel (External collaborator)

A research project on how biological and artificial collectives learn and adapt to find collective solutions to complex problems

Research Unit 1, SCIoI Project 11

The general objective of this project is to study dynamical adaptation and learning of biological and artificial collectives and how this contributes to collective solutions of complex problems outperforming individuals. We will study mechanisms of how individual agents within the collective acquire and share knowledge.

In particular, we will explore the role of partial, potentially conflicting or even erroneous, prior knowledge. The general scenario is a group of agents exploring a complex environment containing an a priori unknown number of targets (“food”). The targets themselves are not trivially accessible but are a) distributed in a complex environment, and b) need to be handled in a particular way to be successfully exploited. We are particularly interested in how collectives composed of individuals with partial prior knowledge (e.g. trained on different aspects of the foraging problem) combine their knowledge, and what the role of naive individuals without prior knowledge is.

On the analytical side, the main objective is to understand the benefits of grouping in terms of collective cognition. In particular, we want to explore two broad scenarios: 1) Situations where non-overlapping, partial knowledge of different individuals enhances collective performance, versus 2) cases where it impairs collective problem solving either because some prior knowledge is misleading or different priors leads to a stalemate (e.g. trained on different cues). Finally, we want to explore how partial knowledge (priors) interacts with possible persistent (fixed) heterogeneity within the collective (animal personalities) [BierbachNC].

On the synthetic side, methods from distributed and learning control theory will be extended and used to investigate the dynamics of collective learning. In particular, we will study (i) the interplay between prior knowledge, individual learning and knowledge transfer between agents, (ii) the relevance of the communication topology, and (iii) the effect of agent heterogeneity with respect to prior knowledge and learning strategies, dynamics and distortion of shared knowledge.

Formal methods developed on the synthetic side will be validated respectively improved using observations from two experimental testbeds – a biological one and a robotic one. Vice versa, methodological results will lead to a deeper understanding and to improved hypotheses on the analytical side.

 

Related Publications

Sosna, M. M. G., Twomey, C. R., Bak-Coleman, J., Poel, W., Daniels, B. C., Romanczuk, P., & Couzin, I. D. (2019). Individual and collective encoding of risk in animal groups. Proceedings of the National Academy of Sciences, 116(41), 20556–20561. https://doi.org/10.1073/pnas.1905585116
Raoufi, M., Hamann, H., & Romanczuk, P. (2021). Speed-vs-Accuracy Tradeoff in Collective Estimation: An Adaptive Exploration-Exploitation Case. IEEE 2021 International Symposium on Multi-Robot and Multi-Agent Systems (MRS). https://doi.org/10.1109/MRS50823.2021.9620695
Molinari, F., Agrawal, N., Stańczak, S., & Raisch, J. (2022). Over-The-Air Max-Consensus in Clustered Networks Adopting Half-Duplex Communication Technology. IEEE Transactions on Control of Network Systems, Early access. https://doi.org/10.1109/TCNS.2022.3212870
Meindl, M., Molinari, F., Raisch, J., & Seel, T. (2020). Overcoming Output Constraints in Iterative Learning Control Systems by Reference Adaptation. IFAC-PapersOnLine 21st IFAC World Congress, 53, 1480–1486. https://doi.org/10.1016/j.ifacol.2020.12.1938
Meindl, M., Molinari, F., Lehmann, D., & Seel, T. (2022). Collective Iterative Learning Control: Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks. IEEE Transactions on Control Systems Technology. https://doi.org/10.1109/TCST.2021.3109646
Makowicz, A. M., Bierbach, D., Richardson, C., & Hughes, K. A. (2022). Cascading indirect genetic effects in a clonal vertebrate. Proceedings of the Royal Society B: Biological Sciences, 289(1978). https://doi.org/10.1098/rspb.2022.0731
Lehmann, D., Drebinger, P., Seel, T., & Raisch, J. (2023). Data-Driven Dynamic Input Transfer for Learning Control in Multi-Agent Systems with Heterogeneous Unknown Dynamics. 62nd IEEE Conference on Decision and Control (CDC). https://doi.org/10.1109/CDC49753.2023.10383433
Bierbach, D., Krause, S., Romanczuk, P., Lukas, J., Arias-Rodriguez, L., & Krause, J. (2020). An interaction mechanism for the maintenance of fission–fusion dynamics under different individual densities. PeerJ, 8, e8974. https://doi.org/10.7717/peerj.8974
Bastien, R., & Romanczuk, P. (2020). A model of collective behavior based purely on vision. Science Advances, 6(6), eaay0792. https://doi.org/10.1126/sciadv.aay0792