The robotic soccer team Brainstormers 2D is a team participating in the simulation league of the RoboCup competition. Brainstormers' research and development is currently done in the Machine Learning Lab at the University of Freiburg, Germany, maintained by team leader Dr. Thomas Gabel and team founder Prof. Dr. Martin Riedmiller.

Key facts:

• founded in 1998
• three times world champion: 2005, 2007, and 2008
• six consecutive European-level titles: 2005 through 2010
• research focus: use of artificial intelligence-based and reinforcement learning approaches to the largest degree possible
• more than 20 publications on the use of machine learning techniques in the context of robotic soccer

The Brainstormers are a team of 11 computer programs, that each control a simulated robot on a virtual playfield. The simulated robots share a lot of features with their real hardware colleagues (see the Brainstormers Tribots' site) - for example restricted view, restricted moving capabilities, restricted ressources - but they have the big advantage to be much cheaper and much less sensible to damages. Therefore, the simulator league teams can concentrate on the development of control software.

Robotic soccer represents an excellent testbed for machine learning and, particularly, for reinforcement learning tasks. The scientific goal of our team is to use machine learning techniques - in particular reinforcement learning methods - to develop the players' control programs. So, from a learning point of view it is also our long-term goal to realize an agent that obtains its behavior by entirely employing a reinforcement learning methodology.

You can find more details about that focus in our research and publications sections below.

RoboCup is an international research initiative intending to expedite AI and intelligent robotics research by defining a set of standard problems where various technologies can and ought to be combined solving them. Annually, there are championship tournaments in several leagues - ranging from rescue tasks over real soccer-playing robots to simulated ones.

The Brainstormers 2D participate in RoboCup's 2D Simulation League, where two teams of simulated soccer-playing agents compete against one another using the Soccer Server, a real-time soccer simulation system.

The Soccer Server allows autonomous software agents written in an arbitrary programming language to play soccer in a client/server-based style: The server simulates the playing field, communication, the environment and its dynamics, while the clients - eleven agents per team - are permitted to send their intended actions (e.g. a parameterised kick or dash command) once per simulation cycle to the server via UDP. Then, the server takes all agents' actions into account, computes the subsequent world state and provides all agents with (partial) information about their environment via appropriate messages over UDP. The course of action during a match can be visualised using an additional program, the Soccer Monitor.

fk8mekagmnu You may visit the RoboCup Homepage for further details on robotic soccer and RoboCup. If you are interested in finding out, what progress has been made in RoboCup throughout the previous years, you might follow this link or watch the video on the right.

zabmohetwbw ynlrccb_xbm

• T. Gabel and M. Riedmiller. On Progress in RoboCup: The Simulation League Showcase. RoboCup 2010: Robot Soccer World Cup XIV, LNCS. Springer, Singapore, 2010. pdf
• M. Riedmiller, T. Gabel, R. Hafner and S. Lange. Reinforcement Learning for Robot Soccer. Autonomous Robots, 27(1):55–74, Springer, 2009. pdf
• T. Gabel, M. Riedmiller and F. Trost. A Case Study on Improving Defense Behavior in Soccer Simulation 2D: The NeuroHassle Approach. RoboCup 2008: Robot Soccer World Cup XII, LNCS. Springer, Shouzou, China, 2008. pdf
• T. Gabel and M. Riedmiller. On Experiences in a Complex and Competitive Gaming Domain: Reinforcement Learning Meets RoboCup. Proceedings of the IEEE Symposium on Computational Intelligence and Games (CIG 2007). Honolulu, USA, 2007. pdf
• T. Gabel, R. Hafner, S. Lange, M. Lauer and M. Riedmiller. Bridging the Gap: Learning in the RoboCup Simulation and Midsize League. Proceedings of the 7th Portuguese Conference on Automatic Control (Controlo 2006). Portuguese Society of Automatic Control, Porto, Portugal, 2006. pdf
• T. Gabel and M. Riedmiller. Learning a Partial Behavior for a competitive Soccer Agent. Künstliche Intelligenz, 2:18-23, Springer, 2006. pdf
• M. Riedmiller, T. Gabel, R. Hafner, S. Lange and M. Lauer. Die Brainstormers: Entwurfsprinzipien lernfähiger autonomer Roboter. Informatik-Spektrum, 20(3):175-190, Springer, 2006.
• T. Gabel and M. Riedmiller. CBR for State Value Function Approximation in Reinforcement Learning. Proceedings of the International Conference on Case Based Reasoning 2005 (ICCBR 2005). Springer, Chicago, USA, August 2005. pdf
• D. Withopf and M. Riedmiller. Comparing Different Methods to Speed-Up Reinforcement Learning in a Complex Domain. Proc. of the Int. Conference on Systems, Man and Cybernetics, 2005. Big Island, USA, October 2005.
• D. Withopf and M. Riedmiller. Effective Methods for Reinforcement Learning in Large Multi-Agent Domains. it - Information Technology Journal, 5(47):241-249, Oldenbourg, 2005.
• M. Riedmiller and A. Merke. Using machine learning techniques in complex multi-agent domains. In I. Stamatescu and W. Menzel and M. Richter and U. Ratsch, editor, Adaptivity and Learning, Springer, 2003.

Team members:

• Dr. Thomas Gabel
• Prof. Dr. Martin Riedmiller
• Tobias Springenberg
• Thomas Huber

Former members:

• Haiko Schol
• Sascha Ludwig
• Florian Trost
• Hannes Schulz
• Anton Fluegge
• Kilian Klimek
• Johannes Knabe
• Hauke Strasdat
• Daniel Withopf
• Artur Merke

• all details on the Brainstormers' achievements during competitions
• research on single-agent learning and multi-agent learning within the Brainstormers project
• Brainstormers' downloads & media files