Marek Musial

Papers

Total Citations

H-Index

About

Marek Musial is a researcher whose work bridges reinforcement learning, robotics, and autonomous systems. His key research areas include constructing efficient approximation spaces for reinforcement learning algorithms, cooperative mobile robotics using ad-hoc communication networks, and the control of autonomous flying vehicles. His most impactful contribution is his 2013 paper on "Construction of approximation spaces for reinforcement learning" (22 citations), which investigates methods for building basis functions from samples to improve the performance of linear RL algorithms like least-squares temporal difference learning (LSTD). This work addresses a fundamental challenge in RL: how to automatically generate effective value function approximations from data. Musial also made notable contributions to cooperative robotics, with his 2004 paper on communication systems for mobile robots using ad-hoc networks (8 citations), and to autonomous flight, including a 2004 study on controlling a model helicopter (7 citations) and earlier work on the TUBROB flying robot (1995). His research demonstrates a sustained interest in enabling intelligent, autonomous decision-making in complex, dynamic environments, with applications ranging from robotic coordination to aerial vehicle control.