Robert A. Jacobs
University of Rochester, Massachusetts Institute of Technology
Papers
6
Total Citations
3,122
H-Index
6
About
Robert A. Jacobs is a leading figure in machine learning and computational neuroscience, best known for pioneering modular and hierarchical learning architectures. His most celebrated contribution is the **Hierarchical Mixtures of Experts (HME)** framework, introduced in his landmark 1994 paper (over 2,600 citations). This tree-structured architecture, trained using the Expectation-Maximization (EM) algorithm, elegantly solves complex supervised learning problems by dividing them into subtasks, where both the mixture coefficients and components are generalized linear models. This work has had a profound impact on ensemble methods and probabilistic modeling. Jacobs also advanced modular neural networks for control tasks, demonstrating how multiple networks can compete to learn piecewise control strategies, adaptively partitioning a plant's parameter space. His earlier work on competitive modular connectionist architectures (1990, 140 citations) laid the groundwork for these ideas, capturing the intermediate granularity of task structure. Through these innovations, Jacobs has fundamentally shaped how researchers approach learning in complex, multi-component systems, blending statistical rigor with neural network design.
Research Focus
Key Achievements
Top Papers
- 1Hierarchical Mixtures of Experts and the EM Algorithm2,632 citations · 1994
- 2Learning piecewise control strategies in a modular neural network architecture176 citations · 1993
- 3Hierarchical mixtures of experts and the EM algorithm154 citations · 2005
- 4A competitive modular connectionist architecture140 citations · 1990
- 5Hierarchical Mixtures of Experts and the EM Algorithm10 citations · 2001
- 6Supervised learning and divide-and-conquer: A statistical approach10 citations · 1993