........ published in NEWSLETTER # 66
[ PCO Home Page ] [ Table of Contents of NEWSLETTER # 66 ]
........ published in NEWSLETTER # 66
LEARNING IN GRAPHICAL MODELS
by Professor M.I. Jordan, MIT, Cambridge/MA (U.S.A.)
Graphical models are a marriage between probability theory and graph theory. They provide a natural tool for dealing with two problems that occur throughout applied mathematics and engineering - uncertainty and complexity - and in particular they are playing an increasingly important role in the design and analysis of machine learning algorithms. Fundamental to the idea of a graphical model is the notion of modularity - a complex system is built by combining simpler parts. Probability theory provides the glue whereby the parts are combined, insuring that the system as a whole is consistent, and providing ways to interface models to data. The graph theoretic side of graphical models provides both an intuitively appealing interface by which humans can model highly-interacting sets of variables as well as a data structure that lends itself naturally to the design of efficient general- purpose algorithms.
Many of the classical multivariate probabilistic systems studied in fields such as statistics, systems engineering, information theory, pattern recognition and statistical mechanics are special cases of the general graphical model formalism - examples include mixture models, factor analysis, hidden Markov models, Kalman filters and Ising models. The graphical model framework provides a way to view all of these systems as instances of a common underlying formalism. This has many advantages - in particular, specialized techniques that have been developed in one field can be transferred between research communities and exploited more widely. Moreover, the graphical model formalism provides a natural framework for the design of new systems.
This book (NATO ASI SERIES D89) presents an in-depth exploration of issues related to learning within the graphical model formalism. Four of the chapters are tutorial articles. The remaining articles cover a wide spectrum of topics of current research interest.
Reference books: C147, C497, D89