About
Approximate Learning of Large Scale Graphical Models: Theory and Applications
Undirected graphical models provide a powerful framework for representing dependency structure between random variables. Learning the parameters of undirected models plays a crucial role in solving key problems in many machine learning applications, including natural language processing, visual object recognition, speech perception, information retrieval, computational biology, and many others. Learning in undirected graphical models of large treewidth is difficult because of the hard inference problem induced by the partition function for maximum likelihood learning, or by finding the MAP assignment for margin-based loss functions. Over the last decade, there has been considerable progress in developing algorithms for approximating the partition function and MAP assignment, both via variational approaches (e.g., belief propagation) and sampling algorithms (e.g., MCMC). More recently, researchers have begun to apply these methods to learning large, densely-connected undirected graphical models that may contain millions of parameters. A notable example is the learning of Deep Belief Networks and Deep Boltzmann Machines, that employ MCMC strategy to greedily learn deep hierarchical models.
The Workshop homepage can be found at http://www.cs.toronto.edu/~rsalakhu/workshop_nips2009/index.html.
Related categories
Uploaded videos:
33:05
Approximate Inference in Natural Language Processing
Jan 19, 2010
·
5098 Views
34:50
Learning Deep Boltzmann Machines
Jan 19, 2010
·
17318 Views
41:56
Joint Max Margin and Max Entropy Learning of Graphical Models
Jan 19, 2010
·
5303 Views
43:32
Large-Scale Learning and Inference: What We Have Learned with Markov Logic Netwo...
Jan 19, 2010
·
7030 Views
17:04
Parameter Learning Using Approximate MAP Inference
Jan 19, 2010
·
3986 Views
11:03
Learning a Region-based Scene Segmentation Model
Jan 19, 2010
·
3272 Views
28:56
Training Structured Predictors for Novel Loss Functions
Jan 19, 2010
·
3462 Views
30:16
Some Machine Learning Problems that We in the Computer Vision Community Would Li...
Jan 14, 2010
·
6538 Views