Graphical Models of Time Series: Parameter Estimation and Topology Selection
by Songsiri, Jitkomut, Ph.D., UNIVERSITY OF CALIFORNIA, LOS ANGELES, 2010, 112 pages; 3451077

Abstract:

This thesis is concerned with estimation problems in graphical models of time series. The graph topology of a graphical model characterizes conditional independence relations between the variables, so estimation generally involves two problems: topology selection and parameter estimation for a given topology. We first consider the problem of fitting a Gaussian autoregressive model to a time series, subject to conditional independence constraints. This is an extension of the classical covariance selection problem to time series. The conditional independence constraints impose a sparsity pattern on the inverse of the spectral density matrix, and result in nonconvex quadratic equality constraints in the maximum likelihood formulation of the model estimation problem. We present a semidefinite relaxation, and prove via duality that the relaxation is exact when the sample covariance matrix is block-Toeplitz. We also give experimental results suggesting that the relaxation is often exact when the sample covariance matrix is not block-Toeplitz. The estimation method can be used for small topology selection problems by enumerating all topologies, solving the estimation problem for each topology and ranking them via model selection criteria such as the Alcaike or Bayes information criteria.

As a second contribution, we propose an efficient method for learning the topology of graphical models of autoregressive Gaussian time series. The method is based on an ℓ1-type nonsmooth regularization of the conditional maximum likelihood estimation problem used to promote sparsity in the inverse of the estimated spectral density matrix. We describe a heuristic approach for choosing the regularization parameter which controls the sparsity of the esimated inverse spectrum. The estimation accuracy of the topology and AR model is illustrated by numerical examples and experiments with real data sets.

Finally we describe a large-scale algorithm that solves a reformulation of the duals of the above two problems via the gradient projection method. Numerical results show that the method is capable of solving problems of dimensions of several hundred within a reasonable amount of time.

 
AdviserLieven Vandenberghe
SchoolUNIVERSITY OF CALIFORNIA, LOS ANGELES
SourceDAI/B 72-06, p. , Apr 2011
Source TypeDissertation
SubjectsElectrical engineering
Publication Number3451077
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3451077
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.