Monte Carlo standard errors for Markov chain Monte Carlo
by Flegal, James Marshall, Ph.D., UNIVERSITY OF MINNESOTA, 2008, 191 pages; 3316137

Abstract:

Markov chain Monte Carlo (MCMC) is a method of producing a correlated sample to estimate characteristics of a target distribution. A fundamental question is how long should the simulation be run? One method to address this issue is to run the simulation until the width of a confidence interval for the quantity of interest is below a user-specified value. The use of this fixed-width methods requires an estimate of the Monte Carlo standard error (MCSE). This dissertation begins by discussing why MCSEs are important, how they can be easily calculated in MCMC and how they can be used to decide when to stop the simulation. The use of MCSEs is then compared to a popular alternative in the context of multiple examples.

This dissertation continues by discussing the relevant Markov chain theory with particular attention paid to the conditions and definitions needed to establish a Markov chain central limit theorem. Estimating MCSEs requires estimating the associated asymptotic variance. I introduce several techniques for estimating MCSEs: batch means, overlapping batch means, regeneration, subsampling and spectral variance estimation. Asymptotic properties useful in MCMC settings are established for these variance estimators. Specifically, I established conditions under which the estimator for the asymptotic variance in a Markov chain central limit theorem is strongly consistent. Strong consistency ensures that confidence intervals formed will be asymptotically valid. In addition, I established conditions to ensure mean-square consistency for the estimators using batch means and overlapping batch means. Mean-square consistency is useful in choosing an optimal batch size for MCMC practitioners.

Several approaches have been introduced dealing with the special case of estimating ergodic averages and their corresponding standard errors. Surprisingly, very little attention has been given to characteristics of the target distribution that cannot be represented as ergodic averages. To this end, I proposed use of subsampling methods as a means for estimating the qth quantile of the posterior distribution. Finally, the finite sample properties of subsampling are examined.

 
AdvisersGalin L. Jones; Glen D. Meeden
SchoolUNIVERSITY OF MINNESOTA
SourceDAI/B 69-08, Nov 2008
Source TypeDissertation
SubjectsStatistics
Publication Number3316137
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3316137
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.