Skip to Content

Bayesian Model Selection and Statistical Modeling

By Tomohiro Ando

Chapman and Hall/CRC – 2010 – 300 pages

Series: Statistics: A Series of Textbooks and Monographs

Purchasing Options:

  • Add to CartHardback: $98.95
    978-1-43-983614-9
    May 27th 2010

Description

Along with many practical applications, Bayesian Model Selection and Statistical Modeling presents an array of Bayesian inference and model selection procedures. It thoroughly explains the concepts, illustrates the derivations of various Bayesian model selection criteria through examples, and provides R code for implementation.

The author shows how to implement a variety of Bayesian inference using R and sampling methods, such as Markov chain Monte Carlo. He covers the different types of simulation-based Bayesian model selection criteria, including the numerical calculation of Bayes factors, the Bayesian predictive information criterion, and the deviance information criterion. He also provides a theoretical basis for the analysis of these criteria. In addition, the author discusses how Bayesian model averaging can simultaneously treat both model and parameter uncertainties.

Selecting and constructing the appropriate statistical model significantly affect the quality of results in decision making, forecasting, stochastic structure explorations, and other problems. Helping you choose the right Bayesian model, this book focuses on the framework for Bayesian model selection and includes practical examples of model selection criteria.

Reviews

"…excellent … for learning or applying [the Bayesian approach]. … The book is suitable for classroom usage. There are challenging problems in the exercises. Graduate students would like this book."

Journal of Statistical Computation and Simulation, Vol. 84, 2014

"This book is good at describing the various methods which have been proposed in this area. It also gives good examples of the use of most of the methods … . There is R code available for many of the examples on the author’s web pages and this is a very positive aspect. The examples I looked at seemed to be well written. The book has exercises at the end of each chapter. … this book will make a welcome addition to my bookshelf. If I need to calculate a marginal likelihood, for example, it will inform, or remind, me of the range of methods available."

—Lawrence Pettit, Biometrics, September 2012

"The book can be useful in several different ways—apart from the most obvious use as a text for a course on Bayesian model selection, it will be of value for anybody working on problems of model selection since it seems to be the first book-length treatment from a Bayesian perspective. Most of the many references are from the 1990s and 2000s, which means that the book (especially Chapters 5-9) will provide a very good overview of the Bayesian literature on model choice, especially for non-Bayesian researchers working in this area."

—Thoralf Mildenberger, Statistical Papers (2012) 53

Contents

Introduction

Statistical models

Bayesian statistical modeling

Book organization

Introduction to Bayesian Analysis

Probability and Bayes’ theorem

Introduction to Bayesian analysis

Bayesian inference on statistical models

Sampling density specification

Prior distribution

Summarizing the posterior inference

Bayesian inference on linear regression models

Bayesian model selection problems

Asymptotic Approach for Bayesian Inference

Asymptotic properties of the posterior distribution

Bayesian central limit theorem

Laplace method

Computational Approach for Bayesian Inference

Monte Carlo integration

Markov chain Monte Carlo methods for Bayesian inference

Data augmentation

Hierarchical modeling

MCMC studies for the Bayesian inference on various types of models

Noniterative computation methods for Bayesian inference

Bayesian Approach for Model Selection

General framework

Definition of the Bayes factor

Exact calculation of the marginal likelihood

Laplace’s method and asymptotic approach for computing the marginal likelihood

Definition of the Bayesian information criterion

Definition of the generalized Bayesian information criterion

Bayes factor with improper prior

Expected predictive likelihood approach for Bayesian model selection

Other related topics

Simulation Approach for Computing the Marginal Likelihood

Laplace–Metropolis approximation

Gelfand–Day’s approximation and the harmonic mean estimator

Chib’s estimator from Gibb’s sampling

Chib’s estimator from MH sampling

Bridge sampling methods

The Savage–Dickey density ratio approach

Kernel density approach

Direct computation of the posterior model probabilities

Various Bayesian Model Selection Criteria

Bayesian predictive information criterion

Deviance information criterion

A minimum posterior predictive loss approach

Modified Bayesian information criterion

Generalized information criterion

Theoretical Development and Comparisons

Derivation of Bayesian information criteria

Derivation of generalized Bayesian information criteria

Derivation of Bayesian predictive information criterion

Derivation of generalized information criterion

Comparison of various Bayesian model selection criteria

Bayesian Model Averaging

Definition of Bayesian model averaging

Occam’s window method

Bayesian model averaging for linear regression models

Other model averaging methods

Bibliography

Index

Author Bio

Tomohiro Ando is an associate professor of management science in the Graduate School of Business Administration at Keio University in Japan.

Name: Bayesian Model Selection and Statistical Modeling (Hardback)Chapman and Hall/CRC 
Description: By Tomohiro Ando. Along with many practical applications, Bayesian Model Selection and Statistical Modeling presents an array of Bayesian inference and model selection procedures. It thoroughly explains the concepts, illustrates the derivations of various Bayesian model...
Categories: Statistics for Business, Finance & Economics, Statistical Theory & Methods