This book describes how model selection and statistical inference can be founded on the shortest code length for the observed data, called the stochastic complexity. This generalization of the algorithmic complexity not only offers an objective view of statistics, where no prejudiced assumptions of "true" data generating distributions are needed, but it also in one stroke leads to calculable expressions in a range of situations of practical interest and links very closely with mainstream statistical theory. The search for the smallest stochastic complexity extends the classical maximum likelihood technique to a new global one, in which models can be compared regardless of their numbers of parameters. The result is a natural and far reaching extension of the traditional theory of estimation, where the Fisher information is replaced by the stochastic complexity and the CramerRao inequality by an extension of the ShannonKullback inequality. Ideas are illustrated with applications from parametric and nonparametric regression, density and spectrum estimation, time series, hypothesis testing, contingency tables, and data compression

Authors: Rissanen J.  Pages: 95 Year: 1989 
Tags: statistical complexity stochastic inquiry rissanen   Customers who bought this item also bought: 