OJS  Vol.5 No.7 , December 2015
Model Averaging by Stacking
Author(s) Claudio Morana1,2
ABSTRACT

The paper introduces a new Frequentist model averaging estimation procedure, based on a stacked OLS estimator across models, implementable on cross-sectional, panel, as well as time series data. The proposed estimator shows the same optimal properties of the OLS estimator under the usual set of assumptions concerning the population regression model. Relatively to available alternative approaches, it has the advantage of performing model averaging exante in a single step, optimally selecting models’ weight according to the MSE metric, i.e. by minimizing the squared Euclidean distance between actual and predicted value vectors. Moreover, it is straightforward to implement, only requiring the estimation of a single OLS augmented regression. By exploiting exante a broader information set and benefiting of more degrees of freedom, the proposed approach yields more accurate and (relatively) more efficient estimation than available expost methods.


Cite this paper
Morana, C. (2015) Model Averaging by Stacking. Open Journal of Statistics, 5, 797-807. doi: 10.4236/ojs.2015.57079.
References
[1]   Baiardi, D. and Morana, C. Financial Deepening and Income Distribution Inequality in the Euro Area. Department of Economics, Management and Statistics, University of Milan Bicocca, Working Paper No. 316.

[2]   Claeskens, G. and Hjort, N. (2008) Model Selection and Model Averaging. Cambridge University Press, Cambridge.
http://dx.doi.org/10.1017/CBO9780511790485

[3]   Hendry, D.F. and Doornik, J.A. (2004) Empirical Model Discovery and Theory Evaluation. MIT Press, Cambridge.

[4]   Hoeting, J.A., Madigan, D., Raftery, A.E. and Volinsky, C.T. (1999) Bayesian Model Averaging: A Tutorial. Statistical Science, 14, 382-417.

[5]   Moral Benito, E. (2015) Model Averaging in Economics: An Overview. Journal of Economic Surveys, 29, 46-75.
http://dx.doi.org/10.1111/joes.12044

[6]   Buckland, S., Burnham, K. and Augustin, N. (1997) Model Selection: An Integral Part of Inference. Biometrics, 53, 603-618.
http://dx.doi.org/10.2307/2533961

[7]   Hansen, B. (2007) Least Squares Model Averaging. Econometrica, 75, 1175-1180.
http://dx.doi.org/10.1111/j.1468-0262.2007.00785.x

[8]   Hansen, B. and Rancine, J. (2010) Jacknife Model Averaging. Journal of Econometrics, 167, 38-46.
http://dx.doi.org/10.1016/j.jeconom.2011.06.019

[9]   Hayashi, F. (2000) Econometrics. Princeton University Press, Princeton.

 
 
Top