Back
 JAMP  Vol.8 No.1 , January 2020
Bayesian Regularized Quantile Regression Analysis Based on Asymmetric Laplace Distribution
Abstract: In recent years, variable selection based on penalty likelihood methods has aroused great concern. Based on the Gibbs sampling algorithm of asymmetric Laplace distribution, this paper considers the quantile regression with adaptive Lasso and Lasso penalty from a Bayesian point of view. Under the non-Bayesian and Bayesian framework, several regularization quantile regression methods are systematically compared for error terms with different distributions and heteroscedasticity. Under the error term of asymmetric Laplace distribution, statistical simulation results show that the Bayesian regularized quantile regression is superior to other distributions in all quantiles. And based on the asymmetric Laplace distribution, the Bayesian regularized quantile regression approach performs better than the non-Bayesian approach in parameter estimation and prediction. Through real data analyses, we also confirm the above conclusions.
Cite this paper: Tang, Q. , Zhang, H. and Gong, S. (2020) Bayesian Regularized Quantile Regression Analysis Based on Asymmetric Laplace Distribution. Journal of Applied Mathematics and Physics, 8, 70-84. doi: 10.4236/jamp.2020.81006.
References

[1]   Koenker, R. and Bassett, G. (1978) Regression Quantiles. Econometrica, 46, 33-50.
https://doi.org/10.2307/1913643

[2]   Koenker, R. and Machado, J.A.F. (1999) Goodness of Fit and Related Inference Processes for Quantile Regression. Journal of the American Statistical Association, 94, 1296-1310.
https://doi.org/10.1080/01621459.1999.10473882

[3]   Yu, K. and Moyeed, R.A. (2001) Bayesian Quantile Regression. Statistics & Probability Letters, 54, 437-447.
https://doi.org/10.1016/S0167-7152(01)00124-9

[4]   Hewson, P. and Yu, K. (2010) Quantile Regression for Binary Performance Indicators. Applied Stochastic Models in Business & Industry, 24, 401-418.
https://doi.org/10.1002/asmb.732

[5]   Reich, B.J., Fuentes, M. and Dunson, D.B. (2011) Bayesian Spatial Quantile Regression. Publications of the American Statistical Association, 106, 6-20.
https://doi.org/10.1198/jasa.2010.ap09237

[6]   Sriram, K., Ramamoorthi, R.V. and Ghosh, P. (2013) Posterior Consistency of Bayesian Quantile Regression Based on the Misspecified Asymmetric Laplace Density. Bayesian Analysis, 8, 479-504.
https://doi.org/10.1214/13-BA817

[7]   Kozumi, H. and Kobayashi, G. (2009) Gibbs Sampling Methods for Bayesian Quantile Regression. Journal of Statistical Computation and Simulation, 81, 1565-1578.
https://doi.org/10.1080/00949655.2010.496117

[8]   Khare, K. and Hobert, J.P. (2012) Geometric Ergodicity of the Gibbs Sampler for Bayesian Quantile Regression. Journal of Multivariate Analysis, 112, 108-116.
https://doi.org/10.1016/j.jmva.2012.05.004

[9]   Sriram, K. (2015) A Sandwich Likelihood Correction for Bayesian Quantile Regression Based on the Misspecified Asymmetric Laplace Density. Statistics & Probability Letters, 107, 18-26.
https://doi.org/10.1016/j.spl.2015.07.035

[10]   Koenker, R. (2004) Quantile Regression for Longitudinal Data. Journal of Multivariate Analysis, 91, 74-89.
https://doi.org/10.1016/j.jmva.2004.05.006

[11]   Wang, H., Li, G. and Jiang, G. (2007) Robust Regression Shrinkage and Consistent Variable Selection through the LAD-Lasso. Journal of Business & Economic Statistics, 25, 347-355.
https://doi.org/10.1198/073500106000000251

[12]   Li, Y. and Zhu, J. (2008) L1-Norm Quantile Regression. Journal of Computational and Graphical Statistics, 17, 163-185.
https://doi.org/10.1198/106186008X289155

[13]   Wu, Y. and Liu, Y. (2009) Variable Selection in Quantile Regression. Statistica Sinica, 19, 801-817.

[14]   Park, T. and Casella, G. (2008) The Bayesian Lasso. Journal of the American Statistical Association, 103, 681-686.
https://doi.org/10.1198/016214508000000337

[15]   Li, Q., Xi, R. and Lin, N. (2010) Bayesian Regularized Quantile Regression. Bayesian Analysis, 5, 533-556.
https://doi.org/10.1214/10-BA521

[16]   Alhamzawi, R., Yu, K. and Benoit, D.F. (2012) Bayesian Adaptive Lasso Quantile Regression. Statistical Modelling, 12, 279-297.
https://doi.org/10.1177/1471082X1101200304

[17]   Adlouni, S.E., Salaou, G. and Sthilaire, A. (2018) Regularized Bayesian Quantile Regression. Communication in Statistics-Simulation and Computation, 47, 277-293.
https://doi.org/10.1080/03610918.2017.1280830

[18]   Tsionas, E. (2003) Bayesian Quantile Inference. Journal of Statistical Computation and Simulation, 73, 659-674.
https://doi.org/10.1080/0094965031000064463

[19]   Andrews, D.F. and Mallows, C.L. (1974) Scale Mixtures of Normal Distributions. Journal of the Royal Statistical Society, 36, 99-102.
https://doi.org/10.1111/j.2517-6161.1974.tb00989.x

[20]   Yi, N. and Xu, S. (2008) Bayesian LASSO for Quantitative Trait Loci Mapping. Genetics, 179, 1045-1055.
https://doi.org/10.1534/genetics.107.085589

[21]   Gilks, W.R. and Wild, P. (1992) Adaptive Rejection Sampling for Gibbs Sampling. Journal of the Royal Statistical Society, 41, 337-348.
https://doi.org/10.2307/2347565

[22]   Benoit, D.F., Al-Hamzawi, R., Yu, K.M. and Dirk, V.P. (2017) BayesQR: Bayesian Quantile Regression. R Package Version 2.3.
https://cran.r-project.org/package=bayesQR
https://doi.org/10.18637/jss.v076.i07

[23]   Stamey, T.A. (1989) Prostate Specific Antigen in the Diagnosis and Treatment of Adenocarcinoma of the Prostate. II. Radical Prostatectomy Treated Patients. The Journal of Urology, 141, 1076-1083.
https://doi.org/10.1016/S0022-5347(17)41175-X

 
 
Top