Bayesian Inference for Mixture of Sparse Linear Regression Model
Search this article
Abstract
This paper proposes a Bayesian Inference for mixture of sparse linear regression models with the exchange Monte Carlo method. Mixture of linear regression model is a hybrid machine learning model that simultaneously performs clustering and linear regression. Mixture of sparse linear regression model imposes sparsity on the regression parameters and is expected to be applied to the analysis of real data in the field of materials science. The proposed method calculates the mixture ratio of each cluster, the label of each data point, and the posterior distribution of the sparse regression parameters by Bayesian inference using the exchange Monte Carlo method. Model selection based on the Bayesian free energy determines the appropriate number of mixtures of clusters. Experiments on artificial data confirmed that we obtained an appropriate posterior distribution of the parameters and showed appropriate model selection results. We applied our method to the data on aluminum alloys in materials science, and model selection and parameter estimation were performed by Bayesian inference.
This paper proposes a Bayesian Inference for mixture of sparse linear regression models with the exchange Monte Carlo method. Mixture of linear regression model is a hybrid machine learning model that simultaneously performs clustering and linear regression. Mixture of sparse linear regression model imposes sparsity on the regression parameters and is expected to be applied to the analysis of real data in the field of materials science. The proposed method calculates the mixture ratio of each cluster, the label of each data point, and the posterior distribution of the sparse regression parameters by Bayesian inference using the exchange Monte Carlo method. Model selection based on the Bayesian free energy determines the appropriate number of mixtures of clusters. Experiments on artificial data confirmed that we obtained an appropriate posterior distribution of the parameters and showed appropriate model selection results. We applied our method to the data on aluminum alloys in materials science, and model selection and parameter estimation were performed by Bayesian inference.
Journal
-
- 情報処理学会論文誌数理モデル化と応用(TOM)
-
情報処理学会論文誌数理モデル化と応用(TOM) 14 (3), 93-101, 2021-08-10
- Tweet
Details 詳細情報について
-
- CRID
- 1050289068477953152
-
- NII Article ID
- 170000185061
-
- NII Book ID
- AA11464803
-
- ISSN
- 18827780
-
- Web Site
- http://id.nii.ac.jp/1001/00212129/
-
- Text Lang
- en
-
- Article Type
- article
-
- Data Source
-
- IRDB
- CiNii Articles