Sparse regression and support recovery with L2-Boosting algorithms - INRAE - Institut national de recherche pour l’agriculture, l’alimentation et l’environnement Accéder directement au contenu
Article Dans Une Revue Journal of Statistical Planning and Inference Année : 2014

Sparse regression and support recovery with L2-Boosting algorithms

Résumé

This paper focuses on the analysis of L2L2-Boosting algorithms for linear regressions. Consistency results were obtained for high-dimensional models when the number of predictors grows exponentially with the sample size nn. We propose a new result for Weak Greedy Algorithms that deals with the support recovery, provided that reasonable assumptions on the regression parameter are fulfilled. For the sake of clarity, we also present some results in the deterministic case. Finally, we propose two multi-task versions of L2L2-Boosting for which we can extend these stability results, provided that assumptions on the restricted isometry of the representation and on the sparsity of the model are fulfilled. The interest of these two algorithms is demonstrated on various datasets.
Fichier non déposé

Dates et versions

hal-02639380 , version 1 (28-05-2020)

Identifiants

Citer

Magali Champion, Christine Cierco-Ayrolles, Sébastien Gadat, Matthieu Vignes. Sparse regression and support recovery with L2-Boosting algorithms. Journal of Statistical Planning and Inference, 2014, 155, pp.19-41. ⟨10.1016/j.jspi.2014.07.006⟩. ⟨hal-02639380⟩
17 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More