Matching pursuit LASSO part I: sparse recovery over big dictionary

Abstract

Large-scale sparse recovery (SR) by solving -norm relaxations over Big Dictionary is a very challenging task. Plenty of greedy methods have therefore been proposed to address big SR problems, but most of them require restricted conditions for the convergence. Moreover, it is non-trivial for them to incorporate the -norm regularization that is required for robust signal recovery. We address these issues in this paper by proposing aMatching Pursuit LASSO (MPL) algorithm, based on a novel quadratically constrained linear program (QCLP) formulation, which has several advantages over existing methods. Firstly, it is guaranteed to converge to a global solution. Secondly, it greatly reduces the computation cost of the -norm methods over Big Dictionaries. Lastly, the exact sparse recovery condition of MPL is also investigated.