The SPARCS project : Statistical Physics Applied to Reconstruction in Compressed Sensing and Complex Systems

ERC funded Project, SPARCS 307087
Principal Invesigator: Florent Krzakala

Allerton 2015 : Communication, Control, and Computing, 2014 53th Annual Allerton Conference on
Harvard 2015 Conference on Big Data, August 24-26, 2015 | CMSA
ICML 2015 32nd International Conference on Machine Learning (ICML), 2015, 1123-1132
ISIT 2015 : IEEE International Symposium on Information Theory, Hong Kong, 2015.
ICASPP 2015 :International Conference on Acoustics, Speech, and Signal Processing (ICASSP) , Australia, 2015.
NIPS 2014 :Neural Information Processing Systems 2014, Montreal
ITWIST 2014 : international - Traveling Workshop on Interactions between Sparse models and Technology"
CCP 2014 :"XXVI IUPAP Conference on Computational Physics" Boston, USA
ISIT 2014 : IEEE International Symposium on Information Theory, Honolulu Hawai, 2014.
WARWICK 2013-14 : Warwick EPSRC Symposium on Statistical Mechanics: Phase transitions in discrete structures and computational problems
ICASPP 2014 :International Conference on Acoustics, Speech, and Signal Processing (ICASSP) , Florence - 31, 2014.
NIPS 2013 :Neural Information Processing Systems 2013, Lake Tahoe.
StatPhys 25 : International Conference on Statistical Physics.
SPARSE 2013 : Signal Processing with Adaptive Sparse Structured Representations 2013.
ITW 2013 : Information Theory Workshop Seville, September 9-13, 2013
ISIT 2013 : IEEE International Symposium on Information Theory, Istanbul, 2013.
ICC'13 :IEEE International Conference on Communications Workshops
ICASPP 2013 :International Conference on Acoustics, Speech, and Signal Processing (ICASSP) , Vancouver, Canada, on May 26 - 31, 2013.
Allerton 2012 : Communication, Control, and Computing, 2012 50th Annual Allerton Conference on

Published

[37] Spectral Detection on Sparse Hypergraphs
Maria Chiara Angelini, Francesco Caltagirone, Florent Krzakala, Lenka Zdeborova
Communication, Control, and Computing (Allerton), 2015 53th Conference on.
preprint arXiv:1507.04113

[36] Minimal Mean Square Error of probabilistic low-rank matrix estimation: Universality with respect to the o\ utput channel
Thibault Lesieur, Florent Krzakala, Lenka Zdeborova
Communication, Control, and Computing (Allerton), 2015 53th Conference on.
preprint arXiv:1507.03857

[35] Matrix Completion from Fewer Entries: Spectral Detectability and Rank Estimation
A. Saade, F. Krzakala and L. Zdeborova
preprint a\ rXiv:1506.03498

[34] Training Restricted Boltzmann Machines via the Thouless-Anderson-Palmer Free Energy
Marylou Gabrié, Eric W. Tramel and Florent Krzakala
preprint arXiv:1506.02914

[33] Approximate message-passing decoder and capacity-achieving sparse superposition codes
Jean Barbier and Florent Krzakala
preprint arXiv:1503.05040

[32] Phase Transitions in Sparse PCA
Thibault Lesieur, Florent Krzakala, Lenka Zdeborova
Information Theory Proceedings (ISIT), 2015 IEEE International Symposium on, page(s),preprint arXiv:1503.00338

[31] Approximate Message Passing with Restricted Boltzmann Machine Priors
Eric W. Tramel, Angélique Drémeau, Florent Krzakala
preprint arXiv:1502.06470

[30] Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques
Angélique Drémeau, Antoine Liutkus, David Martina, Ori Katz, Christophe Schulke, Florent Krzakala, Sylvain Gigan, Laurent Daudet
Optics Express Vol. 23, Issue 9, pp. 11898-11911 (2015), preprint arXiv:1502.03324

[29] Spectral Detection in the Censored Block Model
Alaa Saade, Florent Krzakala, Marc Lelarge, Lenka Zdeborova
Information Theory Proceedings (ISIT), 2015 IEEE International Symposium on, page(s), preprint arXiv:1502.00163

[28] Adaptive Damping and Mean Removal for the Generalized Approximate Message Passing Algorithm
Jeremy Vila, Philip Schniter, Sundeep Rangan, Florent Krzakala, Lenka Zdeborova
Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on Year: 2015 Pages: 2021 - 2025 preprint arXiv:1412.2005

[27] Phase recovery from a Bayesian point of view: the variational approach
Angélique Drémeau and Florent Krzakala
Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on Year: 2015 Pages: 3661- 3665preprint arXiv:1412.1368

[26] Sparse Estimation with the Swept Approximated Message-Passing Algorithm
Florent Krzakala, Andre Manoel, Eric W. Tramel, Lenka Zdeborova
Proceedings of the 32nd International Conference on Machine Learning (ICML), 2015, 1123-1132
preprint arXiv:1406.4311

[25] Spectral Clustering of Graphs with the Bethe Hessian
A. Saade, F. Krzakala and L. Zdeborova
Advances in Neural Information Processing Systems 27 (NIPS 2014), pp 5520 preprint arXiv:1406:1880

[24] Spectral density of the non-backtracking operator
A. Saade, F. Krzakala and L. Zdeborova,
2014 EPL 107 50005 preprint arXiv:1404.7787

[23] Replica Analysis and Approximate Message Passing Decoder for Superposition Codes
Jean Barbier and Florent Krzakala
Information Theory Proceedings (ISIT), 2014 IEEE International Symposium on, page(s) 1494 - 1498,preprint arXiv:1403.8024

[22] Variational Free Energies for Compressed Sensing
Florent Krzakala, Andre Manoel, Eric W. Tramel, Lenka Zdeborova
Information Theory Proceedings (ISIT), 2014 IEEE International Symposium on, page(s) 1499 - 1503, preprint http://arxiv.org/abs/1402.1384

[21] Phase transitions and sample complexity in Bayes-optimal matrix factorization
Yoshiyuki Kabashima, Florent Krzakala, Marc Mezard, Ayaka Sakata, Lenka Zdeborova
preprint http://arxiv.org/abs/1402.1298

[20] On Convergence of Approximate Message Passing
Francesco Caltagirone, Florent Krzakala, Lenka Zdeborova
Information Theory Proceedings (ISIT\ ), 2014 IEEE International Symposium on, page(s) 1812-1816, preprint http://arxiv.org/abs/1401.6384

[19] Compressed sensing and Approximate Message Passing with spatially-coupled Fourier and Hadamard matrices
Jean Barbier, Florent Krzakala, Christophe Schulke
J. Stat. Mech. (2015) P05013 preprint http://arxiv.org/abs/1312.1740

[18] Performance of simulated annealing in p-spin glasses
F. Krzakala and L. Zdeborova
J. Phys.: Conf. Ser. 473 012022 (2013),preprint: arXiv:1309.1736

[17] Belief-Propagation Guided Monte-Carlo Sampling
Aurelien Decelle and Florent Krzakala
Phys. Rev. B 89, 214421 (2014)
preprint: arXiv:1307.7846

[16] On Convergence of Approximate Message Passing
Jean Barbier and Florent Krzakala
2014 IEEE International Symposium on Information Theory (ISIT 2014)
preprint arXiv:1401.6384

[15] Variational Free Energies for Compressed Sensing
Florent Krzakala, Andre Manoel, Eric W. Tramel, Lenka Zdeborova
2014 IEEE International Symposium on Information Theory (ISIT 2014)
preprint arXiv:1403.1384

[14] Replica Analysis and Approximate Message Passing Decoder for Superposition Codes
Jean Barbier and Florent Krzakala
2014 IEEE International Symposium on Information Theory (ISIT 2014)
preprint arXiv:1403.8024

[13] Sparse representations in nested non-linear models
Angélique Drémeau, Patrick Héas et Cédric Herzet
IEEE International Conference On Acoustics, Speech and Signal Processing (ICASSP), Florence, Italie, Mai 4-9, 2014.

[12] Spectral Spatial Preprocessing Using Multihypothesis Prediction for Noise-Robust Hyperspectral Image Classification
Chen, C. Li, W. ; Tramel, E.W. ; Cui, M. ; Prasad, S. ; Fowler, J.E.
Selected Topics in Applied Earth Observations and Remote Sensing, IEEE Journal of

[11] Dynamics and termination cost of spatially coupled mean-field models
Francesco Caltagirone, Silvio Franz, Richard Morris, Lenka Zdeborová
Phys. Rev. E 89, 012102 (2014)
preprint http://arxiv.org/abs/1310.2121

[10] Spectral redemption: clustering sparse networks
F. Krzakala, C. Moore, E. Mossel, J. Neeman, A. Sly, L. Zdeborová and P. Zhang
Proceedings of the National Academy of Sciences 110, no. 52 (2013): 20935-20940
preprint http://arxiv.org/abs/1306.5550

[9] Blind Calibration in Compressed Sensing using Message Passing Algorithms
C. Schulke and F. Caltagirone, F. Krzakala, L. Zdeborová
NIPS Conference, Lake Tahoe (2013)
preprint http://arxiv.org/abs/1306.4355

[8] The hard-core model on random graphs revisited
Jean Barbier, Florent Krzakala, Lenka Zdeborova, Pan Zhang
J. Phys.: Conf. Ser. 473 012021 (2013)
preprint: arXiv:1306.4121

[7] Performance of simulated annealing in p-spin glasses
F. Krzakala and L. Zdeborova
J. Phys.: Conf. Ser. 473 012022 (2013)
preprint: arXiv:1309.1736

[6] Robust error correction for real-valued signals via message-passing decoding and spatial coupling
J. Barbier, F. Krzakala; L. Zdeborová and P. Zhang
IEEE Information Theory Workshop (ITW 2013), 1-5 (2013)
preprint http://arxiv.org/abs/1304.6599

[5] Non-adaptive pooling strategies for detection of rare faulty items
Pan Zhang, F. Krzakala, M. Mezard and L. Zdeborova
EEE International Conference on Communications Workshops (ICC 2013)
preprint http://arxiv.org/abs/1302.0189

[4] Phase Diagram and Approximate Message Passing for Blind Calibration and Dictionary Learning
F. Krzakala, M. Mezard and L. Zdeborova
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on, page(s) 659 - 663
preprint http://arxiv.org/abs/1301.5898

[3] Compressed Sensing under Matrix Uncertainty: Optimum Thresholds and Robust Approximate Message Passing
F. Krzakala, M. Mezard and L. Zdeborova
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 5519 - 5523
preprint http://arxiv.org/abs/1301.0901

[2] Belief Propagation Reconstruction for Discrete Tomography Model
Emmanuelle Gouillart, Florent Krzakala, Marc Mezard and Lenka Zdeborova
Inverse Problems 29 (2013) 035003 preprint http://arxiv.org/abs/1211.2379
Selected in the Research insights of Inverse problems.

[1] Compressed Sensing of Approximately-Sparse Signals: Phase Transitions and Optimal Reconstruction
J. Barbier, F. Krzakala, M. Mézard and L. Zdeborová
Communication, Control, and Computing (Allerton), 2012 50th Annual Alle\ rton Conference on. 1-5 Oct. 2012, Page(s): 800 - 807 preprint http://arxiv.org/abs/1207.2079



Unpublished (Yet!)

Spectral Clustering of Graphs with the Bethe Hessian
A. Saade, F. Krzakala and L. Zdeborova
preprint arXiv:1406:1880

Spectral density of the non-backtracking operator
A. Saade, F. Krzakala and L. Zdeborova,
preprint arXiv:1404.7787

Sparse Estimation with the Swept Approximated Message-Passing Algorithm
Florent Krzakala, Andre Manoel, Eric W. Tramel, Lenka Zdeborova
preprint arXiv:1406.4311

Phase transitions and sample complexity in Bayes-optimal matrix factorization
Yoshiyuki Kabashima, Florent Krzakala, Marc Mézard, Ayaka Sakata, Lenka Zdeborová
preprint : arXiv:1402.1298

Properties of spatial coupling in compressed sensing
Francesco Caltagirone, Lenka Zdeborová
preprint : arXiv:1401.6380

Compressed sensing and Approximate Message Passing with spatially-coupled Fourier and Hadamard matrices
Jean Barbier, Florent Krzakala, Christophe Schulke
preprint : arXiv:1312.1740



The milestone papers on which SPARCS was built

Statistical physics-based reconstruction in compressed sensing
F. Krzakala, M. Mézard, F. Sausset, Y.F. Sun, Lenka Zdeborová
Phys. Rev. X 2, 021005 (2012) , preprint http://arxiv.org/abs/1109.4424

Probabilistic Reconstruction in Compressed Sensing: Algorithms, Phase Diagrams, and Threshold Achieving Matrices
F. Krzakala, M. Mézard, F. Sausset, Y.F. Sun, Lenka Zdeborová
J. Stat. Mech. (2012) P08009 preprint http://arxiv.org/abs/1206.3953