TY - JOUR
T1 - Constructing networks by filtering correlation matrices
T2 - A null model approach
AU - Kojaku, Sadamori
AU - Masuda, Naoki
N1 - Funding Information:
Data accessibility. This article has no additional data. Authors’ contributions. N.M. conceived and designed the research; S.K. and N.M. proposed the algorithm; S.K. performed the computational experiment; S.K. and N.M. wrote the paper. Competing interests. We declare we have no competing interests. Funding. N.M. acknowledges the support provided through JST, CREST, grant no. JPMJCR1304. Acknowledgements. The Standard & Poor’s 500 data were provided by CheckRisk LLP in the UK. We thank Yukie Sano for providing the Japanese stock data used in the present paper.
Publisher Copyright:
© 2019 The Author(s) Published by the Royal Society. All rights reserved.
PY - 2019/11/1
Y1 - 2019/11/1
N2 - Network analysis has been applied to various correlation matrix data. Thresholding on the value of the pairwise correlation is probably the most straightforward and common method to create a network from a correlation matrix. However, there have been criticisms on this thresholding approach such as an inability to filter out spurious correlations, which have led to proposals of alternative methods to overcome some of the problems. We propose a method to create networks from correlation matrices based on optimization with regularization, where we lay an edge between each pair of nodes if and only if the edge is unexpected from a null model. The proposed algorithm is advantageous in that it can be combined with different types of null models. Moreover, the algorithm can select the most plausible null model from a set of candidate null models using a model selection criterion. For three economic datasets, we find that the configuration model for correlation matrices is often preferred to standard null models. For country-level product export data, the present method better predicts main products exported from countries than sample correlation matrices do.
AB - Network analysis has been applied to various correlation matrix data. Thresholding on the value of the pairwise correlation is probably the most straightforward and common method to create a network from a correlation matrix. However, there have been criticisms on this thresholding approach such as an inability to filter out spurious correlations, which have led to proposals of alternative methods to overcome some of the problems. We propose a method to create networks from correlation matrices based on optimization with regularization, where we lay an edge between each pair of nodes if and only if the edge is unexpected from a null model. The proposed algorithm is advantageous in that it can be combined with different types of null models. Moreover, the algorithm can select the most plausible null model from a set of candidate null models using a model selection criterion. For three economic datasets, we find that the configuration model for correlation matrices is often preferred to standard null models. For country-level product export data, the present method better predicts main products exported from countries than sample correlation matrices do.
KW - Lasso
KW - Network inference
KW - Principle of maximum entropy
KW - Sparsity
KW - Thresholding
UR - http://www.scopus.com/inward/record.url?scp=85076211369&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076211369&partnerID=8YFLogxK
U2 - 10.6084/m9.figshare.c.4707266
DO - 10.6084/m9.figshare.c.4707266
M3 - Article
AN - SCOPUS:85076211369
SN - 1364-5021
VL - 475
JO - Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
JF - Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
IS - 2231
M1 - 20190578
ER -