TY - GEN
T1 - Relationship Between Intrinsic Randomness with f-Divergence and Fixed-Length Source Coding
AU - Nomura, Ryo
N1 - Funding Information:
This work is supported in part by JSPS KAKENHI Grant Number JP18K04150 and JP22K04111, and Waseda University Grant for Special Research Projects (Project number: 2022C-312).
Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - This paper deals with the relationship between the intrinsic randomness (IR) problem and the fixed-length source coding problem. The IR problem is one of random number generation problems and optimum achievable rates (optimum IR rate) with respect to several approximation measures such as the variational distance, the Kullback-Leibler (KL) divergence and f-divergences, have been investigated. In particular, it has been shown that the optimum IR rate with respect to the variational distance has a close relationship with the supremum of the unachievable rate in the source coding problem. Inspired by this result, in this paper, we consider the optimum IR rate with respect to a subclass of f-divergences and try to show a relationship with the unachievable rate in the source coding problem. The subclass of f-divergences considered in this paper includes several well-known measures, such as the variational distance, the KL divergence, the Hellinger distance. We also consider a class of normalized f-divergences, which includes the normalized KL divergence.
AB - This paper deals with the relationship between the intrinsic randomness (IR) problem and the fixed-length source coding problem. The IR problem is one of random number generation problems and optimum achievable rates (optimum IR rate) with respect to several approximation measures such as the variational distance, the Kullback-Leibler (KL) divergence and f-divergences, have been investigated. In particular, it has been shown that the optimum IR rate with respect to the variational distance has a close relationship with the supremum of the unachievable rate in the source coding problem. Inspired by this result, in this paper, we consider the optimum IR rate with respect to a subclass of f-divergences and try to show a relationship with the unachievable rate in the source coding problem. The subclass of f-divergences considered in this paper includes several well-known measures, such as the variational distance, the KL divergence, the Hellinger distance. We also consider a class of normalized f-divergences, which includes the normalized KL divergence.
KW - f-divergence
KW - Fixed-length coding
KW - General source
KW - Intrinsic randomness
KW - Random number generation
UR - http://www.scopus.com/inward/record.url?scp=85136265639&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85136265639&partnerID=8YFLogxK
U2 - 10.1109/ISIT50566.2022.9834820
DO - 10.1109/ISIT50566.2022.9834820
M3 - Conference contribution
AN - SCOPUS:85136265639
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 228
EP - 233
BT - 2022 IEEE International Symposium on Information Theory, ISIT 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 IEEE International Symposium on Information Theory, ISIT 2022
Y2 - 26 June 2022 through 1 July 2022
ER -