A Class of Distortionless Codes Designed by Bayes Decision Theory

Research output: Contribution to journalArticlepeer-review

28 Citations (Scopus)


The problem of distortionless encoding when the parameters of the probabilistic model of a source are unknown is considered from a statistical decision theory point of view. A class of predictive and nonpredictive codes is proposed that are optimal within this framework. Specifically, it is shown that the codeword length of the proposed predictive code coincides with that of the proposed nonpredictive code for any source sequence. A bound for the redundancy for universal coding is given in terms of the supremum of the Bayes risk. If this supremum exists, then there exists a minimax code whose mean code length approaches it in the proposed class of codes, and the minimax code is given by the Bayes solution relative to the prior distribution of the source parameters that maximizes the Bayes risk.

Original languageEnglish
Pages (from-to)1288-1293
Number of pages6
JournalIEEE Transactions on Information Theory
Issue number5
Publication statusPublished - 1991 Sept


  • Bayes principle
  • Source coding
  • and nonpredictive coding
  • decision theory. universal code
  • mean-code length
  • minimax principle
  • predictive coding

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences


Dive into the research topics of 'A Class of Distortionless Codes Designed by Bayes Decision Theory'. Together they form a unique fingerprint.

Cite this