Asymptotic bias in information estimates and the exponential (Bell) polynomials

Neural Comput. 2000 Dec;12(12):2797-804. doi: 10.1162/089976600300014728.

Abstract

We present a new derivation of the asymptotic correction for bias in the estimate of information from a finite sample. The new derivation reveals a relationship between information estimates and a sequence of polynomials with combinatorial significance, the exponential (Bell) polynomials, and helps to provide an understanding of the form and behavior of the asymptotic correction for bias.

Publication types

  • Research Support, U.S. Gov't, P.H.S.

MeSH terms

  • Algorithms
  • Artificial Intelligence
  • Bias*
  • Models, Neurological*
  • Probability