MaxEnt upper bounds for the differential entropy of univariate continuous distributions

Author

Nielsen, Frank and Nock, Richard

Abstract

We present a series of closed-form upper bounds of the differential entropy of univariate continuous distributions based on the maximum entropy principle. We apply those bounds to Gaussian mixture models, and study their tightness properties.