Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/3508
Title: | On defining partition entropy by inequalities |
Authors: | Luo, P Zhan, G He, Q Shi, Z Lü, K |
Keywords: | Terms—Conditional entropy, inequality, partition entropy, uncertainty. |
Issue Date: | 2007 |
Publisher: | IEEE |
Citation: | Transactions on Information Theory, 53 (9):3233-3239 |
Abstract: | Partition entropy is the numerical metric of uncertainty within a partition of a finite set, while conditional entropy measures the degree of difficulty in predicting a decision partition when a condition partition is provided. Since two direct methods exist for defining conditional entropy based on its partition entropy, the inequality postulates of monotonicity, which conditional entropy satisfies, are actually additional constraints on its entropy. Thus, in this paper partition entropy is defined as a function of probability distribution, satisfying all the inequalities of not only partition entropy itself but also its conditional counterpart. These inequality postulates formalize the intuitive understandings of uncertainty contained in partitions of finite sets.We study the relationships between these inequalities, and reduce the redundancies among them. According to two different definitions of conditional entropy from its partition entropy, the convenient and unified checking conditions for any partition entropy are presented, respectively. These properties generalize and illuminate the common nature of all partition entropies. |
URI: | http://bura.brunel.ac.uk/handle/2438/3508 |
Appears in Collections: | Business and Management Brunel Business School Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Fulltext.pdf | 254.58 kB | Adobe PDF | View/Open |
Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.