Applying mutual information to adaptive mixture models

Yang, Zheng Rong and Zwolinski, Mark (2000) Applying mutual information to adaptive mixture models. Meng, Helen, Leung, Kwong Sak and Chan, Lai-Wan (eds.) In Intelligent Data Engineering and Automated Learning - IDEAL 2000: Data Mining, Financial Engineering, and Intelligent Agents - 2nd International Conference, Proceedings. vol. 1983, Springer. pp. 250-255 .

Record type: Conference or Workshop Item (Paper)

Abstract

This paper presents a method for determine an optimal set of components for a density mixture model using mutual information. A component with small mutual information is believed to be independent from the rest components and to make a significant contribution to the system and hence cannot be removed. Whilst a component with large mutual information is believed to be unlikely independent from the rest components within a system and hence can be removed. Continuing removing components with positive mutual information till the system mutual information becomes non-positive will finally give rise to a parsimonious structure for a density mixture model. The method has been verified with several examples.

This record has no associated files available for download.

More information

Published date: 2000

Additional Information: Publisher Copyright: © Springer-Verlag Berlin Heidelberg 2000.

Venue - Dates: 2nd International Conference on Intelligent Data Engineering and Automated Learning, IDEAL 2000, , Shatin, N.T., Hong Kong, 2000-12-13 - 2000-12-15