Adaptively Growing Hierarchical Mixtures of Experts
Conference Paper, Proceedings of (NeurIPS) Neural Information Processing Systems, pp. 459 - 465, December, 1996
Abstract
We propose a novel approach to automatically growing and pruning Hierarchical Mixtures of Experts. The constructive algorithm proposed here enables large hierarchies consisting of several hundred experts to be trained effectively. We show that HME's trained by our automatic growing procedure yield better generalization performance than traditional static and balanced hierarchies. Evaluation of the algorithm is performed (1) on vowel classification and (2) within a hybrid version of the JANUS [9] speech recognition system using a subset of the Switchboard large-vocabulary speaker-independent continuous speech recognition database.
BibTeX
@conference{Fritsch-1996-16272,author = {Jurgen Fritsch and Michael Finke and Alex Waibel},
title = {Adaptively Growing Hierarchical Mixtures of Experts},
booktitle = {Proceedings of (NeurIPS) Neural Information Processing Systems},
year = {1996},
month = {December},
pages = {459 - 465},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.