Kamimura, R., Kamimura, T.,
& Shultz, T. R. (2001). Information
theoretic competitive learning and linguistic rule acquisition. Transactions
of the Japanese Society for Artificial Intelligence, 16, 287-298.
In this paper, we propose a new information theoretic method for competitive learning, and demonstrate that it can discover some linguistic rules in unsupervised ways more explicitly than the traditional competitive method. The new method can directly control competitive unit activation patterns to which input-competitive connections are adjusted. This direct control of the activation patterns permits considerable flexibility for connections, and shows the ability to detect salient features not captured by the traditional competitive method. We applied the new method to a linguistic rule acquisition problem. In this problem, unsupervised methods are needed because children learn rules without any explicit instruction. Our results confirmed that the new method can give similar results as those by the traditional competitive method when input data are appropriately coded. However, we could see that when unnecessary information is given to a network, the new method can filter it out, while the performance of the traditional method is degraded by unnecessary information. Because data in actual cognitive and engineering problems usually contain redundant and unnecessary information, the new method has good potential for discovering regularity in actual problems.
Abstracts, papers, chapters, and other documents are posted on this site as an efficient way to distribute reprints. The respective authors and publishers of these works retain all of the copyrights to this material. Anyone copying, downloading, bookmarking, or printing any of these materials agrees to comply with all of the copyright terms. Other than having an electronic or printed copy for fair personal use, none of these works may be reposted, reprinted, or redistributed without the explicit permission of the relevant copyright holders.
To obtain a PDF reprint of this particular article, signal your agreement with these copyright terms by clicking on the statement below.
I agree with all of these copyright terms PDF 454KB