Brunel University Research Archive (BURA) >
Schools >
School of Engineering and Design >
School of Engineering and Design Research papers >

Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/1822

Title: Incremental learning in terms of output attributes
Authors: Guan, SU
Li, P
Keywords: Incremental learning
Outputs
Neural networks
Supervised learning
Publication Date: 2004
Publisher: Freund & Pettman
Citation: Journal of Intelligent Systems. 13 (2) 95-122
Abstract: This paper deals with the situation where outputs are introduced to a neural network incrementally. Conventionally, when new outputs are introduced to a neural network, the old network would be discarded and a new network would be retrained to integrate the old knowledge with the new knowledge. However, this method is likely to waste much computation time due to the loss of learnt knowledge in the existing network. As such, how to integrate both old and new knowledge to form a single structure solution is our primary interest. In this paper, we present three Incremental Output Learning (IOL) algorithms for incremental output learning. When a new output is introduced to the original problem, a new sub-network is trained under IOL to acquire the new knowledge and the outputs from the new sub-network are integrated with the outputs of the existing network. The experimental results from several benchmarking datasets show that our methods are more effective and efficient than retraining.
URI: http://bura.brunel.ac.uk/handle/2438/1822
ISSN: 0334-1860
Appears in Collections:School of Engineering and Design Research papers
Electronic and Computer Engineering

Files in This Item:

File Description SizeFormat
Incremental Learning in Terms of Output Attributes.txt268 BTextView/Open

Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.

 


Library (c) Brunel University.    Powered By: DSpace
Send us your
Feedback. Last Updated: September 14, 2010.
Managed by:
Hassan Bhuiyan