Built independently by an author, for readers. Read the story and support ChapterPal

keyword

dynamic structure reorganization

Dynamic structure reorganization is a machine learning process in which an artificial neural network dynamically alters, expands, or reconfigures its internal architecture during training to learn new information while preserving previously acquired knowledge. In continual and incremental learning environments, standard models with fixed architectures often suffer from catastrophic forgetting when updated solely on new data streams. Dynamic structure reorganization mitigates this issue by adaptively adjusting the network topology, such as by expanding feature branches, integrating auxiliary pathways, and selectively updating or freezing specific sub-networks. This adaptive mechanism enables the model to balance plasticity for learning novel classes or tasks with stability for retaining historical feature representations without requiring retraining on old data.

1 item

Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning

Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning

Kai Zhu, Wei Zhai, Yang Cao, Jiebo Luo, Zhengjun Zha

OrganizationsInstitute of Artificial Intelligence, Hefei Comprehensive National Science CenterUniversity of RochesterUniversity of Science and Technology of China

Why you should read this

Develops a self-sustaining representation expansion framework for non-exemplar class-incremental learning that prevents catastrophic forgetting and parameter explosion by dynamically reorganizing network structures and selectively distilling knowledge using new class prototypes.

Non-exemplar class-incremental learning is to recognize both the old and new classes when old class samples cannot be saved. It is a challenging task since representation optimization and feature retention can only be achieved under supervision from new classes. To address this problem, we propose a novel self-sustaining representation expansion scheme. Our scheme consists of a structure reorganization strategy that fuses main-branch expansion and side-branch updating to maintain the old features, and a main-branch distillation scheme to transfer the invariant knowledge. Furthermore, a prototype selection mechanism is proposed to enhance the discrimination between the old and new classes by selectively incorporating new samples into the distillation process. Extensive experiments on three benchmarks demonstrate significant incremental performance, outperforming the state-of-the-art methods by a margin of 3%, 3% and 6%, respectively.

Added

2026-09-26