elastic-weight-consolidation

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

A flexible, adaptive classification system for dynamic text classification

Continual learning baselines and strategies from popular papers, using Avalanche. We include EWC, SI, GEM, AGEM, LwF, iCarl, GDumb, and other strategies.

A brain-inspired version of generative replay for continual learning with deep neural networks (e.g., class-incremental learning on CIFAR-100; PyTorch code).

Continual Hyperparameter Selection Framework. Compares 11 state-of-the-art Lifelong Learning methods and 4 baselines. Official Codebase of "A continual learning survey: Defying forgetting in classification tasks." in IEEE TPAMI.

Elastic weight consolidation technique for incremental learning.

PyTorch implementation of a VAE-based generative classifier, as well as other class-incremental learning methods that do not store data (DGR, BI-R, EWC, SI, CWR, CWR+, AR1, the "labels trick", SLDA).

#WORK IN PROGRESS PyTorch Implementation of Supervised and Deep Q-Learning EWC(Elastic Weight Consolidation), introduced in "Overcoming Catastrophic Forgetting in Neural Networks"

GenPark AI Agent Skill - Elastic Weight Consolidation (EWC) engine calculating Fisher Information Matrix diagonal penalties to prevent catastrophic forgetting during sequential task learning.

GenPark AI Agent Skill - Gradient Episodic Memory (GEM / A-GEM) projection engine constraining parameter updates to prevent interference with past task gradients.

GenPark AI Agent Skill - Elastic Weight Consolidation (EWC) engine calculating Fisher Information Matrix diagonal penalties to prevent catastrophic forgetting during sequential task learning.

GenPark AI Agent Skill - Gradient Episodic Memory (GEM / A-GEM) projection engine constraining parameter updates to prevent interference with past task gradients.

GenPark AI Agent Skill - Continual learning experience replay buffer with streaming reservoir sampling and priority weighting to balance past vs new agent trajectories.

GenPark AI Agent Skill - Continual learning experience replay buffer with streaming reservoir sampling and priority weighting to balance past vs new agent trajectories.

GenPark AI Agent Skill - Knowledge distillation teacher-student loss engine with temperature-scaled Kullback-Leibler divergence for continual model compression and capability preservation.

GenPark AI Agent Skill - Synaptic Intelligence (SI) online path integral engine accumulating parameter trajectory contributions to protect vital synaptic pathways across tasks.

GenPark AI Agent Skill - Synaptic Intelligence (SI) online path integral engine accumulating parameter trajectory contributions to protect vital synaptic pathways across tasks.

comparative evaluation of incremental machine learning methods

Tensorflow 1.x implementation of EWC, evaluated on permuted MNIST

implementation of some classical CL methods using deepseed