Multistage NN training experiment

Ideas for multistage NN training. There is some research on continuous learning without catastrophic forgetting . For example ANML: Learning to Continually Learn (ECAI 2020) arxiv code video The code for the paper is based on another one: OML (Online-aware Meta-learning) ~ NeurIPS19 code video OML paper derives some code from MAML: Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks pdf official tf code, also includes some links to other implementations....

January 1, 2020 · SergeM

MATLAB

fmincor( ponter to target function, initial point, list of constrains) - some improved gradient decent. Step is adaptive. useParallel - automatic parallel

November 18, 2013 · SergeM

Deep learning in computer vision (draft)

Draft An Overview of ResNet and its Variants, 2017

May 2, 1000 · SergeM