Progressive Neural Networks Hybrid Approaches Quiz
12 Questions
1 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is the main purpose of Memory-based methods in preventing catastrophic forgetting?

Rehearsing old samples stored in memory

What are the pros and cons of Architecture growing methods in preventing catastrophic forgetting?

Pros: Freezing some weights effectively copes with catastrophic forgetting. Cons: Scalability

Which method involves defining a new neural network ('column') per task and using lateral connections to exploit previous knowledge?

Progressive Neural Networks (PNN)

What are some considerations highlighted in the text regarding Memory-based methods?

<p>How to select which samples to store in memory</p> Signup and view all the answers

What is the main focus of the visual transformers approach DyTox?

<p>Parameter expansion in terms of tokens</p> Signup and view all the answers

How does Class Adaptive Aggregation (AANets) update different sets of parameters?

<p>Differently (plasticity/stability)</p> Signup and view all the answers

What is the goal of Gradient Episodic Memory (GEM) with respect to backward transfer?

<p>Enforces positive backward transfer via gradient agreement</p> Signup and view all the answers

What problem does Class-wise Decorrelation (CwD) aim to avoid in learning?

<p>Pathological base representations</p> Signup and view all the answers

What is the overall goal of weakly-supervised class-incremental learning for SiS models?

<p>Enabling SiS models to learn new visual categories over their lifetime</p> Signup and view all the answers

Name one crucial point in class-incremental learning highlighted in the text.

<p>Avoiding catastrophic forgetting</p> Signup and view all the answers

What type of annotations are typically used for base classes in weakly-supervised class-incremental learning?

<p>Dense annotations</p> Signup and view all the answers

In weakly-supervised class-incremental learning, what are the annotations like for new classes?

<p>Weak annotations</p> Signup and view all the answers

More Like This

Use Quizgecko on...
Browser
Browser