continual learning
- Neural networks need sleep
We borrowed neurons from the brain and left out sleep. In a toy test, a network that prunes and dreams every night keeps its old task at 96%. One that studies all night falls to 68%.
We borrowed neurons from the brain and left out sleep. In a toy test, a network that prunes and dreams every night keeps its old task at 96%. One that studies all night falls to 68%.