Abstract
We present a confidence-based single-layer feed-forward learning algorithm SPIRAL
(Spike Regularized Adaptive Learning) relying on an encoding of activation
spikes. We adaptively update a weight vector relying on confidence estimates and
activation offsets relative to previous activity. We regularize updates proportionally
to item-level confidence and weight-specific support, loosely inspired by the observation
from neurophysiology that high spike rates are sometimes accompanied
by low temporal precision. Our experiments suggest that the new learning algorithm
SPIRAL is more robust and less prone to overfitting than both the averaged
perceptron and AROW.
(Spike Regularized Adaptive Learning) relying on an encoding of activation
spikes. We adaptively update a weight vector relying on confidence estimates and
activation offsets relative to previous activity. We regularize updates proportionally
to item-level confidence and weight-specific support, loosely inspired by the observation
from neurophysiology that high spike rates are sometimes accompanied
by low temporal precision. Our experiments suggest that the new learning algorithm
SPIRAL is more robust and less prone to overfitting than both the averaged
perceptron and AROW.
| Original language | English |
|---|---|
| Title of host publication | ESANN 2017 - Proceedings : 25th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning |
| Number of pages | 6 |
| Publisher | ESANN |
| Publication date | 2017 |
| Pages | 371-376 |
| ISBN (Print) | 978-287587039-1 |
| Publication status | Published - 2017 |
| Event | 25th European Symposium on Artificial Neural Networks, omputational Intelligence and Machine Learning - Bruges, Belgium Duration: 26 Apr 2017 → 28 Apr 2017 |
Conference
| Conference | 25th European Symposium on Artificial Neural Networks, omputational Intelligence and Machine Learning |
|---|---|
| Country/Territory | Belgium |
| City | Bruges |
| Period | 26/04/2017 → 28/04/2017 |
| Series | arXiv.org |
|---|