Abstract
We start by demonstrating that an elementary learning task—learning a linear filter
from training data by means of regression—can be solved very efficiently for feature
spaces of very high dimensionality. In a second step, firstly, acknowledging that such
high-dimensional learning tasks typically benefit from some form of regularization and,
secondly, arguing that the problem of scale has not been taken care of in a very satis-
factory manner, we come to a combined resolution of both of these shortcomings by
proposing a technique that we coin scale regularization. This regularization problem can
also be solved relatively efficient. All in all, the idea is to properly control the scale of a
trained filter, which we solve by introducing a specific regularization term into the overall
objective function. We demonstrate, on an artificial filter learning problem, the capabil-
ities of our basic filter. In particular, we demonstrate that it clearly outperforms the de
facto standard Tikhonov regularization, which is the one employed in ridge regression or
Wiener filtering.
from training data by means of regression—can be solved very efficiently for feature
spaces of very high dimensionality. In a second step, firstly, acknowledging that such
high-dimensional learning tasks typically benefit from some form of regularization and,
secondly, arguing that the problem of scale has not been taken care of in a very satis-
factory manner, we come to a combined resolution of both of these shortcomings by
proposing a technique that we coin scale regularization. This regularization problem can
also be solved relatively efficient. All in all, the idea is to properly control the scale of a
trained filter, which we solve by introducing a specific regularization term into the overall
objective function. We demonstrate, on an artificial filter learning problem, the capabil-
ities of our basic filter. In particular, we demonstrate that it clearly outperforms the de
facto standard Tikhonov regularization, which is the one employed in ridge regression or
Wiener filtering.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of BMVC 2017 |
| Number of pages | 12 |
| Publisher | British Machine Vision Conference |
| Publication date | Jul 2017 |
| Publication status | Published - Jul 2017 |
| Event | British Machine Vision Conference 2017 - Imperial College London, London, United Kingdom Duration: 4 Sept 2017 → 7 Sept 2017 https://bmvc2017.london/ |
Conference
| Conference | British Machine Vision Conference 2017 |
|---|---|
| Location | Imperial College London |
| Country/Territory | United Kingdom |
| City | London |
| Period | 04/09/2017 → 07/09/2017 |
| Internet address |