TV-L1 optical flow for vector valued images

Lars Lau Rakêt; Lars Roholm; Mads Nielsen; Francois Bernard Lauze

doi:10.1007/978-3-642-23094-3_24

TV-L¹ optical flow for vector valued images

Lars Lau Rakêt, Lars Roholm, Mads Nielsen, Francois Bernard Lauze

Datalogisk Institut

16 Citationer (Scopus)

Abstract

The variational TV-L1 framework has become one of the most popular and successful approaches for calculating optical flow. One reason for the popularity is the very appealing properties of the two terms in the energy formulation of the problem, the robust L1-norm of the data fidelity term combined with the total variation (TV) regular- ization that smoothes the flow, but preserve strong discontinuities such as edges. Specifically the approach of Zach et al. [1] has provided a very clean and efficient algorithm for calculating TV-L1 optical flows between grayscale images. In this paper we propose a generalized algorithm that works on vector valued images, by means of a generalized projection step. We give examples of calculations of flows for a number of multi- dimensional constancy assumptions, e.g. gradient and RGB, and show how the developed methodology expands to any kind of vector valued images. The resulting algorithms have the same degree of parallelism as the case of one-dimensional images, and we have produced an efficient GPU implementation, that can take vector valued images with vectors of any dimension. Finally we demonstrate how these algorithms generally produce better flows than the original algorithm.

Originalsprog	Engelsk
Titel	Energy Minimization Methods in Computer Vision and Pattern Recognition : 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings
Redaktører	Yuri Boykov, Fredrik Kahl, Victor Lempitsky, Frank R. Schmidt
Antal sider	15
Forlag	Springer
Publikationsdato	2011
Sider	329-343
ISBN (Trykt)	978-3-642-23093-6
ISBN (Elektronisk)	978-3-642-23094-3
DOI	https://doi.org/10.1007/978-3-642-23094-3_24
Status	Udgivet - 2011
Begivenhed	8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition - Sankt Petersborg, Rusland Varighed: 25 jul. 2011 → 27 jul. 2011 Konferencens nummer: 8

Konference

Konference	8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Nummer	8
Land/Område	Rusland
By	Sankt Petersborg
Periode	25/07/2011 → 27/07/2011

Navn	Lecture notes in computer science
Vol/bind	6819
ISSN	0302-9743

Adgang til dokumentet

10.1007/978-3-642-23094-3_24

Citationsformater

Rakêt, L. L., Roholm, L., Nielsen, M., & Lauze, F. B. (2011). TV-L¹ optical flow for vector valued images. I Y. Boykov, F. Kahl, V. Lempitsky, & F. R. Schmidt (red.), Energy Minimization Methods in Computer Vision and Pattern Recognition: 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings (s. 329-343). Springer. https://doi.org/10.1007/978-3-642-23094-3_24

TV-L¹ optical flow for vector valued images. / Rakêt, Lars Lau; Roholm, Lars; Nielsen, Mads et al.
Energy Minimization Methods in Computer Vision and Pattern Recognition: 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings. red. / Yuri Boykov; Fredrik Kahl; Victor Lempitsky; Frank R. Schmidt. Springer, 2011. s. 329-343 (Lecture notes in computer science, Bind 6819).

Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › peer review

Rakêt, LL, Roholm, L, Nielsen, M & Lauze, FB 2011, TV-L¹ optical flow for vector valued images. i Y Boykov, F Kahl, V Lempitsky & FR Schmidt (red), Energy Minimization Methods in Computer Vision and Pattern Recognition: 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings. Springer, Lecture notes in computer science, bind 6819, s. 329-343, 8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition, Sankt Petersborg, Rusland, 25/07/2011. https://doi.org/10.1007/978-3-642-23094-3_24

Rakêt LL, Roholm L, Nielsen M , Lauze FB. TV-L¹ optical flow for vector valued images. I Boykov Y, Kahl F, Lempitsky V, Schmidt FR, red., Energy Minimization Methods in Computer Vision and Pattern Recognition: 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings. Springer. 2011. s. 329-343. (Lecture notes in computer science, Bind 6819). doi: 10.1007/978-3-642-23094-3_24

Rakêt, Lars Lau ; Roholm, Lars ; Nielsen, Mads et al. / TV-L¹ optical flow for vector valued images. Energy Minimization Methods in Computer Vision and Pattern Recognition: 8th International Conference, EMMCVPR 2011, St. Petersburg, Russia, July 25-27, 2011. Proceedings. red. / Yuri Boykov ; Fredrik Kahl ; Victor Lempitsky ; Frank R. Schmidt. Springer, 2011. s. 329-343 (Lecture notes in computer science, Bind 6819).

@inproceedings{b473b96daa554cbb8855f08cb58d0e1d,

title = "TV-L1 optical flow for vector valued images",

abstract = "The variational TV-L1 framework has become one of the most popular and successful approaches for calculating optical flow. One reason for the popularity is the very appealing properties of the two terms in the energy formulation of the problem, the robust L1-norm of the data fidelity term combined with the total variation (TV) regular- ization that smoothes the flow, but preserve strong discontinuities such as edges. Specifically the approach of Zach et al. [1] has provided a very clean and efficient algorithm for calculating TV-L1 optical flows between grayscale images. In this paper we propose a generalized algorithm that works on vector valued images, by means of a generalized projection step. We give examples of calculations of flows for a number of multi- dimensional constancy assumptions, e.g. gradient and RGB, and show how the developed methodology expands to any kind of vector valued images. The resulting algorithms have the same degree of parallelism as the case of one-dimensional images, and we have produced an efficient GPU implementation, that can take vector valued images with vectors of any dimension. Finally we demonstrate how these algorithms generally produce better flows than the original algorithm.",

author = "Rak{\^e}t, {Lars Lau} and Lars Roholm and Mads Nielsen and Lauze, {Francois Bernard}",

year = "2011",

doi = "10.1007/978-3-642-23094-3_24",

language = "English",

isbn = "978-3-642-23093-6",

series = "Lecture notes in computer science",

publisher = "Springer",

pages = "329--343",

editor = "Yuri Boykov and Fredrik Kahl and Victor Lempitsky and Schmidt, {Frank R.}",

booktitle = "Energy Minimization Methods in Computer Vision and Pattern Recognition",

note = "8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition ; Conference date: 25-07-2011 Through 27-07-2011",

}

TY - GEN

T1 - TV-L1 optical flow for vector valued images

AU - Rakêt, Lars Lau

AU - Roholm, Lars

AU - Nielsen, Mads

AU - Lauze, Francois Bernard

N1 - Conference code: 8

PY - 2011

Y1 - 2011

N2 - The variational TV-L1 framework has become one of the most popular and successful approaches for calculating optical flow. One reason for the popularity is the very appealing properties of the two terms in the energy formulation of the problem, the robust L1-norm of the data fidelity term combined with the total variation (TV) regular- ization that smoothes the flow, but preserve strong discontinuities such as edges. Specifically the approach of Zach et al. [1] has provided a very clean and efficient algorithm for calculating TV-L1 optical flows between grayscale images. In this paper we propose a generalized algorithm that works on vector valued images, by means of a generalized projection step. We give examples of calculations of flows for a number of multi- dimensional constancy assumptions, e.g. gradient and RGB, and show how the developed methodology expands to any kind of vector valued images. The resulting algorithms have the same degree of parallelism as the case of one-dimensional images, and we have produced an efficient GPU implementation, that can take vector valued images with vectors of any dimension. Finally we demonstrate how these algorithms generally produce better flows than the original algorithm.

AB - The variational TV-L1 framework has become one of the most popular and successful approaches for calculating optical flow. One reason for the popularity is the very appealing properties of the two terms in the energy formulation of the problem, the robust L1-norm of the data fidelity term combined with the total variation (TV) regular- ization that smoothes the flow, but preserve strong discontinuities such as edges. Specifically the approach of Zach et al. [1] has provided a very clean and efficient algorithm for calculating TV-L1 optical flows between grayscale images. In this paper we propose a generalized algorithm that works on vector valued images, by means of a generalized projection step. We give examples of calculations of flows for a number of multi- dimensional constancy assumptions, e.g. gradient and RGB, and show how the developed methodology expands to any kind of vector valued images. The resulting algorithms have the same degree of parallelism as the case of one-dimensional images, and we have produced an efficient GPU implementation, that can take vector valued images with vectors of any dimension. Finally we demonstrate how these algorithms generally produce better flows than the original algorithm.

U2 - 10.1007/978-3-642-23094-3_24

DO - 10.1007/978-3-642-23094-3_24

M3 - Article in proceedings

SN - 978-3-642-23093-6

T3 - Lecture notes in computer science

SP - 329

EP - 343

BT - Energy Minimization Methods in Computer Vision and Pattern Recognition

A2 - Boykov, Yuri

A2 - Kahl, Fredrik

A2 - Lempitsky, Victor

A2 - Schmidt, Frank R.

PB - Springer

T2 - 8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition

Y2 - 25 July 2011 through 27 July 2011