Mathematical Optimization for Data Science Group, Saarland University

Welcome to the homepage of the

Mathematical Optimization for Data Science Group

Department of Mathematics and Computer Science, Saarland University, Germany

Home
Teaching
Research
Publications
Job Offers

Saarland
University

Mathematics
and

Computer Science

Hierarchy of Localized Random Forests for Video Annotation

N.S. Nagaraja, P. Ochs, K. Liu and T. Brox

Abstract:
We address the problem of annotating a video sequence with partial supervision. Given the pixel-wise annotations in the first frame, we aim to propagate these labels ideally throughout the whole video. While some labels can be propagated using optical flow, disocclusion and unreliable flow in some areas require additional cues. To this end, we propose to train localized classifiers on the annotated frame. In con- trast to a global classifier, localized classifiers allow to distinguish colors that appear in both the foreground and the background but at very dif- ferent locations. We design a multi-scale hierarchy of localized random forests, which collectively takes a decision. Cues from optical flow and the classifier are combined in a variational framework. The approach can deal with multiple objects in a video. We present qualitative and quantitative results on the Berkeley Motion Segmentation Dataset.



pdf	Bibtex	Publisher's link

Citation:
N.S. Nagaraja, P. Ochs, K. Liu, T. Brox:
Hierarchy of Localized Random Forests for Video Annotation.

In A. Pinz, T. Pock, H. Bischof, F. Leberl (Eds.): Pattern Recognition (Proc. DAGM). Lecture Notes in Computer Science, Vol. 7476, Springer, 2012.

Bibtex:
@inproceedings{NOLB12, title = {Hierarchy of Localized Random Forests for Video Annotation}, author = {N.S. Nagaraja and P. Ochs and K. Liu and T. Brox}, year = {2012}, editor = {A. Pinz and T. Pock and H. Bischof and F. Leberl}, booktitle = {Pattern Recognition (Proc. DAGM)}, series = {Lecture Notes in Computer Science}, publisher = {Springer}, volume = {7476}, }

Impressum
Datenschutz