An Extended Occlusion Detection Approach for Video Processing
Abstract
Occlusions become conspicuous as failure regions in video processing when unified over time because the contraventions of the restriction of brightness have accumulated and evolved in occluded regions. The accuracy at the boundaries of the moving objects is one of the challenging areas that required further exploration and research. This paper presents the work in process approach that can detect occlusion regions by using pixel-wise coherence, segment-wise confidence and interpolation technique. Our method can get the same result as usual methods by solving only one Partial Differential Equations (PDE) problem; it is superior to existing methods because it is faster and provides better coverage rates for occlusion regions than variation techniques when tested against a varied number of benchmark datasets. With these improved results, we can apply and extend our approach to a wider range of applications in computer vision, such as background subtraction, tracking, 3D reconstruction, video surveillance, video compression.
Full Text:
PDFReferences
B. K. P. Horn, Ed., Robot Vision. Cambridge, MA, USA: MIT Press, 1986.
B. K. P. Horn and B. G. Schunck, “Determining optical flow,” Artif. Intell., vol. 17, pp. 185–203, 1981.
T. Brox and J. Malik, “Large displacement optical flow: Descriptor matching in variational motion estimation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 500–513, Mar. 2011.
T. Pock, M. Unger, D. Cremers, and H. Bischof, “Fast and exact solution of total variation models on the GPU.” IEEE, Jun. 2008, pp. 1–8.
A. Wedel, T. Pock, C. Zach, H. Bischof, and D. Cremers, “Statistical and geometrical approaches to visual motion analysis.” Berlin, Heidelberg: Springer-Verlag, 2009, ch. An Improved Algorithm for TV-L1 Optical Flow, pp. 23–45.
L. Xu, J. Jia, and Y. Matsushita, “Motion detail preserving optical flow estimation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1744–1757, Sep. 2012.
P. Weinzaepfel, J. Revaud, Z. Harchaoui, and C. Schmid, “Deepflow: Large displacement optical flow with deep matching,” in Proceedings of the 2013 IEEE International Conference on Computer Vision, ser. ICCV ’13. Washington, DC, USA: IEEE Computer Society, 2013, pp. 1385–1392.
L. Alvarez, R. Deriche, T. Papadopoulo, and J. S´anchez, “Symmetrical dense optical flow estimation with occlusions detection,” Int. J. Comput. Vision, vol. 75, no. 3, pp. 371–385, Dec. 2007.
J. Xiao, H. Cheng, H. Sawhney, C. Rao, and M. Isnardi, “Bilateral filtering-based optical flow estimation with occlusion detection,” in Proceedings of the 9th European Conference on Computer Vision - Volume Part I, ser. ECCV’06. Berlin, Heidelberg: Springer-Verlag, 2006, pp. 211–224.
S. Ince and J. Konrad, “Occlusion-aware optical flow estimation,” Trans. Img. Proc., vol. 17, no. 8, pp. 1443–1451, Aug. 2008.
V. Kolmogorov and R. Zabih, “Computing visual correspondence with occlusions using graph cuts,” in Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, vol. 2, 2001, pp. 508–515.
C. Strecha, R. Fransens, and L. Van Gool, A Probabilistic Approach to Large Displacement Optical Flow and Occlusion Detection. Berlin, Heidelberg: Springer Berlin Heidelberg, 2004, pp. 71–82.
A. Ayvaci, M. Raptis, and S. Soatto, “Sparse occlusion detection with optical flow,” Int. J. Comput. Vision, vol. 97, no. 3, pp. 322–338, May 2012.
A. Humayun, O. M. Aodha, and G. J. Brostow, “Learning to find occlusion regions,” in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, ser. CVPR ’11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 2161–2168.
M. Leordeanu, A. Zanfir, and C. Sminchisescu, “Locally affine sparseto-dense matching for motion and occlusion estimation,” in Proceedings of the 2013 IEEE International Conference on Computer Vision, ser. ICCV ’13. Washington, DC, USA: IEEE Computer Society, 2013, pp. 1721–1728.
C. Ballester, L. Garrido, V. Lazcano, and V. Caselles, A TV-L1 Optical Flow Method with Occlusion Detection. Berlin, Heidelberg: Springer Berlin Heidelberg, 2012, pp. 31–40.
M. J. Black and D. J. Fleet, “Probabilistic detection and tracking of motion boundaries,” Int. J. Comput. Vision, vol. 38, no. 3, pp. 231– 245, Jul. 2000.
M. E. Sargin, L. Bertelli, B. S. Manjunath, and K. Rose, “Probabilistic occlusion boundary detection on spatio-temporal lattices,” in 2009 IEEE 12th International Conference on Computer Vision, Sept 2009, pp. 560– 567.
A. N. Stein and M. Hebert, “Occlusion boundaries from motion: Lowlevel detection and mid-level reasoning,” Int. J. Comput. Vision, vol. 82, no. 3, pp. 325–357, May 2009.
A. Ayvaci and S. Soatto, “Motion segmentation with occlusions on the superpixel graph,” in 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Sept 2009, pp. 727–734.
P. Sundberg, T. Brox, M. Maire, P. Arbelaez, and J. Malik, “Occlusion boundary detection and figure/ground assignment from optical flow,” in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, ser. CVPR ’11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 2233–2240.
X. He and A. Yuille, “Occlusion boundary detection using pseudodepth,” in Proceedings of the 11th European Conference on Computer Vision: Part IV, ser. ECCV’10. Berlin, Heidelberg: Springer-Verlag, 2010, pp. 539–552.
P. Smith, T. Drummond, and R. Cipolla, “Layered motion segmentation and depth ordering by tracking edges,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 4, pp. 479–494, Apr. 2004.
J. D. Jackson, A. J. Yezzi, and S. Soatto, “Dynamic shape and appearance modeling via moving and deforming layers,” Int. J. Comput. Vision, vol. 79, no. 1, pp. 71–84, Aug. 2008.
M. J. Black, “Layered segmentation and optical flow estimation over time,” in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), ser. CVPR ’12. Washington, DC, USA: IEEE Computer Society, 2012, pp. 1768–1775.
J. Xiao and M. Shah, “Motion layer extraction in the presence of occlusion using graph cuts,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1644–1659, Oct. 2005.
A. Ayvaci and S. Soatto, “Detachable object detection with efficient model selection,” in Proceedings of the 8th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition, ser. EMMCVPR’11. Berlin, Heidelberg: Springer-Verlag, 2011, pp. 191–204.
C. Vogel, S. Roth, and K. Schindler, An Evaluation of Data Costs for Optical Flow. Berlin, Heidelberg: Springer Berlin Heidelberg, 2013, pp. 343–353.
V. Estellers and S. Soatto, “Detecting occlusions as an inverse problem,” J. Math. Imaging Vis., vol. 54, no. 2, pp. 181–198, Feb. 2016.
J. Shi and C. Tomasi, “Good features to track,” in Conference on Computer Vision and Pattern Recognition, CVPR 1994, 21-23 June, 1994, Seattle, WA, USA, 1994, pp. 593–600.
L. Xu, J. Chen, and J. Jia, “A segmentation based variational model for accurate optical flow estimation,” in Proceedings of the 10th European Conference on Computer Vision: Part I, ser. ECCV ’08. Berlin, Heidelberg: Springer-Verlag, 2008, pp. 671–684.
D. J. Butler, J. Wulff, G. B. Stanley, and M. J. Black, “A naturalistic open source movie for optical flow evaluation,” in Proceedings of the 12th European Conference on Computer Vision - Volume Part VI, ser. ECCV’12. Berlin, Heidelberg: Springer-Verlag, 2012, pp. 611–625.
M. Sokolova and G. Lapalme, “A systematic analysis of performance measures for classification tasks,” Information Processing and Management, vol. 45, no. 4, pp. 427 – 437, 2009.
T. Fawcett, “An introduction to roc analysis,” Pattern Recogn. Lett., vol. 27, no. 8, pp. 861–874, jun 2006.
D. M. W. Powers, “Evaluation: From precision, recall and f-measure to roc., informedness, markedness and correlation,” Journal of Machine Learning Technologies, vol. 2, no. 1, pp. 37–63, 2013.
C. J. van Rijsbergen, Information Retrieval. Butterworth, 1979.
DOI: http://dx.doi.org/10.21553/rev-jec.198
Copyright (c) 2018 REV Journal on Electronics and Communications
Copyright © 2011-2024 |
|
