# American Institute of Mathematical Sciences

November  2007, 1(4): 673-690. doi: 10.3934/ipi.2007.1.673

## On the application of projection methods for computing optical flow fields

 1 Fakultät für Maschinenbau, Helmut--Schmidt--Universität, Holstenhofweg 85, 22043 Hamburg, Germany 2 Fakultät für Mathematik und Informatik, Universität des Saarlandes, Geb. E1.1, 66041 Saarbrücken, Germany

Received  May 2007 Published  October 2007

Detecting optical flow means to find the apparent displacement field in a sequence of images. As starting point for many optical flow methods serves the so called optical flow constraint (OFC), that is the assumption that the gray value of a moving point does not change over time. Variational methods are amongst the most popular tools to compute the optical flow field. They compute the flow field as minimizer of an energy functional that consists of a data term to comply with the OFC and a smoothness term to obtain uniqueness of this underdetermined problem. In this article we replace the smoothness term by projecting the solution to a finite dimensional, affine subspace in the spatial variables which leads to a smoothing and gives a unique solution as well. We explain the mathematical details for the quadratic and nonquadratic minimization framework, and show how alternative model assumptions such as constancy of the brightness gradient can be incorporated. As basis functions we consider tensor products of B-splines. Under certain smoothness assumptions for the global minimizer in Sobolev scales, we prove optimal convergence rates in terms of the energy functional. Experiments are presented that demonstrate the feasibility of our approach.
Citation: Thomas Schuster, Joachim Weickert. On the application of projection methods for computing optical flow fields. Inverse Problems & Imaging, 2007, 1 (4) : 673-690. doi: 10.3934/ipi.2007.1.673
 [1] Richard A. Norton, David I. McLaren, G. R. W. Quispel, Ari Stern, Antonella Zanna. Projection methods and discrete gradient methods for preserving first integrals of ODEs. Discrete & Continuous Dynamical Systems - A, 2015, 35 (5) : 2079-2098. doi: 10.3934/dcds.2015.35.2079 [2] Dang Van Hieu. Projection methods for solving split equilibrium problems. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-19. doi: 10.3934/jimo.2019056 [3] Jae-Hong Pyo, Jie Shen. Normal mode analysis of second-order projection methods for incompressible flows. Discrete & Continuous Dynamical Systems - B, 2005, 5 (3) : 817-840. doi: 10.3934/dcdsb.2005.5.817 [4] Lori Badea. Multigrid methods for some quasi-variational inequalities. Discrete & Continuous Dynamical Systems - S, 2013, 6 (6) : 1457-1471. doi: 10.3934/dcdss.2013.6.1457 [5] Zalman Balanov, Carlos García-Azpeitia, Wieslaw Krawcewicz. On variational and topological methods in nonlinear difference equations. Communications on Pure & Applied Analysis, 2018, 17 (6) : 2813-2844. doi: 10.3934/cpaa.2018133 [6] Stefan Klus, Christof Schütte. Towards tensor-based methods for the numerical approximation of the Perron--Frobenius and Koopman operator. Journal of Computational Dynamics, 2016, 3 (2) : 139-161. doi: 10.3934/jcd.2016007 [7] A. Pedas, G. Vainikko. Smoothing transformation and piecewise polynomial projection methods for weakly singular Fredholm integral equations. Communications on Pure & Applied Analysis, 2006, 5 (2) : 395-413. doi: 10.3934/cpaa.2006.5.395 [8] Philippe Angot, Pierre Fabrie. Convergence results for the vector penalty-projection and two-step artificial compressibility methods. Discrete & Continuous Dynamical Systems - B, 2012, 17 (5) : 1383-1405. doi: 10.3934/dcdsb.2012.17.1383 [9] Julian Koellermeier, Roman Pascal Schaerer, Manuel Torrilhon. A framework for hyperbolic approximation of kinetic equations using quadrature-based projection methods. Kinetic & Related Models, 2014, 7 (3) : 531-549. doi: 10.3934/krm.2014.7.531 [10] O. Chadli, Z. Chbani, H. Riahi. Recession methods for equilibrium problems and applications to variational and hemivariational inequalities. Discrete & Continuous Dynamical Systems - A, 1999, 5 (1) : 185-196. doi: 10.3934/dcds.1999.5.185 [11] Raffaella Servadei, Enrico Valdinoci. Variational methods for non-local operators of elliptic type. Discrete & Continuous Dynamical Systems - A, 2013, 33 (5) : 2105-2137. doi: 10.3934/dcds.2013.33.2105 [12] Michał Jóźwikowski, Mikołaj Rotkiewicz. Bundle-theoretic methods for higher-order variational calculus. Journal of Geometric Mechanics, 2014, 6 (1) : 99-120. doi: 10.3934/jgm.2014.6.99 [13] T. Diogo, N. B. Franco, P. Lima. High order product integration methods for a Volterra integral equation with logarithmic singular kernel. Communications on Pure & Applied Analysis, 2004, 3 (2) : 217-235. doi: 10.3934/cpaa.2004.3.217 [14] Zhangxin Chen. On the control volume finite element methods and their applications to multiphase flow. Networks & Heterogeneous Media, 2006, 1 (4) : 689-706. doi: 10.3934/nhm.2006.1.689 [15] Zaihui Gan. Cross-constrained variational methods for the nonlinear Klein-Gordon equations with an inverse square potential. Communications on Pure & Applied Analysis, 2009, 8 (5) : 1541-1554. doi: 10.3934/cpaa.2009.8.1541 [16] Shixiu Zheng, Zhilei Xu, Huan Yang, Jintao Song, Zhenkuan Pan. Comparisons of different methods for balanced data classification under the discrete non-local total variational framework. Mathematical Foundations of Computing, 2019, 2 (1) : 11-28. doi: 10.3934/mfc.2019002 [17] Lukas F. Lang, Otmar Scherzer. Optical flow on evolving sphere-like surfaces. Inverse Problems & Imaging, 2017, 11 (2) : 305-338. doi: 10.3934/ipi.2017015 [18] Aniello Raffaele Patrone, Otmar Scherzer. On a spatial-temporal decomposition of optical flow. Inverse Problems & Imaging, 2017, 11 (4) : 761-781. doi: 10.3934/ipi.2017036 [19] H. M. Hastings, S. Silberger, M. T. Weiss, Y. Wu. A twisted tensor product on symbolic dynamical systems and the Ashley's problem. Discrete & Continuous Dynamical Systems - A, 2003, 9 (3) : 549-558. doi: 10.3934/dcds.2003.9.549 [20] Qingzhi Yang. The revisit of a projection algorithm with variable steps for variational inequalities. Journal of Industrial & Management Optimization, 2005, 1 (2) : 211-217. doi: 10.3934/jimo.2005.1.211

2018 Impact Factor: 1.469