# American Institute of Mathematical Sciences

May  2019, 24(5): 2383-2405. doi: 10.3934/dcdsb.2019100

## Optimal control for cancer chemotherapy under tumor heterogeneity with Michealis-Menten pharmacodynamics

 1 Department of Mechanical and Aerospace Engineering, University of Texas at Arlington, Arlington, TX, 76010, USA 2 Dept. of Electrical and Systems Engineering, Washington University, St. Louis, Mo, 63130, USA

* Corresponding author: Heinz Schättler

Received  January 2018 Revised  January 2019 Published  March 2019

We analyze mathematical models for cancer chemotherapy under tumor heterogeneity as optimal control problems. Tumor heterogeneity is incorporated into the model through a potentially large number of states which represent sub-populations of tumor cells with different chemotherapeutic sensitivities. In this paper, a Michaelis-Menten type functional form is used to model the pharmacodynamic effects of the drug concentrations. In the objective, a weighted average of the tumor volume and the total amounts of drugs administered (taken as an indirect measurement for the side effects) is minimized. Mathematically, incorporating a Michaelis-Menten form creates a nonlinear structure in the controls with partial convexity properties in the Hamiltonian function for the optimal control problem. As a result, optimal controls are continuous and this fact can be utilized to set up an efficient numerical computation of extremals. Second order Jacobi type necessary and sufficient conditions for optimality are formulated that allow to verify the strong local optimality of numerically computed extremal controlled trajectories. Examples which illustrate the cases of both strong locally optimal and non-optimal extremals are given.

Citation: Shuo Wang, Heinz Schättler. Optimal control for cancer chemotherapy under tumor heterogeneity with Michealis-Menten pharmacodynamics. Discrete & Continuous Dynamical Systems - B, 2019, 24 (5) : 2383-2405. doi: 10.3934/dcdsb.2019100
##### References:

show all references

##### References:
A numerically computed extremal control (top row, left) for the effectiveness function $\varphi(x) = \frac{2}{1+x^2}$ (top row, right), weights $\alpha = (1, \ldots, 1)$, $\beta = 500\alpha$ and $\gamma = 5000$, and therapy horizon $T = 10$. The corresponding evolution of the individual cell populations is shown in the middle row (left) along with the evolution of the average of the populations (right). A comparison of the initial density $n(0, x)\equiv \frac{200}{21}$ and the terminal density $n(10, x)$ shown as red curve is given in the bottom row on the left. This control is a strong local minimum as the entries of the solution $S$ to the Riccati differential equation (13) along the extremal controlled trajectory (shown in the bottom row, right) remain finite over the full interval $[0, T]$
A numerically computed extremal control (top row, left) for the effectiveness function $\varphi_1$ and $\varphi_2$ given in (22), (top row, right), $\alpha = (1, \ldots, 1)$, $\beta = 50 \alpha$, $\gamma = (600, 1400)$ and time horizon $T = 10$. The corresponding evolution of the individual cell populations is shown in the middle row (left) along with the evolution of the average of the populations (right). A comparison of the initial density $n(0, x)\equiv \frac{200}{21}$ and the terminal density $n(10, x)$ shown as red curve is given in the bottom row on the left. This control is a strong local minimum as the entries of the solution $S$ to the Riccati differential equation (13) along the extremal controlled trajectory (shown in the bottom row, right) remain finite over the full interval $[0, T]$
A numerically computed extremal control (top row, left) for the effectiveness function $\varphi_1$ and $\varphi_2$ given in (23), (top row, right), $\alpha = (1, \ldots, 1)$, $\beta = 50 \alpha$, $\gamma = (600, 1400)$ and time horizon $T = 10$. The corresponding evolution of the individual cell populations is shown in the middle row (left) along with the evolution of the average of the populations (right). A comparison of the initial density $n(0, x)\equiv \frac{200}{21}$ and the terminal density $n(10, x)$ shown as red curve is given in the bottom row on the left. This control is not a strong local minimum as the entries of the solution $S$ to the Riccati differential equation (13) along the extremal controlled trajectory (shown in the bottom row, right) blow up in the interval
Examples of the system response, for the same parameters as in Fig. 3, for the constant controls $u_1 = 1$ and $u_2 = 2.5$
Illustration of the functions $\Upsilon$ (top, left), $\eta$ (top, right) and the full Hamiltonian $H$ (bottom) as function of the controls. These graphs depict the actual values for the solution shown in Fig. 6 below at the time $t = 19$
A numerically computed locally optimal control (top row, left) for $\alpha = (1, \ldots, 1)$, $\beta = 15 \alpha$, $\gamma = (90, 30)$ with therapy horizon $T = 20$ and effectiveness functions $\varphi_1 = \frac{2}{1+x^2}$ and $\varphi_2 = \frac{2}{1+3x^6}$ (top row, right). The corresponding evolution of the individual cell populations is shown in the middle row (left) along with the evolution of the average of the populations (right). A comparison of the initial density $n(0, x)\equiv \frac{200}{21}$ and the terminal density $n(20, x)$ shown as red curve is given in the bottom row on the left. This control is a strong local minimum as the entries of the solution $S$ to the Riccati differential equation (30) along the extremal controlled trajectory (shown in the bottom row, right) remain finite in the full interval $[0, 20]$
A numerically computed locally optimal control (top row, left) for α = (1, ...., 1), β = 15α, γ = (90, 30) with therapy horizon T = 20 and effectiveness functions ${\varphi _1}{\rm{ = }}\frac{2}{{1 + 5{x^2}}}$ and ${\varphi _2}{\rm{ = }}\frac{2}{{1 + 60{{\left( {1 - x} \right)}^6}}}$ (top row, right). The corresponding evolution of the individual cell populations is shown in the middle row (left) along with the evolution of the average of the populations (right). A comparison of the initial density n(0, x) ≡ $\frac{{200}}{{21}}$ and the terminal density n(20, x) shown as red curve is given in the bottom row on the left. This control is a strong local minimum as the entries of the solution S to the Riccati differential equation (30) along the extremal controlled trajectory (shown in the bottom row, right) blow up in the interval.
A numerically computed extremal control (top row, left) for α = (1, ..., 1), β = 15α, γ = (90, 30) with shortened therapy horizon T = 5 and effectiveness function ${\varphi _1}{\rm{ = }}\frac{2}{{1 + 5{x^2}}}$ and ${\varphi _2}{\rm{ = }}\frac{2}{{1 + 60{{\left( {1 - x} \right)}^6}}}$ (top row, right). The corresponding evolution of the individual cell populations is shown in the middle row (left) along with the evolution of the average of the populations (right). A comparison of the initial density n(0, x) ≡ $\frac{{200}}{{21}}$ and the terminal density n(5, x) shown as red curve is given in the bottom row on the left. This control still is a strong local minimum as the entries of the solution S to the Riccati differential equation (30) along the extremal controlled trajectory (shown in the bottom row, right) remain finite in the full interval [0, T].
Shooting Method
 Require: $N(t)>0$, $\forall t \in [0, T]$ and pick a threshold $\epsilon >0$. Ensure: optimal control   start with an initial guess $\lambda(0)$ and the stepsize $s=0.01$. while $\|\lambda(T)-\alpha\|>\epsilon$ do  solve $N, \; \lambda$.   $\lambda(0)\Leftarrow \lambda(0)-s\Big( \frac{\delta \lambda(T)}{\delta \lambda(0)}\Big) ^{-1} (\lambda(T)-\alpha)$ end while
 Require: $N(t)>0$, $\forall t \in [0, T]$ and pick a threshold $\epsilon >0$. Ensure: optimal control   start with an initial guess $\lambda(0)$ and the stepsize $s=0.01$. while $\|\lambda(T)-\alpha\|>\epsilon$ do  solve $N, \; \lambda$.   $\lambda(0)\Leftarrow \lambda(0)-s\Big( \frac{\delta \lambda(T)}{\delta \lambda(0)}\Big) ^{-1} (\lambda(T)-\alpha)$ end while
Iterative Method
 Require: $N(t)>0$, $\forall t \in [0, T]$ and pick a threshold $\epsilon >0$. Ensure: initial guess   Start with an initial trajectory $N^{(0)}$ and $k=1$. while $\|N^{(k)}-N^{(k-1)}\|>\epsilon$ do   $A^{(k-1)} \Leftarrow$ function of $N^{(k-1)}$   $O^{(k-1)} \Leftarrow$ function of $N^{(k-1)}$   Solve $S^{(k)}, \; \nu^{(k)}$ backward in time by assuming $\lambda^{(k)} = S^{(k)}N^{(k)}+\nu^{(k)}$.  Update $N^{(k)}$ forward in time:  $\qquad \dot{N}^{(k)} =[A^{(k-1)}+O^{(k-1)}S^{(k)}]N^{(k)}+O^{(k-1)}\nu^{(k)}$)  $u^{(k)} \Leftarrow$ function of $N^{(k)}$, $\lambda^{(k)}$  $k+1 \Leftarrow k$ end while
 Require: $N(t)>0$, $\forall t \in [0, T]$ and pick a threshold $\epsilon >0$. Ensure: initial guess   Start with an initial trajectory $N^{(0)}$ and $k=1$. while $\|N^{(k)}-N^{(k-1)}\|>\epsilon$ do   $A^{(k-1)} \Leftarrow$ function of $N^{(k-1)}$   $O^{(k-1)} \Leftarrow$ function of $N^{(k-1)}$   Solve $S^{(k)}, \; \nu^{(k)}$ backward in time by assuming $\lambda^{(k)} = S^{(k)}N^{(k)}+\nu^{(k)}$.  Update $N^{(k)}$ forward in time:  $\qquad \dot{N}^{(k)} =[A^{(k-1)}+O^{(k-1)}S^{(k)}]N^{(k)}+O^{(k-1)}\nu^{(k)}$)  $u^{(k)} \Leftarrow$ function of $N^{(k)}$, $\lambda^{(k)}$  $k+1 \Leftarrow k$ end while
 [1] Maciej Leszczyński, Urszula Ledzewicz, Heinz Schättler. Optimal control for a mathematical model for anti-angiogenic treatment with Michaelis-Menten pharmacodynamics. Discrete & Continuous Dynamical Systems - B, 2019, 24 (5) : 2315-2334. doi: 10.3934/dcdsb.2019097 [2] Urszula Ledzewicz, Helen Moore. Optimal control applied to a generalized Michaelis-Menten model of CML therapy. Discrete & Continuous Dynamical Systems - B, 2018, 23 (1) : 331-346. doi: 10.3934/dcdsb.2018022 [3] Karl Peter Hadeler. Michaelis-Menten kinetics, the operator-repressor system, and least squares approaches. Mathematical Biosciences & Engineering, 2013, 10 (5&6) : 1541-1560. doi: 10.3934/mbe.2013.10.1541 [4] Jagadeesh R. Sonnad, Chetan T. Goudar. Solution of the Michaelis-Menten equation using the decomposition method. Mathematical Biosciences & Engineering, 2009, 6 (1) : 173-188. doi: 10.3934/mbe.2009.6.173 [5] Shuo Wang, Heinz Schättler. Optimal control of a mathematical model for cancer chemotherapy under tumor heterogeneity. Mathematical Biosciences & Engineering, 2016, 13 (6) : 1223-1240. doi: 10.3934/mbe.2016040 [6] Urszula Ledzewicz, Heinz Schättler, Shuo Wang. On the role of tumor heterogeneity for optimal cancer chemotherapy. Networks & Heterogeneous Media, 2019, 14 (1) : 131-147. doi: 10.3934/nhm.2019007 [7] Jeng-Huei Chen. An analysis of functional curability on HIV infection models with Michaelis-Menten-type immune response and its generalization. Discrete & Continuous Dynamical Systems - B, 2017, 22 (6) : 2089-2120. doi: 10.3934/dcdsb.2017086 [8] Urszula Ledzewicz, Mohammad Naghnaeian, Heinz Schättler. Dynamics of tumor-immune interaction under treatment as an optimal control problem. Conference Publications, 2011, 2011 (Special) : 971-980. doi: 10.3934/proc.2011.2011.971 [9] Yangjin Kim, Khalid Boushaba. An enzyme kinetics model of tumor dormancy, regulation of secondary metastases. Discrete & Continuous Dynamical Systems - S, 2011, 4 (6) : 1465-1498. doi: 10.3934/dcdss.2011.4.1465 [10] Junyoung Jang, Kihoon Jang, Hee-Dae Kwon, Jeehyun Lee. Feedback control of an HBV model based on ensemble kalman filter and differential evolution. Mathematical Biosciences & Engineering, 2018, 15 (3) : 667-691. doi: 10.3934/mbe.2018030 [11] Arturo Alvarez-Arenas, Konstantin E. Starkov, Gabriel F. Calvo, Juan Belmonte-Beitia. Ultimate dynamics and optimal control of a multi-compartment model of tumor resistance to chemotherapy. Discrete & Continuous Dynamical Systems - B, 2019, 24 (5) : 2017-2038. doi: 10.3934/dcdsb.2019082 [12] Michael Basin, Pablo Rodriguez-Ramirez. An optimal impulsive control regulator for linear systems. Numerical Algebra, Control & Optimization, 2011, 1 (2) : 275-282. doi: 10.3934/naco.2011.1.275 [13] Elena Goncharova, Maxim Staritsyn. Optimal control of dynamical systems with polynomial impulses. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4367-4384. doi: 10.3934/dcds.2015.35.4367 [14] Rein Luus. Optimal control of oscillatory systems by iterative dynamic programming. Journal of Industrial & Management Optimization, 2008, 4 (1) : 1-15. doi: 10.3934/jimo.2008.4.1 [15] Qiying Hu, Wuyi Yue. Optimal control for resource allocation in discrete event systems. Journal of Industrial & Management Optimization, 2006, 2 (1) : 63-80. doi: 10.3934/jimo.2006.2.63 [16] Simone Göttlich, Patrick Schindler. Optimal inflow control of production systems with finite buffers. Discrete & Continuous Dynamical Systems - B, 2015, 20 (1) : 107-127. doi: 10.3934/dcdsb.2015.20.107 [17] Leonardo Colombo, David Martín de Diego. Optimal control of underactuated mechanical systems with symmetries. Conference Publications, 2013, 2013 (special) : 149-158. doi: 10.3934/proc.2013.2013.149 [18] Urszula Ledzewicz, Stanislaw Walczak. Optimal control of systems governed by some elliptic equations. Discrete & Continuous Dynamical Systems - A, 1999, 5 (2) : 279-290. doi: 10.3934/dcds.1999.5.279 [19] Luca Galbusera, Sara Pasquali, Gianni Gilioli. Stability and optimal control for some classes of tritrophic systems. Mathematical Biosciences & Engineering, 2014, 11 (2) : 257-283. doi: 10.3934/mbe.2014.11.257 [20] Getachew K. Befekadu, Eduardo L. Pasiliao. On the hierarchical optimal control of a chain of distributed systems. Journal of Dynamics & Games, 2015, 2 (2) : 187-199. doi: 10.3934/jdg.2015.2.187

2018 Impact Factor: 1.008