Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems
Author :
Publisher : Springer Nature
Total Pages : 376
Release :
ISBN-10 : 9783030418465
ISBN-13 : 3030418464
Rating : 4/5 (464 Downloads)

Book Synopsis Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems by : Xi-Ren Cao

Download or read book Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems written by Xi-Ren Cao and published by Springer Nature. This book was released on 2020-05-13 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton–Jacobi–Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.


Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems Related Books

Relative Optimization of Continuous-Time and Continuous-State Stochastic Systems
Language: en
Pages: 376
Authors: Xi-Ren Cao
Categories: Technology & Engineering
Type: BOOK - Published: 2020-05-13 - Publisher: Springer Nature

GET EBOOK

This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitive
Controlled Diffusion Processes
Language: en
Pages: 308
Authors: N.V. Krylov
Categories: Mathematics
Type: BOOK - Published: 2011-10-12 - Publisher: Springer

GET EBOOK

Stochastic control theory is a relatively young branch of mathematics. The beginning of its intensive development falls in the late 1950s and early 1960s. Durin
Deterministic and Stochastic Optimal Control
Language: en
Pages: 231
Authors: Wendell H. Fleming
Categories: Mathematics
Type: BOOK - Published: 2012-12-06 - Publisher: Springer Science & Business Media

GET EBOOK

This book may be regarded as consisting of two parts. In Chapters I-IV we pre sent what we regard as essential topics in an introduction to deterministic optima
Optimal Control of Diffusion Processes
Language: en
Pages: 214
Authors: Vivek S. Borkar
Categories: Science
Type: BOOK - Published: 1989 - Publisher: Longman

GET EBOOK

Applied Stochastic Control of Jump Diffusions
Language: en
Pages: 263
Authors: Bernt Øksendal
Categories: Mathematics
Type: BOOK - Published: 2007-04-26 - Publisher: Springer Science & Business Media

GET EBOOK

Here is a rigorous introduction to the most important and useful solution methods of various types of stochastic control problems for jump diffusions and its ap