Discrete-Time Markov Chains

Discrete-Time Markov Chains
Author :
Publisher : Springer Science & Business Media
Total Pages : 372
Release :
ISBN-10 : 038721948X
ISBN-13 : 9780387219486
Rating : 4/5 (486 Downloads)

Book Synopsis Discrete-Time Markov Chains by : George Yin

Download or read book Discrete-Time Markov Chains written by George Yin and published by Springer Science & Business Media. This book was released on 2005 with total page 372 pages. Available in PDF, EPUB and Kindle. Book excerpt: Focusing on discrete-time-scale Markov chains, the contents of this book are an outgrowth of some of the authors' recent research. The motivation stems from existing and emerging applications in optimization and control of complex hybrid Markovian systems in manufacturing, wireless communication, and financial engineering. Much effort in this book is devoted to designing system models arising from these applications, analyzing them via analytic and probabilistic techniques, and developing feasible computational algorithms so as to reduce the inherent complexity. This book presents results including asymptotic expansions of probability vectors, structural properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems. One of the salient features is that it contains a diverse range of applications on filtering, estimation, control, optimization, and Markov decision processes, and financial engineering. This book will be an important reference for researchers in the areas of applied probability, control theory, operations research, as well as for practitioners who use optimization techniques. Part of the book can also be used in a graduate course of applied probability, stochastic processes, and applications.


Discrete-Time Markov Chains Related Books

Discrete-Time Markov Chains
Language: en
Pages: 372
Authors: George Yin
Categories: Business & Economics
Type: BOOK - Published: 2005 - Publisher: Springer Science & Business Media

GET EBOOK

Focusing on discrete-time-scale Markov chains, the contents of this book are an outgrowth of some of the authors' recent research. The motivation stems from exi
Discrete-Time Markov Chains
Language: en
Pages: 354
Authors: G. George Yin
Categories: Mathematics
Type: BOOK - Published: 2005-10-04 - Publisher: Springer Science & Business Media

GET EBOOK

This book focuses on two-time-scale Markov chains in discrete time. Our motivation stems from existing and emerging applications in optimization and control of
Markov Chains
Language: en
Pages: 456
Authors: Pierre Bremaud
Categories: Mathematics
Type: BOOK - Published: 2013-03-09 - Publisher: Springer Science & Business Media

GET EBOOK

Primarily an introduction to the theory of stochastic processes at the undergraduate or beginning graduate level, the primary objective of this book is to initi
Probability Theory and Stochastic Processes
Language: en
Pages: 717
Authors: Pierre Brémaud
Categories: Mathematics
Type: BOOK - Published: 2020-04-07 - Publisher: Springer Nature

GET EBOOK

The ultimate objective of this book is to present a panoramic view of the main stochastic processes which have an impact on applications, with complete proofs a
Continuous-Time Markov Chains
Language: en
Pages: 367
Authors: William J. Anderson
Categories: Mathematics
Type: BOOK - Published: 2012-12-06 - Publisher: Springer Science & Business Media

GET EBOOK

Continuous time parameter Markov chains have been useful for modeling various random phenomena occurring in queueing theory, genetics, demography, epidemiology,