Office of Academic Resources
Chulalongkorn University
Chulalongkorn University

Home / Help

AuthorKushner, Harold J. author
TitleStochastic Approximation and Recursive Algorithms and Applications [electronic resource] / by Harold J. Kushner, G. George Yin
ImprintNew York, NY : Springer New York, 2003
Edition Second Edition
Connect to
Descript XXII, 478 p. online resource


This revised and expanded second edition presents a thorough development of the modern theory of stochastic approximation or recursive stochastic algorithms for both constrained and unconstrained problems. There is a complete development of both probability one and weak convergence methods for very general noise processes. The proofs of convergence use the ODE method, the most powerful to date. The assumptions and proof methods are designed to cover the needs of recent applications. The development proceeds from simple to complex problems, allowing the underlying ideas to be more easily understood. Rate of convergence, iterate averaging, high-dimensional problems, stability-ODE methods, two time scale, asynchronous and decentralized algorithms, state-dependent noise, stability methods for correlated noise, perturbed test function methods, and large deviations methods are covered. Many motivating examples from learning theory, ergodic cost problems for discrete event systems, wireless communications, adaptive control, signal processing, and elsewhere illustrate the applications of the theory


Introduction: Applications and Issues -- Applications to Learning, Repeated Games, State Dependent Noise, and Queue Optimization -- Applications in Signal Processing, Communications, and Adaptive Control -- Mathematical Background -- Convergence with Probability One: Martingale Difference Noise -- Convergence with Probability One: Correlated Noise -- Weak Convergence: Introduction -- Weak Convergence Methods for General Algorithms -- Applications: Proofs of Convergence -- Rate of Convergence -- Averaging of the Iterates -- Distributed/Decentralized and Asynchronous Algorithms

Mathematics Artificial intelligence Approximation theory Applied mathematics Engineering mathematics Algorithms Probabilities Mathematics Probability Theory and Stochastic Processes Artificial Intelligence (incl. Robotics) Approximations and Expansions Applications of Mathematics Algorithms


Office of Academic Resources, Chulalongkorn University, Phayathai Rd. Pathumwan Bangkok 10330 Thailand

Contact Us

Tel. 0-2218-2929,
0-2218-2927 (Library Service)
0-2218-2903 (Administrative Division)
Fax. 0-2215-3617, 0-2218-2907

Social Network


facebook   instragram