The Pre-Loved edit from Shopbop
To share your reaction on this item, open the Amazon app from the App Store or Google Play on your phone.
Add Prime to get Fast, Free delivery
Amazon prime logo
Buy new:
$134.50
FREE delivery Sunday, January 26
Ships from: Amazon.com
Sold by: Amazon.com
$134.50
FREE Returns
FREE delivery Sunday, January 26
Or Prime members get FREE delivery Friday, January 24. Order within 6 hrs 8 mins.
Only 8 left in stock (more on the way).
$$134.50 () Includes selected options. Includes initial monthly payment and selected options. Details
Price
Subtotal
$$134.50
Subtotal
Initial payment breakdown
Shipping cost, delivery date, and order total (including tax) shown at checkout.
Ships from
Amazon.com
Amazon.com
Ships from
Amazon.com
Sold by
Amazon.com
Amazon.com
Sold by
Amazon.com
Returns
30-day refund/replacement
30-day refund/replacement
This item can be returned in its original condition for a full refund or replacement within 30 days of receipt.
Payment
Secure transaction
Your transaction is secure
We work hard to protect your security and privacy. Our payment security system encrypts your information during transmission. We don’t share your credit card details with third-party sellers, and we don’t sell your information to others. Learn more
$125.00
This book appears new and unread. There is a sticker on back cover showing it was part of a 2 book set originally. V. minor ding on top front cover. All proceeds from this sale support our local library. This book appears new and unread. There is a sticker on back cover showing it was part of a 2 book set originally. V. minor ding on top front cover. All proceeds from this sale support our local library. See less
$5.99 delivery Thursday, January 30. Details
Only 1 left in stock - order soon.
$$134.50 () Includes selected options. Includes initial monthly payment and selected options. Details
Price
Subtotal
$$134.50
Subtotal
Initial payment breakdown
Shipping cost, delivery date, and order total (including tax) shown at checkout.
Access codes and supplements are not guaranteed with used items.
Ships from and sold by restonfriends.
Kindle app logo image

Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required.

Read instantly on your browser with Kindle for Web.

Using your mobile phone camera - scan the code below and download the Kindle app.

QR code to download the Kindle App

Follow the author

Something went wrong. Please try your request again later.

Dynamic Programming and Optimal Control 4th Edition

4.2 4.2 out of 5 stars 40 ratings

{"desktop_buybox_group_1":[{"displayPrice":"$134.50","priceAmount":134.50,"currencySymbol":"$","integerValue":"134","decimalSeparator":".","fractionalValue":"50","symbolPosition":"left","hasSpace":false,"showFractionalPartIfEmpty":true,"offerListingId":"nBz4siJbdOVwI7KzC87LKi7rgCGdfVYn%2B4EmGlfylP57xAzRLB1sNKq3GaYWHHZGLb0asyGQs5mEGmBF2rsD1bHLYQi4oAJT9cce75iISUEWuwoTG2eeAIa%2BiewSzZqF9D%2FJy5Ke7kM%3D","locale":"en-US","buyingOptionType":"NEW","aapiBuyingOptionIndex":0}, {"displayPrice":"$125.00","priceAmount":125.00,"currencySymbol":"$","integerValue":"125","decimalSeparator":".","fractionalValue":"00","symbolPosition":"left","hasSpace":false,"showFractionalPartIfEmpty":true,"offerListingId":"nBz4siJbdOVwI7KzC87LKi7rgCGdfVYnF1H%2F4viKDhN8n1GMxJ3rHuY7JwTccqG0gPLdSNxNWG%2FmmNb5%2FY2SugnEbecXdoalE0YklzYhLh%2FJKWW2IbQJz5a3GP9ytvEYoP%2B1Ev09Wb1B6oEZ9wwsUeH4PgN1jGFF8k7zIX6n6Xw4DPl7KcFcDgAPmsHX8iVs","locale":"en-US","buyingOptionType":"USED","aapiBuyingOptionIndex":1}]}

Purchase options and add-ons

A two-volume set, consisting of the latest editions of the two volumes (4th edition (2017) for Vol. I, and 4th edition (2012) for Vol. II). Much supplementary material can be found at the book's web page. The first volume is oriented towards modeling, conceptualization, and finite-horizon problems, but also includes a substantive introduction to infinite horizon problems that is suitable for classroom use, as well as an up-to-date account of some of the most interesting developments in approximate dynamic programming. The second volume is oriented towards mathematical analysis and computation, treats infinite horizon problems extensively, and provides a detailed account of approximate large-scale dynamic programming and reinforcement learning. This is a textbook on the far-ranging algorithmic methododogy of Dynamic Programming, which can be used for optimal control, Markovian decision problems, planning and sequential decision making under uncertainty, and discrete/combinatorial optimization. The treatment focuses on basic unifying themes, and conceptual foundations. It illustrates the versatility, power, and generality of the method with many examples and applications from engineering, operations research, and other fields. It also addresses extensively the practical application of the methodology, possibly through the use of approximations, and provides an introduction to the methodology of Neuro-Dynamic Programming, which is the focus of much recent research.

Frequently bought together

This item: Dynamic Programming and Optimal Control
$134.50
Get it as soon as Sunday, Jan 26
Only 8 left in stock (more on the way).
Ships from and sold by Amazon.com.
+
$89.00
Get it as soon as Sunday, Jan 26
In Stock
Ships from and sold by Amazon.com.
+
$89.00
Get it as soon as Sunday, Jan 26
In Stock
Ships from and sold by Amazon.com.
Total price: $00
To see our price, add these items to your cart.
Details
Added to Cart
spCSRF_Treatment
Some of these items ship sooner than the others.
Choose items to buy together.

Editorial Reviews

Review

Review of Vol. I, 3rd Edition: In addition to being very well written and organized, the material has several special features that make the book unique in the class of introductory textbooks on dynamic programming. For instance, it presents both deterministic and stochastic control problems, in both discrete- and continuous-time, and it also presents the Pontryagin minimum principle for deterministic systems together with several extensions. It contains problems with perfect and imperfect information, as well as minimax control methods (also known as worst-case control problems or games against nature). I also has a full chapter on suboptimal control and many related techniques, such as open-loop feedback controls, limited lookahead policies, rollout algorithms, and model predictive control, to name a few. ... In conclusion the book is highly recommendable for an introductory course on dynamic programming and its applications. --Onesimo Hernandez Lerma, in Math Reviews

In this two-volume work Bertsekas caters equally effectively to theoreticians who care for proof of such concepts as the existence and the nature of optimal policies and to practitioners interested in the modeling and the quantitative and numerical solution aspects of stochastic dynamic programming. --Michael Caramanis, in Interfaces

In conclusion, this book is an excellent source of reference ... The main strengths of the book are the clarity of the exposition, the quality and variety of the examples, and its coverage of the most recent advances. --T. W. Archibald, in IMA Jnl. of Mathematics

In this two-volume work Bertsekas caters equally effectively to theoreticians who care for proof of such concepts as the existence and the nature of optimal policies and to practitioners interested in the modeling and the quantitative and numerical solution aspects of stochastic dynamic programming. --Michael Caramanis, in Interfaces

In conclusion, this book is an excellent source of reference ... The main strengths of the book are the clarity of the exposition, the quality and variety of the examples, and its coverage of the most recent advances. --T. W. Archibald, in IMA Jnl. of Mathematics

About the Author

Dimitri Bertsekas is McAffee Professor of Electrical Engineering and Computer Science at the Massachusetts Institute of Technology, and a member of the National Academy of Engineering. He has researched a broad variety of subjects from optimization theory, control theory, parallel and distributed computation, systems analysis, and data communication networks. He has written numerous papers in each of these areas, and he has authored or coauthored sixteen textbooks. Professor Bertsekas was awarded the INFORMS 1997 Prize for Research Excellence in the Interface Between Operations Research and Computer Science for his book "Neuro-Dynamic Programming" (co-authored with John Tsitsiklis), the 2001 ACC John R. Ragazzini Education Award, the 2009 INFORMS Expository Writing Award, the 2014 ACC Richard E. Bellman Control Heritage Award for "contributions to the foundations of deterministic and stochastic optimization-based methods in systems and control," the 2014 Khachiyan Prize for Life-Time Accomplishments in Optimization, and the 2015 George B. Dantzig Prize. In 2018, he was awarded jointly with John Tsitsiklis, the INFORMS John von Neumann Theory Prize, for the contributions of the research monographs "Parallel and Distributed Computation" and "Neuro-Dynamic Programming". In 2001, he was elected to the United States National Academy of Engineering for "pioneering contributions to fundamental research, practice and education of optimization/control theory"

Product details

  • Publisher ‏ : ‎ Athena Scientific; 4th edition (June 18, 2012)
  • Language ‏ : ‎ English
  • Hardcover ‏ : ‎ 1270 pages
  • ISBN-10 ‏ : ‎ 1886529086
  • ISBN-13 ‏ : ‎ 978-1886529083
  • Item Weight ‏ : ‎ 3.3 pounds
  • Dimensions ‏ : ‎ 6.5 x 2 x 9.25 inches
  • Customer Reviews:
    4.2 4.2 out of 5 stars 40 ratings

About the author

Follow authors to get new release updates, plus improved recommendations.
Dimitri P. Bertsekas
Brief content visible, double tap to read full content.
Full content visible, double tap to read brief content.

DIMITRI P. BERTSEKAS

Biographical Sketch

Dimitri P. Bertsekas undergraduate studies were in engineering at the National Technical University of Athens, Greece. He obtained his MS in electrical engineering at the George Washington University, Wash. DC in 1969, and his Ph.D. in system science in 1971 at the Massachusetts Institute of Technology.

Dr. Bertsekas has held faculty positions with the Engineering-Economic Systems Dept., Stanford University (1971-1974) and the Electrical Engineering Dept. of the University of Illinois, Urbana (1974-1979). Since 1979 he has been teaching at the Electrical Engineering and Computer Science Department of the Massachusetts Institute of Technology (M.I.T.), where he is currently McAfee Professor of Engineering. He has held editorial positions in several journals. His research at M.I.T. spans several fields, including optimization, control, large-scale computation, and data communication networks, and is closely tied to his teaching and book authoring activities. He has written numerous research papers, and sixteen books and research monographs, several of which are used as textbooks in MIT classes.

Professor Bertsekas was awarded the INFORMS 1997 Prize for Research Excellence in the Interface Between Operations Research and Computer Science for his book "Neuro-Dynamic Programming" (co-authored with John Tsitsiklis), the 2000 Greek National Award for Operations Research, the 2001 ACC John R. Ragazzini Education Award, the 2009 INFORMS Expository Writing Award, the 2014 ACC Richard E. Bellman Control Heritage Award for "contributions to the foundations of deterministic and stochastic optimization-based methods in systems and control," the 2014 Khachiyan Prize for Life-Time Accomplishments in Optimization, and the SIAM/MOS 2015 George B. Dantzig Prize. In 2001, he was elected to the United States National Academy of Engineering for "pioneering contributions to fundamental research, practice and education of optimization/control theory, and especially its application to data communication networks."

Dr. Bertsekas' recent books are "Introduction to Probability: 2nd Edition" (2008), "Convex Optimization Theory" (2009), "Dynamic Programming and Optimal Control, Vol. I, (2017), and Vol. II: Approximate Dynamic Programming" (2012), "Abstract Dynamic Programming" (2013), and "Convex Optimization Algorithms" (2015), all published by Athena Scientific.

Besides his professional activities, Professor Bertsekas is interested in travel, portrait, and landscape photography. His pictures have been exhibited on several occasions at M.I.T., and can also be accessed from his www site.

Customer reviews

4.2 out of 5 stars
40 global ratings

Review this product

Share your thoughts with other customers

Top reviews from the United States

  • Reviewed in the United States on August 28, 2016
    I've read the textbook dealing with DP up to chapter 6. Since this book is approached mathematically, I think it is very well made except a few typos. A bit of unsatisfactoriness for me is the style of the book. I prefer the style introducing the general result first, and then proves why they are derived and where they are derived from. And then, many examples are very helpful for readers like me. However, this book introduces examples first, and then constructs the general form from and using the examples. I am sure that everybody has different styles. My word is just not my type. Nevertheless, the contents that textbook handles are wonderful.
    7 people found this helpful
    Report
  • Reviewed in the United States on March 15, 2019
    This set of two books is just an absolute archive of knowledge. Everything you need to know on Optimal Control and Dynamic programming from beginner level to advanced intermediate is here. Plus worked examples are great. They aren't boring examples as well.
    This set pairs well with Simulation-Based Optimization by Abhijit Gosavi.
    I guess the point is, this book should be the central framework of any graduate course in optimal control and operations research.
    2 people found this helpful
    Report
  • Reviewed in the United States on March 15, 2018
    A classic!
  • Reviewed in the United States on October 9, 2024
    Seems like someone scanned it in while very drunk or something. Publisher really should lift its game this is just embarrassing for them.
    One person found this helpful
    Report
  • Reviewed in the United States on August 27, 2008
    *This is easily the best book on dynamic programming. It certainly is the most up-to-date book on this topic. The first volume covers numerous topics such as deterministic control, HJB equation for the deterministic case, Pontryagin principle, finite horizon MDPs, partially observable MDPs, and rollout heuristics. The second volume treats the infinite horizon case for the regular MDP --- average reward, discounted reward, semi-Markov control, and even some reinforcement learning.
    *I love the notation. The proofs in this book are much easier than those you will find elsewhere. (This opinion is based on my study of proofs in other texts.) The treatment is very sophisticated and yet very accessible! Furthermore, what is really a bonus here --- something you won't find in the other books --- is a discussion on the stochastic shortest path (SSP). The SSP makes it so easy to analyze the average reward problem and the finite horizon problem with a stationary transition probability structure.
    *I strongly recommend this book to all readers interested in understanding the basics of DP and the convergence proofs underlying the DP machinery. It is a must on your book shelf if you are working on research in DP or topics related to DP such as reinforcement learning or adaptive (approximate) DP.
    21 people found this helpful
    Report
  • Reviewed in the United States on April 19, 2000
    This book does a very good job presenting both deterministic and stochastic optimal control. The author does a particularly good job in presenting the derivation of the Bellman equation and its relation to variational formulations for deterministic optimal control. There are also many very good problems with which the reader can test her understanding, and the author has made many solutions available on his web page. Problems range from testing theoretical understanding to determinig optimal policies for various control problems. There are even some exercises which ask the reader to develop parallel codes to solve some problems, so I think there is something in this book for everybody. Richard Bellman once said that there is considerably more to optimal control than just locating the eigenvalues of some matrix in the complex plane. I believe that Bertsekas has remained faithful to Bellman's view with the broad range of problems which he attacks through dynamic programming. I am currently doing a PhD thesis in mathematics studying Bellman equations, and I cannot think of a better source for intuition about control problems than Bertsekas' book. He even does a nice job in pointing out where he has omitted technicalities in the mathematical treatment for those who wish a very rigorous approach to control. If there is a better book out there, I am not aware of it.
    24 people found this helpful
    Report
  • Reviewed in the United States on November 3, 2006
    really nice book on dynamic programming... easy to understand and contains all requisite details.
    4 people found this helpful
    Report
  • Reviewed in the United States on December 9, 2017
    Prof. Bertsekas is definitely the top-level researcher in this domain. It is a good start to study reinforcement learning and its beyond.
    2 people found this helpful
    Report

Top reviews from other countries

  • Liz
    1.0 out of 5 stars Do not waste your money on the kindle edition
    Reviewed in Mexico on September 18, 2024
    I wasted my money on this kindle book. I thought that by being a kindle edition it was gonna be well formated, but It is not even readable.
    It looks like a scanned book. I attached pics of how it looks on my kindle and on the kindle app on my tablet.
    Customer image
    Liz
    1.0 out of 5 stars Do not waste your money on the kindle edition
    Reviewed in Mexico on September 18, 2024
    I wasted my money on this kindle book. I thought that by being a kindle edition it was gonna be well formated, but It is not even readable.
    It looks like a scanned book. I attached pics of how it looks on my kindle and on the kindle app on my tablet.
    Images in this review
    Customer image Customer image
    Customer imageCustomer image
  • amznusr
    2.0 out of 5 stars Probably a good textbook...
    Reviewed in Germany on July 31, 2023
    I was looking forward to working with this two-volume book. Professor Bertsekas is considered a good teacher (in the classroom and in his books).
    Volume 1, however, has skewed text on many pages (see picture 1) and also two pages hanging together which will result in damaged paper when fully opening the book in this place (see picture 2). I informed the publisher about the not perfectly centered pages and they told me that they "look to us exactly as they are supposed to look" (skewed) and with regards to the binding they replied: "Also the binding flaw mentioned does not seem to be of the type that we can guarantee against. Therefore if you ask for a book replacement from Amazon, we cannot guarantee that the replacement book will be more satisfactory."

    Athena Scientific's motto is "A Publisher of Fine Scientific Books". Good one. Not fine with me. I'll sadly have to return those fine books.
    Customer image
    amznusr
    2.0 out of 5 stars Probably a good textbook...
    Reviewed in Germany on July 31, 2023
    I was looking forward to working with this two-volume book. Professor Bertsekas is considered a good teacher (in the classroom and in his books).
    Volume 1, however, has skewed text on many pages (see picture 1) and also two pages hanging together which will result in damaged paper when fully opening the book in this place (see picture 2). I informed the publisher about the not perfectly centered pages and they told me that they "look to us exactly as they are supposed to look" (skewed) and with regards to the binding they replied: "Also the binding flaw mentioned does not seem to be of the type that we can guarantee against. Therefore if you ask for a book replacement from Amazon, we cannot guarantee that the replacement book will be more satisfactory."

    Athena Scientific's motto is "A Publisher of Fine Scientific Books". Good one. Not fine with me. I'll sadly have to return those fine books.
    Images in this review
    Customer image Customer image
    Customer imageCustomer image
  • MG
    5.0 out of 5 stars Happy grad student
    Reviewed in Canada on January 25, 2016
    Indispensable for my research in grad school.
  • F
    5.0 out of 5 stars Rr
    Reviewed in Canada on April 10, 2015
    Great book needed it for class