Subscribe to the OCW Newsletter

Help| Contact Us

FIND COURSES
Topic

MIT Course Number

Department
New Courses

Most Visited Courses

OCW Scholar Courses

Audio/Video Lectures

Online Textbooks

Supplemental Resources

OCW Highlights for High School

MITx & Related OCW Courses
Energy

Entrepreneurship

Environment

Introductory Programming

Life Sciences

Transportation
繁體字 / Traditional Chinese

Español / Spanish

Türkçe / Turkish

(비디오)한국 / Korean
For Educators
OCW Educator Portal
- Search for Instructor Insights
- Search for Teaching Materials
OCW Collections
- Instructor Insights by Department
- MIT Courses about Teaching and Education
K-12
- OCW Highlights for High School
- MIT+K12 Videos
Higher Ed
- Teaching Excellence at MIT
- MIT Undergraduate Curriculum Map
Give Now
About

Search Tips

Exclude words from your search
Put - in front of a word you want to leave out. For example, jaguar speed -car

Search for an exact match
Put a word or phrase inside quotes. For example, "tallest building".

Search for wildcards or unknown words
Put a * in your word or phrase where you want to leave a placeholder. For example, "largest * in the world".

Search within a range of numbers
Put .. between two numbers. For example, camera $50..$100.

Combine searches
Put "OR" between each search query. For example, marathon OR race.

Home » Courses » Electrical Engineering and Computer Science » Underactuated Robotics » Video Lectures » Lecture 22: Actor-critic Methods

Lecture 22: Actor-critic Methods

Course Home
Syllabus
Calendar
Readings
Assignments
Exams
Projects
Video Lectures
Download Course Materials

00:00

00:00

About this Video
Playlist
Download this Video

Topics covered: Actor-critic methods

Instructors: Russell Tedrake

Lecture 1: Introduction

Lecture 1: Introduction

Lecture 2: The Simple Pendulum

Lecture 2: The Simple Pendulum

Lecture 3: Optimal Control of the Double Integrator

Lecture 3: Optimal Control ...

Lecture 4: Optimal Control of the Double Integrator (cont.)

Lecture 4: Optimal Control ...

Lecture 5: Numerical Optimal Control (Dynamic Programming)

Lecture 5: Numerical Optima...

Lecture 6: Acrobot and Cart-pole

Lecture 6: Acrobot and Cart...

Lecture 7: Swing-up Control of Acrobot and Cart-pole Systems

Lecture 7: Swing-up Control...

Lecture 8: Dynamic Programming (DP) and Policy Search

Lecture 8: Dynamic Programm...

Lecture 9: Trajectory Optimization

Lecture 9: Trajectory Optim...

Lecture 10: Trajectory Stabilization and Iterative Linear Quadratic Regulator

Lecture 10: Trajectory Stab...

Lecture 11: Walking

Lecture 11: Walking

Lecture 12: Walking (cont.)

Lecture 12: Walking (cont.)

Lecture 13: Running

Lecture 13: Running

Lecture 14: Feasible Motion Planning

Lecture 14: Feasible Motion...

Lecture 15: Global Policies from Local Policies

Lecture 15: Global Policies...

Lecture 16: Introducing Stochastic Optimal Control

Lecture 16: Introducing Sto...

Lecture 17: Stochastic Gradient Descent

Lecture 17: Stochastic Grad...

Lecture 18: Stochastic Gradient Descent 2

Lecture 18: Stochastic Grad...

Lecture 19: Temporal Difference Learning

Lecture 19: Temporal Differ...

Lecture 20: Temporal Difference Learning with Function Approximation

Lecture 20: Temporal Differ...

Lecture 21: Policy Improvement

Lecture 21: Policy Improvement

Now Playing

Lecture 22: Actor-critic Methods

Lecture 22: Actor-critic Me...

Lecture 23: Case Studies in Computational Underactuated Control

Lecture 23: Case Studies in...

Free Downloads

Video

iTunes U (MP4 - 155MB)
Internet Archive (MP4 - 155MB)

Find Courses

Find by Topic
Find by Course Number
Find by Department
New Courses
Most Visited Courses
OCW Scholar Courses
Audio/Video Courses
Online Textbooks
Instructor Insights
Supplemental Resources
MITx & Related OCW Courses
Translated Courses

For Educators

Search for Instructor Insights
Search for Teaching Materials
Instructor Insights by Department
MIT Courses about Teaching and Education
Highlights for High School
MIT+K12 Videos
Teaching Excellence at MIT
MIT Undergraduate Curriculum Map

Give Now

Make a Donation
Why Give?
Our Supporters
Other Ways to Contribute
Shop OCW
Become a Corporate Sponsor

About

About OpenCourseWare
Site Statistics
OCW Stories
News
Press Releases

Tools

Help & FAQs
Contact Us
Site Map
Privacy & Terms of Use
RSS Feeds

Our Corporate Supporters

About MIT OpenCourseWare

MIT OpenCourseWare makes the materials used in the teaching of almost all of MIT's subjects available on the Web, free of charge. With more than 2,400 courses available, OCW is delivering on the promise of open sharing of knowledge. Learn more »

© 2001–2025
Massachusetts Institute of Technology

Your use of the MIT OpenCourseWare site and materials is subject to our Creative Commons License and other terms of use.