406.406. Value Iteration

Value Iteration

===============

Value iteration is a method for finding the optimal value function in a Markov decision process. It involves iterating between value function updates until convergence.

**Example:** We have a simple grid world with four states (A, B, C, D) and two actions (left, right). The reward function is as follows:

| State | Reward |

| --- | --- |

| A | 0 |

| B | 0 |

| C | 10 |

| D | 0 |

The goal is to find the optimal value function using value iteration.

**Constraints:** The policy is stationary, and the reward function is deterministic.