Click4Ai

421.

Medium

Target Network

==================

In this problem, you will implement a target network, a type of network used in Deep Reinforcement Learning to stabilize the training process.

**Example:*

Suppose we have a simple Markov Decision Process (MDP) with two states (A and B) and two actions (left and right). The agent starts at state A and receives a reward of -1 for each step. The goal is to reach state B.

| State | Action | Next State | Reward |

| --- | --- | --- | --- |

| A | left | A | -1 |

| A | right | B | 10 |

| B | left | B | -1 |

| B | right | A | -1 |

The agent starts at state A and chooses the right action, reaching state B. The reward is 10, which is higher than the expected reward of -1. This experience should be used to update the target network.

Constraints:

  • The target network should be a copy of the Q-network.
  • The target network should be updated periodically.
  • Test Cases

    Test Case 1
    Input: [[1, 2, 3], [4, 5, 6], [7, 8, 9]]
    Expected: TargetNetwork object
    Test Case 2
    Input: [[10, 20, 30], [40, 50, 60], [70, 80, 90]]
    Expected: TargetNetwork object
    + 3 hidden test cases