Temporal Difference (TD) Error for Action-Value Function

Easy · Solved in PyTorch · Machine learning coding practice

Problem

Implement single-step Temporal Difference (TD) learning to update the Q-function, the most widely used method for estimating action-value functions in reinforcement learning.

Topics: RL, TD error, q-learning, value-function

The full statement, worked examples, hints and the test suite are available once you sign in. You can then solve Temporal Difference (TD) Error for Action-Value Function in the browser and run it against the tests.

Related problems

• Unbiased GRPO Optimization: Dr. GRPO Medium
• Transformer Positional Encoding Easy
• Batch Normalization Easy
• Build Binary Classifier with Cross Entropy Loss Easy
• Binary Quantization and Bit Packing Easy
• Score Allowed Candidate Tokens Easy