Beam Search with nanoGPT
Medium · Solved in PyTorch · Machine learning coding practice
Problem
Implement Beam Search with KV-cache reordering for a NanoGPT class.
Topics: decoding, inference, language model
The full statement, worked examples, hints and the test suite are available once you sign in. You can then solve Beam Search with nanoGPT in the browser and run it against the tests.