1 link tagged with all of: autograd + transformer + gpt + microgpt
Click any tag below to further narrow down your results
Links
This gist provides a single-file, dependency-free implementation of a GPT-style transformer, complete with a custom autograd engine, training loop using Adam, and inference routine. It trains on a list of names, demonstrating both the core algorithm and a brief benchmark discussion for a GPU-based microgpt.cu variant.