GitHub - angelos-p/llm-from-scratch

Contribute to angelos-p/llm-from-scratch development by creating an account on GitHub.

GitHub

@perspektivbrocken @fedilz_infos

https://github.com/rasbt/LLMs-from-scratch

ist gut. Kommt aber auch ein bisschen auf den Hintergrund der Leute an.

#llmfromscratch

GitHub - rasbt/LLMs-from-scratch: Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step - rasbt/LLMs-from-scratch

GitHub
Writing an LLM from scratch, part 28 -- training a base model from scratch on an RTX 3090

I felt like it should be possible to train a GPT-2 small level model on my own hardware using modern tools and open datasets from scratch. It was!

Giles' Blog