Skip to content
/ theLMbook Public

This is the official repository for The Hundred-Page Language Models Book by Andriy Burkov

www.thelmbook.com
1.3k stars 201 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

aburkov/theLMbook

1 Branch1 Tag

Folders and files

NameName
Last commit message
Last commit date

Latest commit

aburkovaburkov
Update GRPO_From_Scratch_Multi_GPU_DataParallel_Qwen_2_5_1_5B_Instruc…
Mar 8, 2025
aa7adf5 · Mar 8, 2025

History

78 Commits
wiki
wiki
Feb 13, 2025
GRPO.py
GRPO.py
Feb 27, 2025
GRPO_From_Scratch_Multi_GPU_DataParallel_Qwen_2_5_1_5B_Instruct.ipynb
GRPO_From_Scratch_Multi_GPU_DataParallel_Qwen_2_5_1_5B_Instruct.ipynb
Mar 8, 2025
GRPO_Qwen_0_5_Instruct.ipynb
GRPO_Qwen_0_5_Instruct.ipynb
Feb 15, 2025
README.md
README.md
Jan 11, 2025
byte_pair_encoding.ipynb
byte_pair_encoding.ipynb
Jan 16, 2025
count_language_model.ipynb
count_language_model.ipynb
Jan 16, 2025
embedding_vs_linear.py
embedding_vs_linear.py
Dec 4, 2024
emotion_GPT2_as_classifier.ipynb
emotion_GPT2_as_classifier.ipynb
Jan 16, 2025
emotion_GPT2_as_text_generator.ipynb
emotion_GPT2_as_text_generator.ipynb
Jan 16, 2025
emotion_GPT2_as_text_generator_LoRA.ipynb
emotion_GPT2_as_text_generator_LoRA.ipynb
Jan 16, 2025
emotion_classifier_CNN.ipynb
emotion_classifier_CNN.ipynb
Feb 12, 2025
emotion_classifier_LR.ipynb
emotion_classifier_LR.ipynb
Jan 16, 2025
instruct_GPT2.ipynb
instruct_GPT2.ipynb
Jan 16, 2025
news_RNN_language_model.ipynb
news_RNN_language_model.ipynb
Dec 20, 2024
news_decoder_language_model.ipynb
news_decoder_language_model.ipynb
Jan 16, 2025
quadratic_loss.py
quadratic_loss.py
Dec 2, 2024
sampling_method.ipynb
sampling_method.ipynb
Jan 16, 2025

Repository files navigation

The Hundred-Page Language Models Book

cover

About

This is the official repository for The Hundred-Page Language Models Book by Andriy Burkov

www.thelmbook.com

Resources

Readme
Activity

Stars

1.3k stars

Watchers

18 watching

Forks

201 forks
Report repository

Releases 1

data Latest
Jun 28, 2024

Packages

No packages published

Contributors 2

Languages