GitHub - RuslanKovalyov/PetGPT

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 70 Commits
.gitignore		.gitignore
LICENSE		LICENSE
MPS_device_test.py		MPS_device_test.py
OpenWebTextReader-generating-data-paths.py		OpenWebTextReader-generating-data-paths.py
README		README
bigram.py		bigram.py
compare tokenizers speed.py		compare tokenizers speed.py
count_num_of_tokens_in_file.py		count_num_of_tokens_in_file.py
dev.ipynb		dev.ipynb
gpt.py		gpt.py
gpt_OWT-40GB_data_train.py		gpt_OWT-40GB_data_train.py
gpt_sentencepiece.py		gpt_sentencepiece.py
gpt_word_level.py		gpt_word_level.py
loss_plot.py		loss_plot.py
make_vocab.py		make_vocab.py
more.txt		more.txt
requirements.txt		requirements.txt
run.py		run.py
run_OWT.py		run_OWT.py
run_sentencepiece.py		run_sentencepiece.py
run_word_level.py		run_word_level.py
tokenizers.ipynb		tokenizers.ipynb
v2.py		v2.py

Repository files navigation

# PetGPT

## Overview
PetGPT, created by Ruslan Kovalev, is an exploratory project in the field of machine learning and artificial intelligence, with a focus on language models. This project is inspired by and builds upon the teachings and code of Andrej Karpathy, aiming to apply these concepts in a practical setting.

## Inspiration
This project draws inspiration from Andrej Karpathy's code and YouTube tutorials, particularly [this informative lesson](https://www.youtube.com/watch?v=kCc8FmEb1nY). PetGPT represents my journey in learning and adapting these concepts, molded in my own style and understanding.

## Objective
The goal of PetGPT is to facilitate a hands-on learning experience in the development and comprehension of language models. It serves as a personal platform for experimentation and exploration within various facets of AI.

## Disclaimer
As a personal and educational project, PetGPT is a reflection of my ongoing learning process. The code quality and practices may not align with professional standards. I welcome constructive feedback and contributions to further enhance this project.

## License
PetGPT is released under the MIT License. For more details, see the [LICENSE](LICENSE) file.

## Acknowledgments
- Heartfelt thanks to Andrej Karpathy for his invaluable teachings and open-source contributions, which have been instrumental in this project's development.
- This project is an educational tool designed to explore and apply AI concepts without infringing on any existing intellectual property.

## Contact
Ruslan Kovalev - [email protected] | [LinkedIn](https://www.linkedin.com/in/ruslan-developer) | [Twitter](https://twitter.com/Ruslan__Kovalev)