this is focus on two library
1.transformer
2.peft
src/
this folder contains all the source code for training the language model without any parameter effective fine-tuning.
peft_methods/
this folder contains all the source code for training the language model with parameter effective fine-tuning using peft library.
for peft methods,i have used two methods
1.offical peft library
2.simplied peft library methods
peft_en.md:this has the explanation of simplified peft library methods for english language.
the example.ipynb is just for checking some code snippets (because maybe i will forget some functions,it is just used for checking the some output of the code snippets)
the codes may have some errors,maybe i will correct it if i have some time.
-
Notifications
You must be signed in to change notification settings - Fork 0
zhkzly/language_model
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
transformers,peft,sft
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published