This project is started for learning the basic of language model

    this is focus on two library
    1.transformer
    2.peft

    src/
    this folder contains all the source code for training the language model without any parameter effective fine-tuning.

    peft_methods/
    this folder contains all the source code for training the language model with parameter effective fine-tuning using peft library.

    for peft methods,i have used two methods
    1.offical peft library

    2.simplied peft library methods
        peft_en.md:this has the explanation of simplified peft library methods for english language.

    the example.ipynb is just for checking some code snippets (because maybe i will forget some functions,it is just used for checking the some output of the code snippets)

    the codes may have some errors,maybe i will correct it if i have some time.