Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
## Summary - Release version 0.1.0, which includes HF trainer integration ## Testing Done - [x] run `make test` to ensure correctness - [x] run `make checkstyle` to ensure code style - [x] run `make test-convergence` to ensure convergence ``` jobuser [ ~/Liger-Kernel ]$ make checkstyle && make test && make test-convergence flake8 .; flake8_status=$?; \ isort .; isort_status=$?; \ black .; black_status=$?; \ if [ $flake8_status -ne 0 ] || [ $isort_status -ne 0 ] || [ $black_status -ne 0 ]; then \ exit 1; \ fi Skipped 1 files All done! ✨ 🍰 ✨ 51 files left unchanged. pytest --disable-warnings test/ --ignore=test/convergence ============================================================= test session starts ============================================================== platform linux -- Python 3.10.14, pytest-7.1.2, pluggy-1.0.0 rootdir: /home/jobuser/Liger-Kernel plugins: lipy-config-base-30.6.1, lipy-fabric-35.2.3, lipy-test-8.0.52, datadir-1.3.1, lipy-mp-34.4.191 collected 114 items test/transformers/test_cross_entropy.py .......................................................... [ 50%] test/transformers/test_fused_linear_cross_entropy.py ...... [ 56%] test/transformers/test_geglu.py ........ [ 63%] test/transformers/test_rms_norm.py ................ [ 77%] test/transformers/test_rope.py ............ [ 87%] test/transformers/test_swiglu.py ........ [ 94%] test/transformers/test_trainer_integration.py ... [ 97%] test/transformers/test_transformers_monkey_patch.py . [ 98%] test/triton/test_triton_monkey_patch.py .. [100%] ======================================================== 114 passed in 64.99s (0:01:04) ======================================================== HF_DATASETS_OFFLINE=1 pytest --disable-warnings test/convergence ============================================================= test session starts ============================================================== platform linux -- Python 3.10.14, pytest-7.1.2, pluggy-1.0.0 rootdir: /home/jobuser/Liger-Kernel plugins: lipy-config-base-30.6.1, lipy-fabric-35.2.3, lipy-test-8.0.52, datadir-1.3.1, lipy-mp-34.4.191 collected 6 items test/convergence/test_mini_models.py .... [ 66%] test/convergence/test_mini_models_no_logits.py .. [100%] ============================================================== 6 passed in 37.44s ============================================================== ```
- Loading branch information