v1.3.4
What's Changed
- feat: relax mistral requirements by @OlivierDehaene in #1351
- fix: fix logic if sliding window key is not present in config by @OlivierDehaene in #1352
- fix: fix offline (#1341) by @OlivierDehaene in #1347
- fix: fix gpt-q with groupsize = -1 by @OlivierDehaene in #1358
- Peft safetensors. by @Narsil in #1364
- Change URL for Habana Gaudi support in doc by @regisss in #1343
- feat: update exllamav2 kernels by @OlivierDehaene in #1370
- Fix local load for peft by @Narsil in #1373
Full Changelog: v1.3.3...v1.3.4