v0.16.0

What's New

Streaming 0.11.0 🚀 (#1711)

We've upgraded streaming to 0.11.0. StreamingDataset can now be used with custom Stream implementations via a registry. See the documentation page for example usage.

What's Changed

• Fix llama3 example yamls by @j316chuck in #1688
• Update example yamls to use newest foundry version by @snarayan21 in #1689
• Update datasets requirement from <2.21,>=2.20.0 to >=2.20.0,<3.2 by @dependabot in #1670
• Catch multiple slashes in source dataset into one slash by @KuuCi in #1697
• Make loaded peft adapters optionally trainable by @snarayan21 in #1701
• Adding preprocessors for QA and messages datasets by @ShashankMosaicML in #1700
• Update pycln by @b-chu in #1704
• Add permission error by @b-chu in #1703
• Update datasets requirement from <3.2,>=2.20.0 to >=2.20.0,<3.3 by @dependabot in #1698
• Bump coverage[toml] from 7.6.4 to 7.6.10 by @dependabot in #1702
• Update mosaicml-streaming to 0.11.0 by @es94129 in #1711
• Bump version to 0.17.0.dev0 by @irenedea in #1712

Full Changelog: v0.15.1...v0.16.0