What's Changed
This release introduces performance improvements with parallel rails execution capabilities for both standard and streaming scenarios, enhanced tracing infrastructure using OpenTelemetry API, and several critical bug fixes for streaming functionality. The new parallel rails execution in Colang 1.0 can reduce latency when multiple rails are configured, as they now run concurrently rather than sequentially.
The migration to OpenTelemetry provides standardized observability with better integration into existing monitoring stacks, enabling detailed insights into LLM calls, rail execution times, and token usage across your guardrails. We intend to expand this observability in future release with adapting semantic conventions for Generative AI Systems.
Critical streaming fixes address word spacing issues in output rails (where text was being concatenated without proper delimiters) and restore accurate token counting for streaming LLM calls. These enhancements collectively deliver a more performant and observable guardrails system while maintaining full backward compatibility for existing Colang 1 configurations.
🚀 Features
- (tracing) [breaking] Update tracing to use otel api (#1269)
- (streaming) Implement parallel streaming output rails execution (#1263, #1324)
- (streaming) Support external async token generators (#1286)
- Support parallel rails execution (#1234, #1323)
🐛 Bug Fixes
- (streaming) Resolve word concatenation in streaming output rails (#1259)
- (streaming) Enable token usage tracking for streaming LLM calls (#1264, #1285)
- (tracing) Prevent mutation of user options when tracing is enabled (#1273)
- (rails) Prevent LLM parameter contamination in rails (#1306)
📚 Documentation
- Release notes 0.14.1 (#1272)
- Update guardrails-library.md to include Clavata as a third party API (#1294)
- (streaming) Add section on token usage tracking (#1282)
- Add parallel rail section and split config page (#1295)
- Show complete prompts.yml content in getting started tutorial (#1311)
- (tracing) Update and streamline tracing guide (#1307)
⚙️ Miscellaneous Tasks
New Contributors
Full Changelog: v0.14.1...v0.15.0
