v12.1.0
📦 new-relic-sdkView on GitHub →
✨ 1 features🐛 1 fixes🔧 2 symbols
Summary
This release introduces time to first token tracking for LLM response streams and resolves a crash-inducing incompatibility with the Flask add_url_rule function signature.
✨ New Features
- Added recording of the attribute 'time_to_first_token' on LlmChatCompletionSummary events for OpenAI and Bedrock response streams to measure time until the first token is received.
🐛 Bug Fixes
- Fixed an incompatibility in the Flask instrumentation for the add_url_rule function signature which previously caused crashes in some cases.