b9923
Breaking Changes📦 llama-cppView on GitHub →
⚠ 2 breaking🐛 2 fixes🔧 4 symbols
Summary
This release refactors the server-stream component, implementing a pimpl pattern, prefixing public functions with "server_stream_", and improving concurrency safety via mutex guards. Logging for stream operations has also been reduced to the debug level.
⚠️ Breaking Changes
- Public functions related to server-stream functionality have been prefixed with "server_stream_" to scope them correctly, matching existing functions like server_stream_session_manager_start/stop. Code using the old names will break.
- The stream_read_status enum has been moved from the public header to the internal C++ implementation file, hidden behind the pimpl boundary. Code relying on this enum being publicly accessible will break.
Migration Steps
- Rename all usages of old server-stream public functions to use the new "server_stream_" prefix.
- Remove any direct dependencies on the publicly exposed stream_read_status enum; access status information through the session interface if necessary, or update logic based on the new internal structure.
🐛 Bug Fixes
- Server stream session and manager state is now guarded by a mutex to ensure thread safety.
- Logging verbosity adjusted: stream traces (drain, draining, drain ended, DELETE evict, attach_pipe, and the router stream resume proxy) have been moved to the debug log level.