b8952
📦 llama-cppView on GitHub →
✨ 1 features🐛 1 fixes🔧 3 symbols
Summary
This release enhances the router functionality by enabling form-data forwarding to the model server, which resolves an issue preventing audio transcription endpoint usage in router mode. Several internal implementation details related to multipart body construction and JSON parsing were refined.
Migration Steps
- If you were relying on specific behavior around JSON parsing in multipart bodies, note that a non-throwing json::parse overload is now used.
- If you are using file uploads, be aware that the files representation now includes filename and content-type.
✨ New Features
- Router now forwards form-data to the model server, enabling the use of /v1/audio/transcriptions endpoint in router mode.
🐛 Bug Fixes
- Fixed issue preventing form-data forwarding to model server (Fixes #22044).