b9077
📦 llama-cppView on GitHub →
✨ 3 features🐛 3 fixes🔧 1 symbols
Summary
This release introduces support for the Vertex AI compatible API within the server component and includes various stability and build fixes, notably for Windows.
✨ New Features
- Added support for Vertex AI compatible API in the server component.
- Server component now supports other AIP_* environment variables.
- Server component will do nothing if AIP_MODE is unset.
🐛 Bug Fixes
- Made server component logic 'a bit safer'.
- Fixed a test case.
- Fixed Windows build.