●Change8

v0.17.8-rc3

📦 ollamaView on GitHub →
✨ 2 features🐛 7 fixes🔧 5 symbols

Summary

This release focuses on stability and performance improvements across parsers, cloud proxy handling, and MLX backend optimizations. It also includes fixes for Docker builds and application defaults.

Migration Steps

  1. Users leveraging MLX runners should note the sampler interface chain has been replaced with a single stateful Sampler.

✨ New Features

  • mlx: Implemented int4 groupsize 64 support.
  • mlxrunner: Replaced sampler interface chain with a single stateful Sampler.

🐛 Bug Fixes

  • Fixed unclosed arg_value tags in GLM tool calls within parsers.
  • Reapplied fix to not require pulling stubs for cloud models.
  • Fixed localhost handling during model creation.
  • Improved Docker build parallelism.
  • Handled stream disconnects gracefully in the cloud proxy.
  • Fixed an issue where resetting to defaults disabled auto-update in the app.
  • Fixed Windows build failures in CI.

Affected Symbols

parserscloud_proxyappmlxrunnerSampler