●Change8

v1.39.0

📦 weaviateView on GitHub →
✨ 5 features🐛 13 fixes🔧 9 symbols

Summary

This release introduces Namespaces for enhanced control-plane and data isolation, along with significant improvements to the BM25 search algorithm for better performance. It also includes preview features for altering schema by reindexing properties and dropping vector indices.

Migration Steps

  1. Namespace graduation using backup/restore.
  2. Namespace suspend scaffolding (errors etc).
  3. Namespace suspend RAFT states.
  4. Namespace suspend: Check namespace status for DB Users.
  5. Namespace: Add endpoints for suspend.
  6. Return first letters of API keys for admins on namespaced clusters.
  7. feat(reindex): GA API rework per RFC (v1.39) — resource-oriented index endpoints.
  8. feat(drop-vector-index): reject writes carrying a dropped vector index.
  9. feat(drop-vector-index): reject introducing the "none" vector index type on collection update.
  10. feat(drop-vector-index): introduce (storobj.Object).RemoveTargetVector method.
  11. feat(drop-vector-index): introduce segment edit ops bolt facility.
  12. feat(drop-vector-index): introduce compactor transformer hook.
  13. feat(drop-vector-index): apply value transformer in segment cleaner.
  14. feat(drop-vector-index): wire edit ops into segment compaction.
  15. feat(drop-vector-index): clean pending segments via edit ops with retry/quarantine.
  16. feat(drop-vector-index): bridge edit-ops transformer to objects bucket.
  17. feat(drop-vector-index): implement drop vector index distributed task.
  18. feat(drop-vector-index): gate schema removal of dropped vector on cleanup FINISHED.
  19. feat(drop-vector-index): fail the unit when cleanup quarantines a segment.
  20. feat(drop-vector-index): cold-tenant completion, MT-scale coverage, tenant-lifecycle decoupling.

✨ New Features

  • Namespaces add control-plane and data isolation between users on a shared cluster.
  • Add support for changing property's index types (Reindex Preview).
  • Support for dropping inverted indices from existing properties, allowing users to reclaim disk space by removing indices that are no longer needed, with RBAC integration and multi-tenancy support (Drop vector index Preview).
  • Add gRPC web endpoint.
  • Add dedicated REST API for performing search queries.

🐛 Bug Fixes

  • Fix namespace test that is flaky due to EC.
  • Namespaces: Match colon-containing user/group ids literally for global callers.
  • Fix namespace regexp.
  • fix(bm25): record max-impact pair on memtable BlockEntry.
  • fix(bm25): dedup duplicate properties (last boost wins).
  • fix(bm25): propagate combineResults error (was silent empty results).
  • fix(bm25): apply propertyBoost to WAND pivot and block-impact bounds.
  • [Reindex Fixes A] fix: idempotent recovery-swap marking after mid-FINALIZING restart.
  • [Reindex Fixes A] fix: class DELETE racing a draining reindex worker re-created the class dir.
  • [Reindex Fixes A] fix: atomic tokenization+bucket snapshot per BM25 query (LiveQueries flake).
  • [Reindex Fixes B] fix: partial-state cleanup deleted live class-level deferred-finalize dirs.
  • fix(dtm): fail/retry reindex task on OnTaskCompleted schema-flip failure (#297).
  • fix(drop-vector-index): reject writes targeting a dropped vector on the receiving node.

Affected Symbols

BM25BlockMaxWANDstorobj.Object.RemoveTargetVectorsegment edit ops bolt facilitycompactor transformer hooksegment cleanerobjects bucketdrop vector index distributed task