Change8

v0.36.0

📦 huggingface-hubView on GitHub →
3 features🐛 5 fixes🔧 5 symbols

Summary

This release focuses on significant performance optimizations for HfFileSystem and introduces the new get_organization_overview API endpoint, serving as the final minor release before v1.0.0.

Migration Steps

  1. No explicit migration steps are required for this minor release, but be aware of performance improvements in `HfFileSystem`.

✨ New Features

  • Added new API endpoint `get_organization_overview` to retrieve high-level information about an organization.
  • Implemented major performance optimizations in `HfFileSystem`, including keeping the cache when pickling instances for distributed environments.
  • Greatly optimized file listing with `.glob()` in `HfFileSystem` to reduce the number of `/tree` calls.

🐛 Bug Fixes

  • Fixed an issue where HTTP backoff would retry on `ChunkedEncodingError`.
  • Fixed an issue where HTTP backoff would retry on 429 errors (now only retries on 5xx errors).
  • Added quotes for better shell compatibility in a command.
  • Fixed type validation to skip unresolved forward references.
  • Fixed an issue related to the error message display.

Affected Symbols