arize-phoenix-evals-v2.0.0
Breaking Changes📦 arize-phoenixView on GitHub →
⚠ 1 breaking✨ 3 features🐛 2 fixes🔧 4 symbols
Summary
Version 2.0.0 stabilizes Evals 2.0, introduces asynchronous evaluation capabilities, and adds rate limiting to LLM interactions. This release includes significant updates to the evals module.
⚠️ Breaking Changes
- Evals 2.0 functionality has been moved out of preview, indicating potential API changes or stabilization of previously experimental features related to evals.
Migration Steps
- Review changes related to Evals 2.0 as it is now fully released and no longer in preview; check for any API shifts from previous preview versions.
✨ New Features
- Added rate limiting to llm methods within evals.
- Introduced an async version of the evaluate dataframe function.
- Achieved compatibility between Experiments and Evals 2.0.
🐛 Bug Fixes
- Added support for Gemini 2.0 Flash.
- Unified sync and async LLM handling within evals.
🔧 Affected Symbols
evalsevaluate dataframellm methodsExperiments