●Change8

v0.3.0

Breaking Changes
📦 ragasView on GitHub →
⚠ 1 breaking✨ 10 features🐛 6 fixes🔧 1 symbols

Summary

This release introduces major features like LlamaIndex agentic integration, a new CLI, and security enhancements including a fix for CVE-2025-45691. It also includes significant internal refactoring, notably the removal of the Project structure.

⚠️ Breaking Changes

  • The `Project` class/functionality has been refactored out, which may break existing code relying on its previous structure or existence.

Migration Steps

  1. Review usage of the refactored `Project` functionality and update code accordingly.
  2. If using older embedding extraction logic, ensure it is updated to use the new async method.
  3. Review security settings due to the fix for CVE-2025-45691.

✨ New Features

  • Added LlamaIndex agentic integration.
  • Introduced security settings alongside a fix for an Arbitrary File Read Vulnerability (CVE-2025-45691).
  • Added support for Devin's deepwiki.
  • Restored `ragas_experimental` module to the main package.
  • Implemented a user simulator.
  • Made 'llm as prompt' an optional feature.
  • Added alignment rate checking and validation.
  • Introduced `ragas evals` CLI.
  • Added `llm_factory` and `embedding_factory` for easier configuration.
  • Refactored code related to monorepo structure and release scripts.

🐛 Bug Fixes

  • Fixed an issue related to dataset slicing.
  • Updated embedding extraction to use the appropriate asynchronous method.
  • Added checks for embedding shapes in CosineSimilarityBuilders.
  • Cleaned up some metrics.
  • Fixed metric alignment when using the `inmemory` backend.
  • Corrected release script logic.

🔧 Affected Symbols

Project