●Change8

Migrating to RAGAS v0.3.8

Version v0.3.8 introduces 2 breaking changes. This guide details how to update your code.

Released: 10/28/2025

2
Breaking Changes
3
Migration Steps
16
Affected Symbols

⚠️ Check Your Code

If you use any of these symbols, you need to read this guide:

semantic similarity (internal components)answer_correctnesscontext_entity_recallContextRelevanceToolCallF1ChrfScoreContextUtilizationinstructor_llm_factoryllm_factorySingleHopSpecificQuerySynthesizersimple criteria (internal components)LangchainLLMWrapperLlamaIndexLLMWrapperembedding wrappersasync_utils.pyengine.py

Breaking Changes

●Issue #1

The internal structure for semantic similarity has been migrated to collections. If you were accessing internal components related to semantic similarity directly, you may need to update paths.

●Issue #2

The `instructor_llm_factory` has been merged into `llm_factory`. Code using `instructor_llm_factory` must be updated to use `llm_factory`.

Migration Steps

  1. 1
    Update any code referencing `instructor_llm_factory` to use `llm_factory` instead.
  2. 2
    Review usage of semantic similarity components due to migration to collections.
  3. 3
    If encountering issues related to async patching, note that uvloop detection now correctly handles nest_asyncio skipping.

Release Summary

This release focuses heavily on internal refactoring, migrating core functionalities like semantic similarity and simple criteria to collections, and merging LLM factory methods. Several bugs related to async handling and specific synthesizers were also fixed.

Need More Details?

View the full release notes and all changes for RAGAS v0.3.8.

View Full Changelog