Change8

v0.12.38

📦 llamaindexView on GitHub →
10 features🐛 8 fixes🔧 14 symbols

Summary

This release introduces OpenTelemetry observability, Claude 4 support across multiple providers, and a new embeddings cache. It also includes critical security fixes for JSONReader and significant enhancements to the Model Context Protocol (MCP) integration.

Migration Steps

  1. Update llama-index-core to 0.12.38 for security fixes in JSONReader.
  2. Update openai library to the latest version if using llama-index-llms-openai 0.3.44 to ensure type compatibility.
  3. If using RankLLM, update to the latest SDK as required by llama-index-postprocessor-rankllm-rerank 0.5.0.
  4. If using Valyu tools, note the update to Valyu 2.0.0.

✨ New Features

  • Added embeddings cache implementation in llama-index-core.
  • Added configurable allow_parallel_tool_calls to FunctionAgent.
  • Introduced OpenTelemetry (OTel) integration for observability.
  • Added support for Claude 4 models in Anthropic and Bedrock Converse LLMs.
  • Introduced new integrations: Azure Foundry Agent, Featherless AI LLM, Servam AI LLM, and BrightData tools.
  • Enhanced MCP (Model Context Protocol) support including SSE endpoint detection and full feature support in BasicMCPClient.
  • Added Vector Index Compression support for Azure Cosmos DB Mongo vector store.
  • Added voyage-3.5 model support in VoyageAI embeddings.
  • Added support for image generation, MCP calls, and code interpreter in OpenAI responses.
  • Added async methods and blank index creation for LlamaCloud managed indices.

🐛 Bug Fixes

  • Fixed potential DoS vulnerability in JSONReader.
  • Fixed context serialization and HITL resumption in AgentWorkflow.
  • Improved ReActAgent completion parsing for 'Thought/Action/Action Input' patterns.
  • Fixed Google GenAI token counting and added retry mechanisms.
  • Fixed metadata and filename handling in AzStorageBlobReader.
  • Fixed remote filesystem reading for PPTX files in readers-file.
  • Fixed tool calling with empty arguments in Bedrock Converse.
  • Fixed OpenAI response type imports for compatibility with latest openai library.

🔧 Affected Symbols

JSONReaderNLSQLRetrieverNLSQLTableQueryEngineFunctionAgentBaseToolSpecAgentWorkflowQueryFusionRetrieverOpenAILikeEmbeddingAnthropicBedrockConverseBasicMCPClientPostgresKVStoreGmailToolSpecSelectionOutputParser