Skip to content

Conversation

@Sameerlite
Copy link
Collaborator

@Sameerlite Sameerlite commented Oct 24, 2025

Title

Add documentation for enable_caching_on_provider_specific_optional_params setting

Relevant issues

Fixes #15595

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
  • I have added a screenshot of my new test passing locally
  • My PR passes all unit tests on make test-unit
  • My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

📖 Documentation

Changes

  • Added comprehensive documentation for enable_caching_on_provider_specific_optional_params setting in docs/my-website/docs/proxy/caching.md
  • Updated example config in litellm/proxy_server_config.yaml to show the setting (commented out for reference)

Key Documentation Added:

litellm_settings:
  cache: True
  cache_params:
    type: "redis"
  enable_caching_on_provider_specific_optional_params: True  # Include provider-specific params in cache keys

Test case for caching with provider specific optional param are already there

@vercel
Copy link

vercel bot commented Oct 24, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
litellm Ready Ready Preview Comment Oct 24, 2025 6:41am

@ishaan-jaff ishaan-jaff merged commit b9585b1 into main Oct 24, 2025
35 of 53 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Wrong embedding vector gets returned for Vertex AI embedding models

2 participants