Update dependency litellm to v1.59.0 #1972

renovate · 2025-01-18T13:29:23Z

This PR contains the following updates:

Package	Change	Age	Adoption	Passing	Confidence
litellm	`1.56.9` -> `1.59.0`

Release Notes

BerriAI/litellm (litellm)

`v1.59.0`

Compare Source

What's Changed

Add key & team level budget metric for prometheus by @yujonglee in https://github.com/BerriAI/litellm/pull/7831
fix(key_management_endpoints.py): fix default allowed team member roles by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7843
(UI - View SpendLogs Table) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7842
[fix dd llm obs] - use env vars for setting dd tags, service name by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7835
[Hashicorp - secret manager] - use vault namespace for tls auth by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7834
QA: ensure all bedrock regional models have same supported_ as base + Anthropic nested pydantic object support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7844
10x Bedrock perf improvement - refactor: make bedrock image transformation requests async by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7840
/key/delete - allow team admin to delete team keys by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7846
Improve Proxy Resiliency: Cooldown single-deployment model groups if 100% calls failed in high traffic by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7823
LiteLLM Minor Fixes & Improvements (2024/16/01) by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7826
Remove UI build output by @yujonglee in https://github.com/BerriAI/litellm/pull/7849
Fix invalid base URL error by @yujonglee in https://github.com/BerriAI/litellm/pull/7852
Refactor logs UI by @yujonglee in https://github.com/BerriAI/litellm/pull/7851

Full Changelog: BerriAI/litellm@v1.58.4...v1.59.0

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.0

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	250.0	285.129348931583	6.106818187164813	0.0	1827	0	224.69302100000732	2869.612018000055
Aggregated	Passed ✅	250.0	285.129348931583	6.106818187164813	0.0	1827	0	224.69302100000732	2869.612018000055

`v1.58.4`

Compare Source

What's Changed

build(pyproject.toml): bump uvicorn depedency requirement + Azure o1 model check fix + Vertex Anthropic headers fix by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7773
Add gemini/ frequency_penalty + presence_penalty support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7776
feat(helm): add securityContext and pull policy values to migration job by @Hexoplon in https://github.com/BerriAI/litellm/pull/7652
fix confusing save button label by @yujonglee in https://github.com/BerriAI/litellm/pull/7778
[integrations/lunary] Improve Lunary documentaiton by @hughcrt in https://github.com/BerriAI/litellm/pull/7770
Fix wrong URL for internal user invitation by @yujonglee in https://github.com/BerriAI/litellm/pull/7762
Update instructor tutorial by @Winston-503 in https://github.com/BerriAI/litellm/pull/7784
(helm) - allow specifying envVars on values.yaml + add helm lint test by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7789
Fix anthropic pass-through end user tracking + add gemini-2.0-flash-thinking-exp by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7772
Add back in non root image fixes (#7781) by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7795
test: initial test to enforce all functions in user_api_key_auth.py h… by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7797
test: initial commit enforcing testing on all anthropic pass through … by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7794
build: bump certifi version - see if that fixes asyncio ssl issue on … by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7800
(datadog llm observability) - fixes + improvements for using datadog llm observability logging integration by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7824
(fix) IBM Watsonx using ZenApiKey by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7821
(Fix + Testing) - Add dd-trace-run to litellm ci/cd pipeline + fix bug caused by dd-trace patching OpenAI sdk by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7820
(security fix) - remove hf model with exposed security token by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7810

New Contributors

@Winston-503 made their first contribution in https://github.com/BerriAI/litellm/pull/7784

Full Changelog: BerriAI/litellm@v1.58.2...v1.58.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.58.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	237.21547618310757	6.133261155980474	0.0	1835	0	175.96439100003636	4047.4063279999655
Aggregated	Passed ✅	200.0	237.21547618310757	6.133261155980474	0.0	1835	0	175.96439100003636	4047.4063279999655

`v1.58.2`

Compare Source

What's Changed

Fix RPM/TPM limit typo in admin UI by @yujonglee in https://github.com/BerriAI/litellm/pull/7769
Add AIM Guardrails support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7771
Support temporary budget increases on keys by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7754
Litellm dev 01 13 2025 p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7758
docs - iam role based access for bedrock by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7774
(Feat) prometheus - emit remaining team budget metric on proxy startup by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7777
(fix) BaseAWSLLM - cache IAM role credentials when used by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7775

Full Changelog: BerriAI/litellm@v1.58.1...v1.58.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.58.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	250.0	289.8090936126223	6.143711740946042	0.0	1838	0	228.12097899998207	2196.5017750000015
Aggregated	Passed ✅	250.0	289.8090936126223	6.143711740946042	0.0	1838	0	228.12097899998207	2196.5017750000015

`v1.58.1`

Compare Source

🚨Alpha - 1.58.0 has various perf improvements, we recommend waiting for a stable release before bumping in production

What's Changed

(core sdk fix) - fix fallbacks stuck in infinite loop by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7751
[Bug fix]: v1.58.0 - issue with read request body by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7753
(litellm SDK perf improvements) - handle cases when unable to lookup model in model cost map by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7750
(prometheus - minor bug fix) - litellm_llm_api_time_to_first_token_metric not populating for bedrock models by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7740
(fix) health check - allow setting health_check_model by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7752

Full Changelog: BerriAI/litellm@v1.58.0...v1.58.1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.58.1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	250.0	294.2978673554448	6.045420383532543	0.0	1809	0	223.72276400000146	3539.4181890000027
Aggregated	Passed ✅	250.0	294.2978673554448	6.045420383532543	0.0	1809	0	223.72276400000146	3539.4181890000027

`v1.58.0`

Compare Source

v1.58.0 - Alpha Release

🚨 This is an alpha release - we've made several performance / RPS improvements to litellm core. If you see any issues please file it https://github.com/BerriAI/litellm/issues

What's Changed

(proxy perf) - service logger don't always import OTEL in helper function by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7727
(proxy perf) - only read request body 1 time per request by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7728

Full Changelog: BerriAI/litellm@v1.57.11...v1.58.0

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.58.0

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	240.0	273.2166563012582	6.118315985413586	0.0033451700302972037	1829	1	75.1692759999969	3821.228761000043
Aggregated	Passed ✅	240.0	273.2166563012582	6.118315985413586	0.0033451700302972037	1829	1	75.1692759999969	3821.228761000043

`v1.57.11`

Compare Source

v1.57.11 - Alpha Release

🚨 This is an alpha release - we've made several performance / RPS improvements to litellm core. If you see any issues please file it https://github.com/BerriAI/litellm/issues

What's Changed

(litellm SDK perf improvement) - use verbose_logger.debug and _cached_get_model_info_helper in _response_cost_calculator by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7720
(litellm sdk speedup) - use _model_contains_known_llm_provider in response_cost_calculator to check if the model contains a known litellm provider by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7721
(proxy perf) - only parse request body 1 time per request by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7722
Revert "(proxy perf) - only parse request body 1 time per request" by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7724
add azure o1 pricing by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7715

Full Changelog: BerriAI/litellm@v1.57.10...v1.57.11

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.11

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	240.0	270.55759577820237	6.130862160194138	0.0	1835	0	224.79750500002638	1207.8732939999952
Aggregated	Passed ✅	240.0	270.55759577820237	6.130862160194138	0.0	1835	0	224.79750500002638	1207.8732939999952

`v1.57.10`

Compare Source

v1.57.10 - Alpha Release

🚨 This is an alpha release - we've made several performance / RPS improvements to litellm core. If you see any issues please file it https://github.com/BerriAI/litellm/issues

Litellm dev 01 10 2025 p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7679
Litellm dev 01 10 2025 p3 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7682
build: new ui build by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7685
fix(model_hub.tsx): clarify cost in model hub is per 1m tokens by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7687
Litellm dev 01 11 2025 p3 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7702
(perf litellm) - use _get_model_info_helper for cost tracking by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7703
(perf sdk) - minor changes to cost calculator to run helpers only when necessary by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7704
(perf) - proxy, use orjson for reading request body by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7706
(minor fix - aiohttp_openai/) - fix get_custom_llm_provider by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7705
(sdk perf fix) - only print args passed to litellm when debugging mode is on by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7708
(perf) - only use response_cost_calculator 1 time per request. (Don't re-use the same helper twice per call ) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7709
[BETA] Add OpenAI /images/variations + Topaz API support by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7700
(litellm sdk speedup router) - adds a helper _cached_get_model_group_info to use when trying to get deployment tpm/rpm limits by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7719

Full Changelog: BerriAI/litellm@v1.57.8...v1.57.10

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.10

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	240.0	264.0629029362514	6.184926091214754	0.0	1851	0	213.62108399998192	1622.618584999998
Aggregated	Passed ✅	240.0	264.0629029362514	6.184926091214754	0.0	1851	0	213.62108399998192	1622.618584999998

`v1.57.8`

Compare Source

What's Changed

(proxy latency/perf fix - user_api_key_auth) - use asyncio.create task for caching virtual key once it's validated by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7676
(litellm sdk - perf improvement) - optimize response_cost_calculator by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7674
(litellm sdk - perf improvement) - use O(1) set lookups for checking llm providers / models by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7672
(litellm sdk - perf improvement) - optimize pre_call_check by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7673
[integrations/lunary] allow to pass custom parent run id to LLM calls by @hughcrt in https://github.com/BerriAI/litellm/pull/7651
LiteLLM Minor Fixes & Improvements (01/10/2025) - p1 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7670
(performance improvement - litellm sdk + proxy) - ensure litellm does not create unnecessary threads when running async functions by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7680
(litellm proxy perf) - pass num_workers cli arg to uvicorn when num_workers is specified by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7681
fix proxy pre call hook - only use asyncio.create_task if user opts into alerting by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7683
[Bug fix]: Proxy Auth Layer - Allow Azure Realtime routes as llm_api_routes by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7684

Full Changelog: BerriAI/litellm@v1.57.7...v1.57.8

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.8

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	210.0	225.29799695056985	6.153370698253471	0.0	1841	0	177.73327700001573	2088.13791099999
Aggregated	Passed ✅	210.0	225.29799695056985	6.153370698253471	0.0	1841	0	177.73327700001573	2088.13791099999

`v1.57.7`

Compare Source

What's Changed

(minor latency fixes / proxy) - use verbose_proxy_logger.debug() instead of litellm.print_verbose by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7664
feat(ui_sso.py): Allows users to use test key pane, and have team budget limits be enforced for their use-case by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7666
fix(main.py): fix lm_studio/ embedding routing by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7658
fix(vertex_ai/gemini/transformation.py): handle 'http://' in gemini p… by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7660
Use environment variable for Athina logging URL by @vivek-athina in https://github.com/BerriAI/litellm/pull/7628

Full Changelog: BerriAI/litellm@v1.57.5...v1.57.7

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	218.4749677188173	6.216185012755876	0.0	1860	0	177.92223199990076	3911.6109139999935
Aggregated	Passed ✅	200.0	218.4749677188173	6.216185012755876	0.0	1860	0	177.92223199990076	3911.6109139999935

`v1.57.5`

Compare Source

🚨🚨 Known issue - do not upgrade - Window's compatibility issue on this release

Relevant issue: https://github.com/BerriAI/litellm/issues/7677

What's Changed

LiteLLM Minor Fixes & Improvements (01/08/2025) - p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7643
Litellm dev 01 08 2025 p1 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7640
(proxy - RPS) - Get 2K RPS at 4 instances, minor fix for caching_handler by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7655
(proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7659
(proxy perf improvement) - use uvloop for higher RPS (10%-20% higher RPS) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7662
(Feat - Batches API) add support for retrieving vertex api batch jobs by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7661
(proxy-latency fixes) use asyncio tasks for logging db metrics by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7663

Full Changelog: BerriAI/litellm@v1.57.4...v1.57.5

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.5

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	230.0	282.70225500655766	6.115771768544881	0.0	1830	0	206.44150200001832	3375.4479410000044
Aggregated	Passed ✅	230.0	282.70225500655766	6.115771768544881	0.0	1830	0	206.44150200001832	3375.4479410000044

`v1.57.4`

Compare Source

What's Changed

fix(utils.py): fix select tokenizer for custom tokenizer by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7599
LiteLLM Minor Fixes & Improvements (01/07/2025) - p3 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7635
(feat) - allow building litellm proxy from pip package by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7633
Litellm dev 01 07 2025 p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7622
Allow assigning teams to org on UI + OpenAI omni-moderation cost model tracking by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7566
(fix) proxy auth - allow using Azure JS SDK routes as llm_api_routes by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7631
(helm) - bug fix - allow using migrationJob.enabled variable within job by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7639

Full Changelog: BerriAI/litellm@v1.57.3...v1.57.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	218.7550845980808	6.268875045928877	0.0	1876	0	170.9488330000113	1424.4913769999812
Aggregated	Passed ✅	200.0	218.7550845980808	6.268875045928877	0.0	1876	0	170.9488330000113	1424.4913769999812

`v1.57.3`

Compare Source

Full Changelog: BerriAI/litellm@v1.57.2...v1.57.3

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.3

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	240.0	273.577669278204	6.101109800829093	0.0	1826	0	209.38834100002168	2450.7287210000186
Aggregated	Passed ✅	240.0	273.577669278204	6.101109800829093	0.0	1826	0	209.38834100002168	2450.7287210000186

`v1.57.2`

Compare Source

What's Changed

Prompt Management - support router + optional params by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7594
aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7598
(Fix) security of base image by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7620
Litellm dev 01 07 2025 p1 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7618
(Feat) soft budget alerts on keys by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7623
LiteLLM Minor Fixes & Improvement (01/01/2025) - p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7615

Full Changelog: BerriAI/litellm@v1.57.1...v1.57.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	190.0	212.2353391522645	6.34173008698281	0.0	1898	0	174.4866640000282	3470.5951910000013
Aggregated	Passed ✅	190.0	212.2353391522645	6.34173008698281	0.0	1898	0	174.4866640000282	3470.5951910000013

`v1.57.1`

Compare Source

What's Changed

(perf) - fixes for aiohttp handler to hit 1K RPS by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7590
(latency/perf fixes - proxy) - use async_service_success_hook by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7591
(Feat) - allow including dd-trace in litellm base image by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7587
(proxy perf improvement) - remove redundant .copy() operation by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7564
Refresh VoyageAI models, prices and context by @fzowl in https://github.com/BerriAI/litellm/pull/7472
LiteLLM Minor Fixes & Improvements (01/06/2025) - p3 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7596
LiteLLM Minor Fixes & Improvements (01/06/2025) - p2 by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7597

Full Changelog: BerriAI/litellm@v1.57.0...v1.57.1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	250.0	286.96666935492755	6.035628429692609	0.0	1806	0	226.66728699999794	3887.529271000062
Aggregated	Passed ✅	250.0	286.96666935492755	6.035628429692609	0.0	1806	0	226.66728699999794	3887.529271000062

`v1.57.0`

Compare Source

What's Changed

(Fix) make sure init custom loggers is non blocking by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7554
(Feat) Hashicorp Secret Manager - Allow storing virtual keys in secret manager by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7549
Create and view organizations + assign org admins on the Proxy UI by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7557
(perf) fix [PROXY] don't use f string in add_litellm_data_to_request() by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7558
fix(groq/chat/transformation.py): fix groq response_format transforma… by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7565
Support deleting keys by key_alias by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7552
(proxy perf improvement) - use asyncio.create_task for service_logger_obj.async_service_success_hook in pre_call by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7563
add fireworks_ai/accounts/fireworks/models/deepseek-v3 by @Fredy in https://github.com/BerriAI/litellm/pull/7567
FriendliAI: Documentation Updates by @minpeter in https://github.com/BerriAI/litellm/pull/7517
Prevent istio injection for db migrations cron job by @lowjiansheng in https://github.com/BerriAI/litellm/pull/7513

New Contributors

@Fredy made their first contribution in https://github.com/BerriAI/litellm/pull/7567
@minpeter made their first contribution in https://github.com/BerriAI/litellm/pull/7517

Full Changelog: BerriAI/litellm@v1.56.10...v1.57.0

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.57.0

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	200.0	212.84027329611826	6.1961289027318704	0.0	1854	0	174.45147399996586	1346.3216149999653
Aggregated	Passed ✅	200.0	212.84027329611826	6.1961289027318704	0.0	1854	0	174.45147399996586	1346.3216149999653

`v1.56.10`

Compare Source

What's Changed

fix(aws_secret_manager_V2.py): Error reading secret from AWS Secrets … by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7541
Support checking provider-specific /models endpoints for available models based on key by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7538
feat(router.py): support request prioritization for text completion c… by @krrishdholakia in https://github.com/BerriAI/litellm/pull/7540
(Fix) - Docker build error with pyproject.toml by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7550
(Fix) - Slack Alerting , don't send duplicate spend report when used on multi instance settings by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7546
add cohere/command-r7b-12-2024 by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/7553

Full Changelog: BerriAI/litellm@v1.56.9...v1.56.10

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.56.10

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	230.0	268.3301603401397	6.21711064668469	0.0	1861	0	212.36320399998476	3556.7401620000396
Aggregated	Passed ✅	230.0	268.3301603401397	6.21711064668469	0.0	1861	0	212.36320399998476	3556.7401620000396

Configuration

📅 Schedule: Branch creation - "every weekend" in timezone US/Eastern, Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

renovate-approve bot approved these changes Jan 18, 2025

View reviewed changes

renovate bot force-pushed the renovate/litellm-1.x branch 2 times, most recently from 7455cd0 to a2495a7 Compare January 18, 2025 22:01

renovate bot changed the title ~~Update dependency litellm to v1.58.4~~ Update dependency litellm to v1.59.0 Jan 18, 2025

Update dependency litellm to v1.59.0

605978d

renovate bot force-pushed the renovate/litellm-1.x branch from a2495a7 to 605978d Compare January 18, 2025 22:03

renovate bot merged commit afaa36b into main Jan 19, 2025
11 checks passed

renovate bot deleted the renovate/litellm-1.x branch January 19, 2025 01:38

odlbot mentioned this pull request Jan 21, 2025

Release 0.28.0 #1978

Merged

13 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update dependency litellm to v1.59.0 #1972

Update dependency litellm to v1.59.0 #1972

renovate bot commented Jan 18, 2025 •

edited

Loading

Update dependency litellm to v1.59.0 #1972

Update dependency litellm to v1.59.0 #1972

Conversation

renovate bot commented Jan 18, 2025 • edited Loading

Release Notes

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

🚨Alpha - 1.58.0 has various perf improvements, we recommend waiting for a stable release before bumping in production

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

v1.58.0 - Alpha Release

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

v1.57.11 - Alpha Release

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

v1.57.10 - Alpha Release

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

🚨🚨 Known issue - do not upgrade - Window's compatibility issue on this release

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

New Contributors

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

What's Changed

Docker Run LiteLLM Proxy

Don't want to maintain your internal proxy? get in touch 🎉

Load Test LiteLLM Proxy Results

Configuration

renovate bot commented Jan 18, 2025 •

edited

Loading