custom triton cache manager#3659

grimoire wants to merge 5 commits intoInternLM:mainInternLM/lmdeploy:mainfrom

grimoire:custom-triton-cache-managergrimoire/lmdeploy:custom-triton-cache-managerCopy head branch name to clipboard