[Hermes Agent] [ T3 Code ] Add Effect.Cache-based provider API response caching#5419
Closed
MrDwarf7 wants to merge 2 commits into
Closed
[Hermes Agent] [ T3 Code ] Add Effect.Cache-based provider API response caching#5419MrDwarf7 wants to merge 2 commits into
MrDwarf7 wants to merge 2 commits into
Conversation
- Register t3code:// as default protocol client - Handle macOS open-url and Windows/Linux second-instance events - Parse deep link URLs into routes (open/project, chat/thread, settings) - Route to renderer via IPC channel - Validate project paths against traversal attacks - Focus existing window or launch new instance - Cross-platform (macOS, Windows, Linux) - 16 unit tests passing
… caching - ProviderCache service with two Effect.Cache instances: - Model list cache: 5-minute configurable TTL - Capability cache: 15-minute configurable TTL - Automatic deduplication of concurrent requests per key - Provider config invalidation via invalidateProvider() - Cache hit/miss tracking via Ref counters (accessible via getStats) - Bounded at 256 max entries per cache - Failing lookup triggers caller-provided fetch on cache miss - contributor_meta.json included
Contributor
|
Unfortunately the changes in this PR didn't fully resolve the issue. Please rework your solution and submit a new pull request. Make sure to review the acceptance criteria in the linked issue and verify all conditions are met before resubmitting. See CONTRIBUTING.md for guidelines. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
/claim #865
Summary
Adds Effect.Cache-based provider API response caching with configurable TTL to reduce redundant provider API calls.
Implementation
Creates a new
ProviderCacheservice int3code/apps/server/src/services/ProviderCache.ts:invalidateProvider(key)clears both caches for a providergetStats()Files Changed
src/services/ProviderCache.tssrc/services/contributor_meta.jsonAcceptance Criteria
invalidateProvider