Skip to content

[Metrics] Track Episode Cache Memory Usage #103

Description

@DsThakurRawat

Description (GFI)

Granular memory tracking for the KV cache.

Task

  • Update EpisodeCache to compute the byte-size of its stored tensors.
  • Expose reflex_episode_cache_bytes_total as a Prometheus metric.

Metadata

Metadata

Assignees

Labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions