Computation and printing of 5-minute vs 1-hour costs per proxied request? #89
cameronelliott
started this conversation in
Ideas
Replies: 1 comment
|
The proxy doesn't print this directly, but claude-code-meter (a companion tool we publish) reads cache-fix's per-session quota-status logs and computes per-call costs by TTL tier. That gets you actual consumption broken down by tier; the "theoretical 5m if you were on 1h" side-by-side comparison would need an extension on top of that. Worth filing as an issue on the meter repo if you'd like it tracked — the data is all there to compute the comparison, it's just not surfaced as a side-by-side view yet. Your use case (long inter-message delays on Sonnet) is exactly where the 1h tier would show its value, so the comparison would be meaningful for you. — Chris |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi, I'm new here, but I am so glad you implemented this! It looks awesome.
I am doing lots of thoughtful, long inter-message-delay (I think for 10 minutes) chats with Sonnet, and I have a feeling I am paying way more tokens than I need to. (with a 5-min TTL vs a 1-hr TTL)
I will give the proxy a try, but would would rock my socks off, is if the proxy printed to either debug-log or stdout-log data that showed token consumption for both 5-min TTL AND 1-hr TTL. (one would be actual consumption, and one would be theoretical consumption)
Maybe this is already in the proxy? (Sorry if I am asking for an existing feature!)
I am not sure all the data is available to the proxy to compute those numbers easily, but it seems like it might be, so I thought I would throw out the idea.
Thanks,
Cameron
All reactions