Skip to content

billing endpoint changes #14

@earonesty

Description

@earonesty

billing speed up and reliability:

  1. directly hit db for billing
  2. use a similar "lazy" mechanism for hitting the db as we do for the stats (check on first connect, cache info, queue updates to db, auto-transactions). abstract this mechanism so we have a single db update thread for billing and stats updates!
  3. track account credits internally in ram for recent users (LRU cache), so we don't have to check billing at all for inference continuation (better to err on allowing small overdraft too)
  4. remove endpoint from vercel / reliance on vercel

Metadata

Metadata

Assignees

No one assigned

    Labels

    bountyWe will pay to get this done. Needs to be clean code!

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions