Skip to content

[Docs] add details about what events to track for AI template #1863

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

ryancurtis1
Copy link
Contributor

@ryancurtis1 ryancurtis1 commented May 6, 2025

adds a little more detail to docs on what to track beyond what is already in the template

TODO

  • confirm copy on the template before shipping this change

@ryancurtis1 ryancurtis1 requested review from a team, lindseybradford and ashishbachavala and removed request for a team May 6, 2025 22:14
@ryancurtis1 ryancurtis1 requested a review from a team as a code owner May 6, 2025 22:14
@ryancurtis1 ryancurtis1 requested review from santigracia and removed request for a team May 6, 2025 22:14
Copy link

vercel bot commented May 6, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 15, 2025 10:26pm

Copy link
Collaborator

@tiffanyqi tiffanyqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code lgtm

- Sign Up: An event triggered the first time a user is identified in your system, typically upon account creation or registration.
- Start Agent: An event triggered when a user first begins interacting with an AI feature, such as opening a chatbot interface or engaging a virtual assistant.
- LLM Prompt Sent: An event recorded each time a user submits a prompt or query to an AI system. Include the prompt content as a property.
- LLM Response Sent: An event triggered when the AI system sends a response back to the user. Include properties such as api token usage (Tokens Used), estimated cost (API Cost), and latency (API Response Time).
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit API token usage

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants