Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix: cheaper query for fetching log attribute values for filter suggestions #5989

Merged

Conversation

raj-k-singh
Copy link
Collaborator

Summary

The existing query worked fine for most attributes that typically do not have a large number of distinct values.
However, while uncommon, attributes like message can end up having 100s of millions of values in the tag_attributes table.
This change updates the query used for fetching log attribute values to ensure it is always cheap regardless of how many values an attribute has in the tag_attributes table.

Related Issues / PR's

Fixes #5988

Affected Areas and Manually Tested Areas

Logs filter suggestions

@github-actions github-actions bot added the bug Something isn't working label Sep 17, 2024
@raj-k-singh raj-k-singh merged commit 8c891f0 into develop Sep 17, 2024
13 checks passed
@raj-k-singh raj-k-singh deleted the fix/cheaper-query-for-fetching-attribs-for-log-attribute branch September 17, 2024 10:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Logs: Filter Suggestions Query consume too much CPU for very high cardinality attributes like "message"
2 participants