Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-evaluate and document WMArchive document structure #12043

Open
amaltaro opened this issue Jul 16, 2024 · 3 comments
Open

Re-evaluate and document WMArchive document structure #12043

amaltaro opened this issue Jul 16, 2024 · 3 comments

Comments

@amaltaro
Copy link
Contributor

Impact of the new feature
WMArchive and WMAgent

Is your feature request related to a problem? Please describe.
It's been a couple of times that we had issues with WMArchive, like:

  • documents too large
  • publishing information that is not really useful for monitoring/debugging expected scenarios
  • missing information; and so on

Further information in the following 2 tickets:

Describe the solution you'd like
This is likely a meta-issue, but the initial activities to be carried out with this ticket are:

  • document the current structure of WMArchive documents
  • identify potential worst offender fields
  • identify potential duplicate information
  • share these with Computing Operations and define what we would like to keep in this monitoring.

Upon discussing the current schema, we would like have to (in future tickets):

  • refactor the new schema
  • add protections in the code, if needed (like document size)
  • update WMArchive dashboard accordingly

Describe alternatives you've considered
As mentioned in the tickets above, MonIT limits the size of such documents to ~30MB.
CMSWEB and NGinx no longer have any limits (at some point it was limiting payload to 8MB).

Additional context
The tickets above have many insights.

@amaltaro
Copy link
Contributor Author

On the use cases and important information for Ops, please refer to this comment made by Hasan:
#10879 (comment)

@vkuznet
Copy link
Contributor

vkuznet commented Aug 20, 2024

fine with me.

@amaltaro amaltaro closed this as not planned Won't fix, can't repro, duplicate, stale Aug 20, 2024
@amaltaro
Copy link
Contributor Author

Sorry, I meant to close the pull request, not the issue itself. Reopening it.

@amaltaro amaltaro reopened this Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ToDo
Development

No branches or pull requests

2 participants