You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At the moment the index is comprised of many many fields that are not used as a side effect of mapping the atomic definition to Elasticsearch. To reduce the size of the index it would be nice to be able to control what fields we care about storing in the index.
The text was updated successfully, but these errors were encountered:
@BenFradet we were thinking about a bit of a blacklist where after you had processed the enriched event you could just drop the key from the final JSON that gets sent to Elasticsearch.
At the moment because we essentially translate it to a atomic.events definition there are a lot of fields that are always null. If this could be known ahead of time you could just remove these keys and never have them added to the mapping in the Elasticsearch index.
from snowplow/snowplow#3195:
The text was updated successfully, but these errors were encountered: