Kibana discover view

[sirdrug]

Good day! Due to the peculiarities of storing data in elasticsearch, there may be thousands of fields in dataview, but in discover we will only see those that actually exist in a specific document. Is it possible to repeat this behavior in quesma?
Example kibana with elasticsearch backend:

Example kibana with quesma/clickhouse backend:

[pdelewski]

Yes, because we control the response to Kibana, replicating this behavior in Quesma shouldn’t be a problem.

[pdelewski]

@sirdrug Additional question: are the above fields, in your case, only strings, or can they be of arbitrary types?

[trzysiek]

Hi @sirdrug !
I implemented such feature and it seems working (#1490). There are some small todos in the PR, but it should already work if you needed that.

Responding to pdelewski question, I think it can only be done for strings.
Other types I think of - ints, IPs, Geo, etc. don't have any empty value, only strings (feel free to correct me, haven't thought about it too much).
They can be Nullable, but in that case Quesma already filters out such values.