[Runtime Filter] Why does the in_list (and min_max) runtime filter apply only to prune partitions

[JasonLi-cn]

Why can't in_list runtime filter be applied to row granularity filtering, like bloom runtime filter.🤔

[BohuTANG]

I would like to ping @xudong963 here , he is the Databend runtime filter impler.

[xudong963]

in_list runtime filter will generate when build side row number is less than 1024, but bloom runtime filter doesn't have the limitation. They have similar effect for row granularity filtering, so using bloom runtime filter is enough.

[JasonLi-cn]

BTW, When will the distributed runtime filter be implemented?

[xudong963]

Broadcast join has implemented runtime filter, the next step is to support rf for shuffle join