I found that spamming lots of random filters and then attempting to remove them one-by-one often causes one or more of them to "stick" or duplicate. Stuck filters cannot be removed either by clicking or de-selecting them via the filter menu.
I have not found an exact way to reproduce this issue but randomly spamming filters seems to do the trick.