I attempted to fix this in v20.11.25, but I am going to remove it because ti causes this problem:
I have no intention of trying to fix this again. You can use the new deselect button in Filters or as mentioned above: ignore it when it is not relevant, or select a different clip or filter.