Yeah. I see what you mean. When you put the filter on a track, it watches for discontinuities (like the start of a new clip) and it resets the averaging window.
A workaround is to add the filter to the Output of the timeline instead of of the track:
The side effect of this is that it applies normalization to the entire project, not just the one track.