Does the filter have to be on every collection pages?

No, you can choose which collection to display the filter.