I think it's not a bug, but a design, to allow you to use the momentary (FS-5U) foot switch as it is designed to be used. If you need the on/off just use the Latching (FS-5L) model.
It's a good thing to me!