Hi there,
Yes, that is exactly what it is supposed to do, as it simulates a ground fault and shuts off. If you pushed the button and the switch would not do that, this would let you know that the switch itself is faulty and needs to be replaced. Hope this helps.
Cheers,
Ralf