If a soft pull takes it off then it's still not in right.
Make sure the pushpins are pulled all the way up and in the position where you will not have to turn them. There is a little bump to hold them in so you want to push them down over that bump and then that pin will click in to place.
It's one of those things where you have to be cruel to be kind and just give it a bit of welly to make sure they are in all the way and in the right position.