From another thread with the opposite problem:
Edit the pad properties and uncheck the F.Mask layer.
There will be copper on both sides of the hole, but the top pad will be covered with solder avoiding contac without losing strength.
I have never done it, anyway I would give it a try.