There’s Edit->Swap Layers. Find out which layers are left off and which stay, and swap the layers accordingly before changing the number of copper layers.
There’s Edit->Swap Layers. Find out which layers are left off and which stay, and swap the layers accordingly before changing the number of copper layers.