Even though you are confirmed as a combatant after registration closes, you can still leave your alliance at any time before the battle starts.