Yes. Non-allied players can attack your Gathering Squads and take over the mine if they win. Allied gathering is shown with a blue icon and cannot be looted.