The US Supreme Court had overturned a judge's decision that the men be allowed to contest their removal.