Prince Harry has denied having a fight with Prince Andrew after it was claimed "punches were thrown" between the pair in 2013.