British heavyweight Johnny Fisher feels he may have been "too pally" with Dave Allen before December's controversial victory in Saudi Arabia.