The correct option is E first
It usually takes time to get into any relationship, be it friendship. The phrase 'at first' means 'at the very beginning'. So, in this context the speaker says that at first he didn't get well with a particular person but later on they became friends. So, option B is correct and the others are not because they do not provide the correct answer.