It is as per the definition
we can also say that potential is the work done for bringing a unit charge from infinity to that point
there is no problem if it is negative
the work done will be mathematicaly negative
But by definition,we are saying it as positive unit charge