It moves in the upwards direction because according to Newton's third law of motion every action has it's opposite and equal reaction.
Therefore when the air starts coming out from the
mouth of the balloon(action) in the downward direction, as a reaction the balloon moves upward .