If you know that the current is in a particular direction, then can you say all the 'balls' are going only in that direction at any point of time?
Not every time, but definitely sometimes.
When we say that there is a current of balls, we actually mean that the net movement of the balls over a period of time is in the direction of current. The balls, individually, could be moving in any random direction at any given point of time.