If you know the direction of flow of current, can you say all the particles of the current are going only in that direction at any point of time?
No, they need not at every point of time, but the net movement is in the direction of the current.
When we say that there is a current of balls, we actually mean that the net movement of the balls over a period of time is in the direction of the current. The balls, individually, could be moving in any random direction at any given instance.