Every people produce a different tone, pitch, resonance when they talk. Every people have a different style of speaking. If we are familiar with the caller's voice our brain matches the caller's voice with already available data and tells us who is the caller.