When we use a voltmeter, we are creating a parallel path across a device, which draws a small amount of current away from the device being tested. This impact on the voltage across that device (because V=IR, and we are reducing I). To minimize this effect, the meter should draw as little current as possible - which happens if its resistance is "very large".