Capacitance with the dielectric is given by:
Presence of the dielectric increase the capacitance of the capacitor.
Voltage across it is given by:
V = q/C
where q is the charge stored in the capacitor.
As C increases, V decreases,
Hence Presence of dielectric decrease the Voltage across the capacitor .