A force that requires a physical contact between the object and the person who is applying the force is called a contact force.There a two types of contact forces - muscular force and frictional force.
So we can say that it is a muscular force, since our muscles are doing action during pushing.
NOTE that muscular force is a type of contact force.
Hope this helps :)