The amount of damage is determined by
the amount of force applied on the wall.
A heavy truck in motion has very high momentum compared to a moving bicycle as its mass is thousands of times more then a bicycle.Since force is proportional to the rate of change of momentum, the truck will apply a far greater force on the wall than the bicycle. That's why a truck will do more damage to the wall compared to a bicycle.