Sponge is made up if fine fibres that are solid. But sponge fibres are tangled and have small air spaces inside them. Availability of air pockets is the reason for the compressibility of sponges.
Solids can't be compressed. The sponge is not solid because it can be compressed.