You are doing some work when you are swimming forward in a swimming pool with a butterfly stroke.
According to the definition of work done, while swimming you are applying muscle force and moving forward and the net force direction is definitely not perpendicular to the direction of displacement. Hence, work is done by you.