I'd suspect the soap. Just change one thing at a time to get the real culprit. In my experience the only difference between face and bowl lathering ends at the bowl or puck. Once on the face it is...