It might have to do with the direction of the grain of your beard at and below the jawline.

Some people, like me, have a beard that runs north to south above the jaw but west to east below the...