Unless it's a thick oil that has solidified, I don't see the need to clean it off at all. Just shave with it as normal.

Sometimes I strop a razor in advance and put (Ballistol) oil on it. Shaving...