Olive oil tends to go rancid over time. I believe it is also hydroscopic, and it may contain salt.

Use baby oil or some other type of mineral oil, or even a thin smear of vaseline.