What you are doing is good enough. Neatsfoot won't ruin the leather, but it should be used sparingly and generally only if the leather needs it (losing suppleness, sanding out a cut or nick, etc.)
...