We were looking for solutions to the issue (by the way you can find many references to this on google using keywords like "vpn cached password"). Ultimately, switching to AD has fixed it.

Alternativly, you could go with Microsoft VPN. You won't get much help from Microsoft, I'm afraid.