Don't ever overwrite IdP configuration files.