The mods that are installed on the server will all force their server configurations on the clients when they join. If you don't have the same configurations in your local mod files, you can have problems when, for some reason, a mod fails to load due to an update or if you play in single player mode. It is always best to have the same config files in your local configs folder as the ones on the server that you play on. You can find information about mod configs on the Discord server in the mod-config-info channnel.
Use the link below to get the current server mod config files. 10thRealmConfigs.zip
If you don't already know, the unzipped .cfg files go into C:\Program Files (x86)\Steam\steamapps\common\Valheim\BepInEx\config
Any changes to the configuration files or mod versions are always posted in the Discord mod-updates and general text channels. I try to avoid changing the mods and configurations as much as possible during the progression of a world, but sometimes it has to done anyway.