This issue started probably a month or two ago. I have bepinex enabled.

I had the daily restart enabled, but every day players reported they could not connect to the server and so I had to restart the whole container.

Eventually I disabled the daily restart, and now, whenever a Valheim update happens and the container does the internal restart, again players can't connect and I have to restart the container.