Thank you for submitting this issue to us. There is quite an easy fix for it. If you assign a custom Lightmap Parameters asset to you Lighting Settings, you will be able to adjust the "Pushoff" parameter. Increasing that until you get the desired results (but no more!) will fix the issue you're seeing.
This issue is caused by floating point errors in the rays and unfortunately tthere is no one-size-fits-all value.