After investigation, the issue is resolved by setting up an Occlusion Area (Create Empty Game Object -> Add Component -> Occlusion Area) around the problematic building. According to documentation (https://docs.unity3d.com/2023.2/Documentation/Manual/class-OcclusionArea.html ) this makes Unity generate higher precision data both at Bake time and at Runtime.