The fix for this issue to enable camera relative light culling is disabled by default, as it chnages behaviour, and the problem is specific to certain scene configurations.
To enable the fix, enable this setting:
Edit => Project Settings => Graphics => Culling Settings => Camera Relative Culling => Lights
When enabled, if the camera is actually further away from the world origin, then the problem will persist, and in those situations, the default behaviour should be used.