Raycasts fail to hit Collider when there is a different GameObject with a Collider very far away in the scene

How to reproduce:
1. Open the attached project "case_1136525-RaycastBug" and scene "TestScene"
2. Enter Play Mode
3. In the Hierarchy select the "OutOfBoundsObject" GameObject and make it active through the Inspector
4. Observe changes in the Console Window

Expected result: the Console Window keeps outputting "Hit == True" at all times in Play Mode
Actual result: Console Window starts showing "Hit == False" when "OutOfBoundsObject" is disabled

Reproducible with: 2018.3.0a5, 2018.3.9f1, 2019.1.0b7, 2019.2.0a8
Not reproducible with: 2017.4.23f1, 2018.3.0a4

Note: both "RaycastTarget" and "OutOfBoundsObject" have to have RigidBody Components. The "RaycastTarget" fails to be hit only when in certain configurations of its position and the raycast origin's position