GameObject does not collide with other GameObjects when the GameObject's Layer is changed in Play Mode

Reproduction steps:
1. Open the “ReproProject“ project
2. Open the “Assets/Scenes/SampleScene“ scene
3. Enter Play Mode
4. Observe the cube on the right side in the Game View

Expected result: The cube collides with the plane
Actual result: The cube falls through the plane and does not collide

Reproducible with: 2021.3.38f1, 2022.3.30f1, 6000.0.4f1

Reproducible on: Windows 11 Pro (22H2)
Not reproducible on: No other environment tested