Size of ShadowCaster2D with Casting Source set to a Collider increases when RigidBody2D is attached to the GameObject

Reproduction steps:
1. Open the attached “BugRepro” project
2. Open the “Assets/Scenes/SampleScene” Scene
3. In the Hierarchy window, select “Without Rigidbody” GameObject
4. Add a Rigidbody2D Component (Component > Physics 2D > Rigidbody 2D)
5. Observe the GameObject in the Scene view

Expected result: The Shadow Caster 2D stays the same size
Actual result: The size of the Shadow Caster 2D increases

Reproducible with: 2023.2.20f1, 6000.0.0b16
Couldn't test with: 2021.3.37f1, 2022.3.26f1 (Casting Source option is not available)

Reproducible on: Windows 11
Not reproducible on: No other environments tested