Rigidbody moves away from the original GameObject when Center of Mass is set in every frame

Reproduction steps:
1. Open the attached “RB-Breaker.zip” project
2. Open the “SampleScene” scene
3. Open the Physics Debugger Window (WIndow > Analysis > Physics Debugger)
4. Select the Cube GameObject from the Hierarchy
5. Hold the middle mouse button and move in the Scene View

Expected result: Rigibody Gizmo remains in the original place
Actual result: Rigibody Gizmo starts moving away from the Cube GameObject

Reproducible with: 2021.3.37f1, 2022.3.26f1, 2023.2.19f1, 6000.0.0b16

Reproducible on: Windows 11
Not reproducible on: No other environment tested

Notes:

• Does not reproduce if “Automatic Tensor” is disabled in Rigidbody settings and “Invertia Tensor Rotation” is set to (0;0;0)
• Also reproduces in the Play mode
• Freezing Position on all axes while the “Is Kinematic” is set to “true” does not reproduce the issue
• Setting “Is Kinematic” to “false” and “Is Trigger” to “true” does not reproduce the issue in 2022.3 and above