Rect Transform's Pivot is affecting scene gizmo handles

Steps to repro:

1) Open attached project or simply make an empty one

2) Add a TMP button to the scene

3) Select its child text object

4) In Rect Transform inspector tweak the Pivot property

5) Observe that it affects the visual scale of handles in the Scene view

 

Checked only 2023.2, 2021.3. Bug probably affects other streams too.