Focal distance has impact on SceneView

Repro:
1) Open any HDRP project
2) Look at the Scene view
3) Change the Focal Distance on the camera

Result: Scene view changes (issue.mp4)
Expected: Scene view doesnt change (expected.mp4)

Working fine on 2023.1.a20

Broken on 2023.1.a23 or graphics/srp/devs

Bisection is not mandatory as the cause is known:
https://unity.slack.com/archives/C6Y79CZM0/p1669911523047269?thread_ts=1666082700.562659&cid=C6Y79CZM0