The Scene view is stuttery and unresponsive when using VS 2022 debugging mode

Steps to reproduce:
1. Create a new project
2. In the Project window create a new C# script
3. Open the created C# script
4. In Visual Studio 2022 click the “Attach to Unity“ button
5. Open Unity Editor
6. In the Scene view right click and try to move around the scene

Expected result: Moving around the scene is smooth and responsive
Actual result: Scene view stutters and is unresponsive

Reproducible with: 2020.3.40f1, 2021.3.10f1, 2022.1.17f1, 2022.2.0a10
Not reproducible with: 2022.2.0a11, 2022.2.0b7, 2023.1.0a11

Reproducible on: Windows 10

Note: Not reproducible with Rider and VS Code