How to reproduce:
1. Open the attached project (IN-18268.zip)
2. In the Project panel double-click to open the Prefab
3. In the Hierarchy at the top left press the arrow to close the prefab view
Expected result: the prefab view closes without any prompts
Actual result: A "Prefab Has Been Modified" prompt shows up
Reproducible with: 2021.2.0a9, 2021.3.14f1, 2022.1.23f1, 2022.2.0b16, 2023.1.0a20
Not reproducible with: 2020.3.42f1, 2021.2.0a8
Reproducible on: Windows 10, Ubuntu 20.04