"Remove texture only valid for surface data" error message in the Console when exiting Play mode

Reproduction steps:

1. Open user attached project "2023-beta-test.zip"
2. Enter Play mode
3. Activate Headset
4. Exit Play mode

Expected result: No error messages in the Console
Actual result: 3 error messages "Remove texture only valid for surface data" in the Console

Reproduced with: 1.6.0 (2023.2.0a6), 1.7.0 (2021.3.26f1, 2022.3.0f1, 2023.1.0b19, 2023.2.0a17)

Reproducible on: Windows 10

Reproducible with this device: Oculus Quest

Not reproducible with this device: Oculus Rift S

Note: Can’t test on Player, because the build fails

Customer states this can be reproduced without an XR Headset, it is just easier to do so with one:

"I was able to also reproduce this without XR, although it took more times entering play mode + exiting again (around 10 times); I also got Editor crashes when I tried to enter play mode more often. Seems some sort of memory leak, but the error message posted above “Remove texture only valid for surface data” is not very helpful I guess, as there ain’t no stacktrace."