Synopsis
If I toggle off Visualize Surfaces while the Debug Options UI is enabled, most of the scanned planes disappear, but one or two will remain visible. See RogueSurface.jpg attached.
Once I saw a surface visualization in XR Simulation while Visualize Surfaces was disabled; see xrSim.png attached. However, I do not have consistent repro steps for making this happen in XR Sim.
How to See the Bug
Open the attached repro project in Unity 2022.3.15f1.
Deploy Scenes/SampleScene to an Android phone.
Scan several planes.
Tap the ... button in the top right corner of the screen.
Enable the AR Debug Menu.
Disable Visualize Surfaces.
If the plane visualization (i.e. grid of white dots) remains visible on any of your scanned planes, then you see the bug.
Configuration
Unity 2022.3.15f1
com.unity.template.mobile-ar-template (Branch: main, Commit: ee7de2c0)
Samsung 23 Ultra
MacBook Pro - Intel