From the build team's investigation, it looks like the Asset isn't deleted in the AssetDatabase. We would recommend users use AssetDatabase.DeleteAsset as opposed to File IO in these cases.
If further issues arise with AssetDatabase.DeleteAsset then that would be a good bug to file!