Menus stay on the screen even their windows are closed

Steps to reproduce:

1. Create any  project
2. Go to the menu "Window"  and select "Package Manager"
3. Click the dropdown icon next to  "+"
4. Verify, that the contextual menu with 4 install options should become visible
5. Leave it open and close the "Package Manager" window
6. Observe the contextual menu

Expected Result: Contextual menu should be closed with the window

Actual Result: Contextual menu still displayed on the screen even window is closed. Added video in the "Attachments" section.

Reproducible with: 2023.2.0a15, 2023.2.0a19

Not Reproducible with: 2023.2.0a14, 2023.1.0b20, 2022.3.2f1, 2021.3.27f1

Confirmed OS: MacOS Monterey.

Note for Linux: if the context menu is spawned during domain reload (create a new script and immediately right click on it while it's in rename mode) the window will stay on top of other windows - see screenshot.