Firstly; thank you for reporting this issue, it inspired some interesting discussions.
Having looked into it, the issue is caused by the Addressables packages use of IMGUI (which is heavy!).
We do have plans to migrate the Addressables windows to UIToolkit, but we'll complete that work outside of a bug-fix - it's quite a large undertaking!