Navigating ListView with keyboard opens the wrong Elements

How to reproduce:
1. Open the attached "ListNavigation.zip" Project
2. Open "SampleScene" Scene (Assets -> Scenes -> SampleScene)
3. Click on "GameObject" Gameobject
4. Expand the Drops section of the Script Component
5. Click on any Element with a mouse
6. Try Navigating to other Elements using arrow keys and open them up using arrow keys
7. Observe the results

Expected result: The hovered Element opens up when clicking the right arrow key
Actual result: The first Element that was clicked using the mouse is opened

Reproducible with: 2023.2.14f1

Reproduced on: macOS Sonoma 14.3 (M1)