HDR color changes to a different outcome when any modifier is changed during animation recording

Reproduction steps:
1. Open the attached “Bug” project
2. Open the “Assets/Scenes/Test.unity” Scene
3. Enter the Play Mode
4. Observe the Game View

Expected result: The GameObjects' colors are not impacted by the animation, only their alpha
Actual result: GameObject on the right changes to a darker color

Reproducible with: 2020.3.47f1, 2021.3.22f1, 2022.2.16f1, 2023.1.0b13, 20231.2.0a11

Reproducible on: Intel MacOS 13.3