For the time being I will close it. I will add the following explanation to the bug
Fast Scrolling with UIToolkit on a vitualized container with a LOT of children is often bad for performance.
So many UItk controls need to be rebound that it makes stuttering happen.
This is an unfortunately expected behavior for now.