I'm back from vacation and I finally got this mouse-powered scroller working so you can enter at any point without it jumping. Red line is its delta reference.