I do think you should implement a rolling average. And when over the rolling average barely any progress has been made, add a little pointer to it's current location so I don't have to precisely move the mouse and then 5 minutes later wonder if I had accidentally bumped the mouse or yes progress has been made