One way to fix this is to ignore small mouse movements. I believe
xscreensaver does this.
** Changed in: gnome-screensaver (Ubuntu)
Severity: Wishlist => Minor
Status: Unconfirmed => Confirmed
--
mouse movement wakes screensaver
https://launchpad.net/bugs/37139