I too have this annoyance, but it's not /too/ bad.
** Changed in: gnome-keyring (Ubuntu)
Severity: Normal => Wishlist
Status: Unconfirmed => Confirmed
--
Integrate with pam-keyring to securely avoid keyring password challenge
https://launchpad.net/bugs/48132