It's supposed to ask for non-empty panels and that works fine for me.
What do you have on your panel?
** Changed in: gnome-panel (Ubuntu)
Assignee: (unassigned) => Ubuntu Desktop Bugs
Status: Unconfirmed => Needs Info
--
Should request confirmation for panel removal/deletion
https://launchpad.net/bugs/40333