Is that specific to totem for you or does it happens also with mplayer as pointed by a previous comment or xine-ui? It might be a videodriver issue -- Totem-gstreamer exits immediately on AIGLX theora files https://launchpad.net/bugs/49360