[Bug 1260012] Re: app snapshot during test setup is being set to an empty list

[Thomi Richards]

Right, as discussed with jibel on IRC, I think the best thing to do in
this case is to disable the snapshot testing. You're running in such an
unusual environment that trying to fix this for your use case will take
a significant amount of effort, and won't really help you much anyway.

The best way to disable this is to override a method in
AutopilotTestCase, like so:

class MyTests(AutopilotTestCase):

    def _compare_system_with_app_snapshot(self):
        pass  # Disable application snapshot comparison.


I'm marking this as 'won't fix' in autopilot. If the solution above isn't acceptable to you, please let me know and we can try and work out something else.

Cheers,

** Changed in: autopilot
       Status: Incomplete => Won't Fix

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to ubiquity in Ubuntu.
https://bugs.launchpad.net/bugs/1260012

Title:
  app snapshot during test setup is being set to an empty list

Status in Autopilot:
  Won't Fix
Status in “ubiquity” package in Ubuntu:
  New

Bug description:
  During the Ubiquity autopilot tests we are getting frequent fails
  where get_running_applications() is not picking up Ubiquity as a
  running application and is setting the app snapshot to an empty list
  then when it comes to comparing the snapshot the test is failing as
  its now detected ubiquity is running.

  The test runner launches ubiquity and waits 30 seconds before starting
  the test, so slow app loading time isn't an issue here

  see https://jenkins.qa.ubuntu.com/view/Ubiquity/view/Ubuntu/job
  /ubiquity_ap-ubuntu_devel_daily-
  test_nonenglish_encrypt_lvm/ARCH=i386,label=rabisu/lastCompletedBuild/testReport/ubiquity_autopilot_tests.tests.test_nonenglish_encrypt_lvm/LVMEncryptInstallTestCase/test_lvm_encrypt_install/

  This doesn't occur on every run but i could manage to reproduce it
  locally 1 in every 5/6 runs 'ish'.

  Steps to try and reproduce

  1) branch lp:ubiquity
  2) make sure qemu and bsdtar are installed and have a daily iso (Ubuntu, Ubuntu-GNOME and Edubuntu currently working)
  3) from dir ./ubiquity/autopilot/ubiquity-autopilot-runner execute using the configfile attached to this bug

      ./run-ubiquity-test -T/path/to/debug_config.cfg ./path/to/trusty-
  desktop.iso

  4) test artifacts are stored in /tmp/ubiquity.tests

  If you want additional artifacts or additional autopilot options or
  even stop the VM shutting down for debugging you can change the config
  file accordingly

  You can also use the --sdl param if you want to view the desktop. All
  other test runner info can be found in the README if needed

  I will also attach the autopilot.log file that shows the app snapshot
  is empty, see 14.18 time interval

  If any other info is needed contact myself or jibel

To manage notifications about this bug go to:
https://bugs.launchpad.net/autopilot/+bug/1260012/+subscriptions