[Bug 1541334] Re: Do not run britney on all of proposed

[Martin Pitt]

It would actually not be wrong IMHO. Britney does installability tests
in isolation, and for a fair while we have set up apt pinning to also
run the tests in isolation -- i. e. we only install the trigger from
-proposed, but the tested package (if different than the trigger) and
all other test dependencies come from release. This prevents cases like
that silo where kwin got broken by the unrelated libhybris update in
xenial-proposed, but the new Qt gets the blame in that silo.

Transitioned to silos, that means that we want to run tests with the
*trigger* from the silo, but everything else from Ubuntu. This requires
some legwork in adt-run, as a silo isn't a discernibly different pocket,
so we need to adjust the apt pinning somehow. And then disable the "use
everything from -proposed" flag in the autopkgtest worker.

** Also affects: autopkgtest (Ubuntu)
   Importance: Undecided
       Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to autopkgtest in Ubuntu.
https://bugs.launchpad.net/bugs/1541334

Title:
  Do not run britney on all of proposed

Status in Bileto:
  Incomplete
Status in autopkgtest package in Ubuntu:
  New

Bug description:
  Currently all of -proposed is used for britney testing, which results
  in failures that may not be due to the silo.

  From #ubuntu-devel:
  20160203|12:25 < pitti> Mirv: ah, I guess robru tests PPAs against all -proposed
  20160203|12:26 < pitti> Mirv: so, I don't want to override that in ubuntu as it's clearly a regression, and either libhybris or kwin needs to be updated
  20160203|12:26 < pitti> and by overriding we would let libhybris in and land the regression
  20160203|12:28 < pitti> Mirv: so I'd recommend to just ignore that one failure for this landing
  20160203|12:30 < pitti> Mirv: it would probably be better if we tested PPAs not against the entirety of -proposed, so that they are better isolated against such unrelated breakage
  20160203|12:31 < pitti> or, once someone fixes libhybris or kwin, we can retry it and then it'll work too

To manage notifications about this bug go to:
https://bugs.launchpad.net/bileto/+bug/1541334/+subscriptions