[Bug 1837254] Re: ubuntu-cpc parallel builds produce unused files

[Robert C Jennings]

** Description changed:

+ [Impact]
+ 
  In parallel builds where a list of image targets are provided, the build
  may produce binaries that are not part of the named set of targets but
  are created by series dependencies.  These implicitly created binaries
  may be generated by multiple builds but are unused as our convention for
  the ubuntu-cpc project is to only consume binaries from the explicitly
  named image targets; this avoids overwriting the same object by multiple
  parallel builds.  The problem is that as we build out parallel jobs for
  a number of image targets (multiplied by each supported architecture)
  we're wasting a lot of resources.
+ 
+ [Test Case]
+ 
+  * Specify an image target within the ubuntu-cpc project for a build
+ 
+  * Observe artifacts in addition to the ones for the named image target
+ are produced and downloaded
+ 
+ 
+ [Regression Potential] 
+ 
+  * An artifact from an explicitly named artifact is missing and builds
+ will begin to remove desired output.  Testing is being done to address
+ this regression.
+ 
+ [Other Info]
+  
+  * This has been running in production in Eoan for a few weeks and we're satisfied with the results.
+ 
+ [Original Description]
+ 
+ In parallel builds where a list of image targets are provided, the build
+ may produce binaries that are not part of the named set of targets but
+ are created by series dependencies.  These implicitly created binaries
+ may be generated by multiple builds but are unused as our convention for
+ the ubuntu-cpc project is to only consume binaries from the explicitly
+ named image targets; this avoids overwriting the same object by multiple
+ parallel builds.  The problem is that as we build out parallel jobs for
+ a number of image targets (multiplied by each supported architecture)
+ we're wasting a lot of resources.

** Description changed:

  [Impact]
  
  In parallel builds where a list of image targets are provided, the build
  may produce binaries that are not part of the named set of targets but
  are created by series dependencies.  These implicitly created binaries
  may be generated by multiple builds but are unused as our convention for
  the ubuntu-cpc project is to only consume binaries from the explicitly
  named image targets; this avoids overwriting the same object by multiple
  parallel builds.  The problem is that as we build out parallel jobs for
  a number of image targets (multiplied by each supported architecture)
  we're wasting a lot of resources.
  
  [Test Case]
  
-  * Specify an image target within the ubuntu-cpc project for a build
+  * Specify an image target within the ubuntu-cpc project for a build
  
-  * Observe artifacts in addition to the ones for the named image target
+  * Observe artifacts in addition to the ones for the named image target
  are produced and downloaded
  
+ [Regression Potential]
  
- [Regression Potential] 
- 
-  * An artifact from an explicitly named artifact is missing and builds
+  * An artifact from an explicitly named artifact is missing and builds
  will begin to remove desired output.  Testing is being done to address
  this regression.
  
  [Other Info]
-  
-  * This has been running in production in Eoan for a few weeks and we're satisfied with the results.
+ 
+  * This has been running in production in Eoan for a few weeks and we're
+ satisfied with the results.  We have seen overall time reduced by 20-50%
+ on some builds.
  
  [Original Description]
  
  In parallel builds where a list of image targets are provided, the build
  may produce binaries that are not part of the named set of targets but
  are created by series dependencies.  These implicitly created binaries
  may be generated by multiple builds but are unused as our convention for
  the ubuntu-cpc project is to only consume binaries from the explicitly
  named image targets; this avoids overwriting the same object by multiple
  parallel builds.  The problem is that as we build out parallel jobs for
  a number of image targets (multiplied by each supported architecture)
  we're wasting a lot of resources.

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to livecd-rootfs in Ubuntu.
https://bugs.launchpad.net/bugs/1837254

Title:
  ubuntu-cpc parallel builds produce unused files

Status in livecd-rootfs package in Ubuntu:
  Fix Released
Status in livecd-rootfs source package in Xenial:
  New
Status in livecd-rootfs source package in Bionic:
  New
Status in livecd-rootfs source package in Disco:
  New

Bug description:
  [Impact]

  In parallel builds where a list of image targets are provided, the build
  may produce binaries that are not part of the named set of targets but
  are created by series dependencies.  These implicitly created binaries
  may be generated by multiple builds but are unused as our convention for
  the ubuntu-cpc project is to only consume binaries from the explicitly
  named image targets; this avoids overwriting the same object by multiple
  parallel builds.  The problem is that as we build out parallel jobs for
  a number of image targets (multiplied by each supported architecture)
  we're wasting a lot of resources.

  [Test Case]

   * Specify an image target within the ubuntu-cpc project for a build

   * Observe artifacts in addition to the ones for the named image
  target are produced and downloaded

  [Regression Potential]

   * An artifact from an explicitly named artifact is missing and builds
  will begin to remove desired output.  Testing is being done to address
  this regression.

  [Other Info]

   * This has been running in production in Eoan for a few weeks and
  we're satisfied with the results.  We have seen overall time reduced
  by 20-50% on some builds.

  [Original Description]

  In parallel builds where a list of image targets are provided, the build
  may produce binaries that are not part of the named set of targets but
  are created by series dependencies.  These implicitly created binaries
  may be generated by multiple builds but are unused as our convention for
  the ubuntu-cpc project is to only consume binaries from the explicitly
  named image targets; this avoids overwriting the same object by multiple
  parallel builds.  The problem is that as we build out parallel jobs for
  a number of image targets (multiplied by each supported architecture)
  we're wasting a lot of resources.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/livecd-rootfs/+bug/1837254/+subscriptions