[Bug 973494] Re: Retracing is way too slow

[Evan Dandrea]

One way in which we can improve this is by keeping very large caches.
Currently, the caches are purged every so often as we run out of disk
space. We can reduce the amount of disk space we need by moving to a
copy-on-write approach using aufs.

** Also affects: daisy
   Importance: Undecided
       Status: New

** Changed in: whoopsie-daisy (Ubuntu)
       Status: Confirmed => Invalid

** No longer affects: whoopsie-daisy (Ubuntu)

** Changed in: daisy
   Importance: Undecided => High

** Changed in: daisy
       Status: New => Confirmed

** Changed in: daisy
     Assignee: (unassigned) => Evan Dandrea (ev)

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to whoopsie-daisy in Ubuntu.
https://bugs.launchpad.net/bugs/973494

Title:
  Retracing is way too slow

Status in Ubuntu error tracker backend (daisy):
  Confirmed
Status in “apport” package in Ubuntu:
  Fix Released

Bug description:
  We're currently only able to process about three core files per minute
  with each retracer. We can fire up more retracers and drop some core
  files at random when we're approaching a high load, both of which
  mitigate this problem to varying degrees. However, we should also
  address the problem that our current retracing code is taking far too
  long to process each core file:

  [4:40pm] jjo: ev: basically afaics we are losing the producer|consumer rate battle
  [4:40pm] mthaddon: ev: basically the rabbitmq queues are fairly consistently increasing in size, but the server itself is very lightly loaded - should we be firing up more retracers, or is there some way of making existing retracers do more work?
  [4:40pm] jjo: ev: while finfolk doesnt get squeezed for load
  [4:41pm] ev: the retracers process in serial, so bringing up more of them would be advisable
  [4:41pm] jjo: ev: FTR I had fired up to ~7 retracers in parallel , which hover'd loadavg~=8 -> got ~3 oopsen per min
  [4:41pm] jjo: ev: but still I couldn't manage to get more than ~3/min

To manage notifications about this bug go to:
https://bugs.launchpad.net/daisy/+bug/973494/+subscriptions