[Bug 1838858] Re: backport GC AIO to Luminous

[Jesse Williamson]

I've verified that AIO GC is working on bionic. First, I configured radosgw with:
rgw gc obj min wait = 5
rgw gc processor period = 60
rgw gc processor max time = 60

...and then tested with the Hot Sauce S3 tool, configured to create 100 10MB objects and
then request deletion, triggering the GC code:
./hsbench -a $akey -s $skey -u http://127.0.0.1:70 -z 10MB -n 100 -t 2 -b 1 -m ipd

In another window, I watched the GC list and saw that it grew when deletion was requested, and
indeed evicted objects until the count was once again 0.

** Tags removed: verification-needed verification-needed-bionic
** Tags added: verification-done-bionic

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to Ubuntu Cloud Archive.
https://bugs.launchpad.net/bugs/1838858

Title:
  backport GC AIO to Luminous

Status in Ubuntu Cloud Archive:
  Invalid
Status in Ubuntu Cloud Archive pike series:
  Won't Fix
Status in Ubuntu Cloud Archive queens series:
  In Progress
Status in ceph package in Ubuntu:
  Invalid
Status in ceph source package in Bionic:
  Fix Committed

Bug description:
  [Impact]
  In RGW deployments with large deltas for deleted objects, the garbage collector will easily fall behind on cleanup of deleted objects eventually resulting in OSD devices hitting storage capacity.

  [Test Case]
  Deploy Ceph + RADOS Gateway
  Create millions of objects in an iterative loop
  Start deleting objects in parallel at a high rate
  Storage capacity will gradually reduce over time as RGW garbage collection falls behind.

  [Tricky to reproduce without significant scale of objects + deletion
  but proposed fix has been tested in the field.]

  [Regression Potential]
  Low - fix has been accepted into Ceph Luminous upstream and will form part of the next point release.  Change to use AIO for GC is also in later Ceph releases.

  [Original Bug Report]
  SRU for backport of the GC AIO feature to Ceph Luminous.

  https://github.com/ceph/ceph/pull/28784

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1838858/+subscriptions