aurora-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mehrdad Nurolahzade (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AURORA-1866) Reduce Storage Write Lock Contention in RowGarbageCollector
Date Wed, 21 Dec 2016 17:38:58 GMT
Mehrdad Nurolahzade created AURORA-1866:
-------------------------------------------

             Summary: Reduce Storage Write Lock Contention in RowGarbageCollector
                 Key: AURORA-1866
                 URL: https://issues.apache.org/jira/browse/AURORA-1866
             Project: Aurora
          Issue Type: Story
          Components: Scheduler
            Reporter: Mehrdad Nurolahzade
            Priority: Minor


{{RowGarbageCollector}} runs as a background service and deletes unreferenced rows in {{task_configs}}
and {{job_keys}} tables (by default every two hours). This is achieved by deleting all existing
rows (one by one) and silently ignoring the rows that fail deletion due to referential integrity
constraints. The entire operation happens while holding the storage write lock. 

We are not currently exposing stats on timing of this operation. There is a ticket to expose
such stats ([AURORA-1842]). If proven to be an expensive operation, we need to consider batching
the operations or setting a cap on the maximum number of rows garbage collected (and scheduling
more frequently) to reduce contention on the storage write lock.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message