falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jaydeep Vishwakarma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FALCON-1734) PurgeService for State Store
Date Thu, 07 Jan 2016 06:41:39 GMT
Jaydeep Vishwakarma created FALCON-1734:

             Summary: PurgeService for State Store 
                 Key: FALCON-1734
                 URL: https://issues.apache.org/jira/browse/FALCON-1734
             Project: Falcon
          Issue Type: New Feature
            Reporter: Jaydeep Vishwakarma

State Store in Falcon is not for historical queries.The no. of instances can keep growing
over time and the store will bloat unnecessarily. During the time of entity level delete we
do cascade level delete, If the number of instances are huge it has to delete too many rows
which might escalate the lock level and impact other instances.  
To tackle that, we can have PurgeService run as a thread inside Falcon Server that will iterate
over instances and delete completed instances in a date range. The range will be a function
of frequency of entity and can be configured in startup.properties.

This message was sent by Atlassian JIRA

View raw message