drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aman Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-4846) Eliminate extra operations during metadata cache pruning
Date Sat, 13 Aug 2016 02:19:22 GMT
Aman Sinha created DRILL-4846:

             Summary: Eliminate extra operations during metadata cache pruning
                 Key: DRILL-4846
                 URL: https://issues.apache.org/jira/browse/DRILL-4846
             Project: Apache Drill
          Issue Type: Bug
          Components: Metadata
    Affects Versions: 1.7.0
            Reporter: Aman Sinha
            Assignee: Aman Sinha
             Fix For: 1.8.0

While doing performance testing for DRILL-4530 using a new data set and queries, we found
two potential performance issues: (a) the metadata cache was being read twice in some cases
and (b) the checking for directory modification time was being done twice, once as part of
the first phase of directory-based pruning and subsequently after the second phase pruning.
  This check gets expensive for large number of directories.   Creating this JIRA to track
fixes for these issues. 

This message was sent by Atlassian JIRA

View raw message