hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-19478) Utilize multi-get to speed up WAL file checking in BackupLogCleaner
Date Sun, 10 Dec 2017 17:11:00 GMT
Ted Yu created HBASE-19478:
------------------------------

             Summary: Utilize multi-get to speed up WAL file checking in BackupLogCleaner
                 Key: HBASE-19478
                 URL: https://issues.apache.org/jira/browse/HBASE-19478
             Project: HBase
          Issue Type: Improvement
            Reporter: Ted Yu


Currently BackupLogCleaner#getDeletableFiles() issues one Get per WAL file:
{code}
      for (FileStatus file : files) {
        String wal = file.getPath().toString();
        boolean logInSystemTable = table.isWALFileDeletable(wal);
{code}
This is rather inefficient considering the number of WAL files in production can get quite
large.

We should use multi-get to reduce the number of calls to backup table (which normally resides
on another server).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message