hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Ranganathan (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-4663) MR based copier for copying HFiles
Date Tue, 25 Oct 2011 04:56:32 GMT
MR based copier for copying HFiles

                 Key: HBASE-4663
                 URL: https://issues.apache.org/jira/browse/HBASE-4663
             Project: HBase
          Issue Type: Sub-task
            Reporter: Karthik Ranganathan
            Assignee: Karthik Ranganathan

This copier is a modification of the distcp tool in HDFS. It does the following:

1. List out all the regions in the HBase cluster for the required table
2. Write the above out to a file
3. Each mapper 
   3.1 lists all the HFiles for a given region by querying the regionserver
   3.2 copies all the HFiles
   3.3 outputs success if the copy succeeded, failure otherwise. Failed regions are retried
in another loop
4. Mappers are placed on nodes which have maximum locality for a given region to speed up

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message