hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-5440) Allow import to optionally use HFileOutputFormat
Date Thu, 23 Feb 2012 20:50:48 GMT

     [ https://issues.apache.org/jira/browse/HBASE-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lars Hofhansl updated HBASE-5440:
---------------------------------

    Attachment: 5440.txt

First cut.

* a new import mapper that writes KeyValues
* uses KeyValueSortReducer

Only used when -Dimport.bulk.output=<path/to/output> is set.

I did experiment with a Reducer that accepts Mutation (common super class of Put and Delete),
but that caused more problems than it solved, hence the KeyValueImporter.
                
> Allow import to optionally use HFileOutputFormat
> ------------------------------------------------
>
>                 Key: HBASE-5440
>                 URL: https://issues.apache.org/jira/browse/HBASE-5440
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>            Priority: Minor
>             Fix For: 0.94.0
>
>         Attachments: 5440.txt
>
>
> importtsv support importing into a life table or to generate HFiles for bulk load.
> import should allow the same.
> Could even consider merging these tools into one (in principle the only difference is
the parsing part - although that is maybe for a different jira).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message