hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. BagherEsmaeily" <mbesmae...@gmail.com>
Subject Re: completebulkload does 'copy' StoreFiles instead of 'cut'
Date Sun, 15 Sep 2013 09:52:16 GMT
Actually that was my fault duplicating the issue.I had no permission to
delete the second issue. sorry!


On Sun, Sep 15, 2013 at 2:12 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Looks like HBASE-9538 is for the same issue.
>
> On Sep 15, 2013, at 1:09 AM, "M. BagherEsmaeily" <mbesmaeily@gmail.com>
> wrote:
>
> > HBASE-9537
> >
> >
> > On Sun, Sep 15, 2013 at 11:56 AM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> >> File a JIRA for the issue ?
> >>
> >> On Sep 14, 2013, at 11:10 PM, "M. BagherEsmaeily" <mbesmaeily@gmail.com
> >
> >> wrote:
> >>
> >>> Hi rajesh,
> >>>
> >>> I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload
> >>> output directory and hbase cluster are the same, too.
> >>>
> >>> I've also coded a MapReduce job using HFileOutputFormat. When I use
> >>> LoadIncrementalHFiles
> >>> to move the output of my job to HBase table, it still copies instead of
> >> cut.
> >>>
> >>> Thanks
> >>>
> >>>
> >>> On Sat, Sep 14, 2013 at 2:50 PM, rajesh babu Chintaguntla <
> >>> chrajeshbabu32@gmail.com> wrote:
> >>>
> >>>> Hi BagherEsmaeily,
> >>>>
> >>>>      which version of hbase you are using? Is the file system of
> >> bulkload
> >>>> output directory and hbase cluster are same?
> >>>>
> >>>>      If you are using hbase older than 0.94.5 version, the Storefiles
> >>>> generated by importtsv are getting copied instead of        moving
> even
> >> if
> >>>> the file system of bulkload output directory and hbase cluster are
> same.
> >>>>
> >>>>      Its a bug and solved in 0.94.5 (HBASE-5498).
> >>>>
> >>>> Thanks.
> >>>> Rajeshbabu
> >>>>
> >>>> On Sat, Sep 14, 2013 at 12:01 PM, M. BagherEsmaeily <
> >> mbesmaeily@gmail.com
> >>>>> wrote:
> >>>>
> >>>>> Hello,
> >>>>>
> >>>>> I was using HBase complete bulk load to transfer the output of
> >> ImportTsv
> >>>> to
> >>>>> a table in HBase, and I noticed that it copies the output instead
of
> >>>>> cutting. This takes long time for my gigabytes of data.
> >>>>>
> >>>>> In HBase documentation (
> >>>>> http://hbase.apache.org/book/ops_mgt.html#completebulkload) I read
> >> that
> >>>>> the
> >>>>> files would be moved not copied. Can anyone help me with this?
> >>>>>
> >>>>> Kind Regards
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message