hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-14541) TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed on internal rig; gave up after trying 10 times
Date Tue, 13 Oct 2015 19:48:05 GMT

     [ https://issues.apache.org/jira/browse/HBASE-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matteo Bertozzi updated HBASE-14541:
------------------------------------
    Attachment: HBASE-14541-v0.patch

v0 is a workaround that seems to work.
looks like the problem is how many times we split the file.
each split is a retry... so if the number of split is less then the configured retry number
we always end up failing... or at least is what I'm getting...
(v0 also avoid the _tmp/_tmp/_tmp/../_tmp thing)

> TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed on internal rig; gave up
after trying 10 times
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-14541
>                 URL: https://issues.apache.org/jira/browse/HBASE-14541
>             Project: HBase
>          Issue Type: Bug
>            Reporter: stack
>         Attachments: HBASE-14541-test.patch, HBASE-14541-v0.patch
>
>
> This one seems worth a dig. We seem to be making progress but here is what we are trying
to load which seems weird:
> {code}
> 2015-10-01 17:19:41,322 INFO  [main] mapreduce.LoadIncrementalHFiles(360): Split occured
while grouping HFiles, retry attempt 10 with 4 files remaining to group or split
> 2015-10-01 17:19:41,323 ERROR [main] mapreduce.LoadIncrementalHFiles(402): -------------------------------------------------
> Bulk load aborted with some files not yet loaded:
> -------------------------------------------------
>   hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-B/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/ce11cbe2490d444d8958264004286aff.bottom
>   hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-B/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/ce11cbe2490d444d8958264004286aff.top
>   hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-A/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/30c58eeb23a6464da21117e6e1bc565c.bottom
>   hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-A/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/30c58eeb23a6464da21117e6e1bc565c.top
> {code}
> Whats that about?
> Making note here. Will keep an eye on this one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message