hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-13181) TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
Date Tue, 10 Mar 2015 10:35:38 GMT

     [ https://issues.apache.org/jira/browse/HBASE-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matteo Bertozzi updated HBASE-13181:
------------------------------------
    Attachment: HBASE-13181-v0.patch

The problem is a missing close() of the Output stream.

we are running with hfile.format = v2 by default
and since the size of the v2 file is small (700bytes vs the 4.5k of v3) the file doesn't get
flushed, so we end up with a 0 byte file that throws the corrupted file exception.

> TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
> -----------------------------------------------------------------
>
>                 Key: HBASE-13181
>                 URL: https://issues.apache.org/jira/browse/HBASE-13181
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Srikanth Srungarapu
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-13181-v0.patch
>
>
> Noticing the test failures frequently on internal test rig:
> {code}
> FAILED:  org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent
> Error Message:
> 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading
HFile Trailer from file /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from
file /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from
file /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
> Stack Trace:
> org.apache.hadoop.io.MultipleIOException: 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException:
Problem reading HFile Trailer from file /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from
file /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from
file /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
>         at org.apache.hadoop.io.MultipleIOException.createIOException(MultipleIOException.java:52)
>         at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4910)
>         at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4855)
>         at org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent(TestHRegionReplayEvents.java:1159)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message