hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dima Spivak (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-12252) IntegrationTestBulkLoad fails with illegal partition error
Date Tue, 14 Oct 2014 19:05:33 GMT

     [ https://issues.apache.org/jira/browse/HBASE-12252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dima Spivak updated HBASE-12252:
--------------------------------
    Status: Patch Available  (was: In Progress)

> IntegrationTestBulkLoad fails with illegal partition error
> ----------------------------------------------------------
>
>                 Key: HBASE-12252
>                 URL: https://issues.apache.org/jira/browse/HBASE-12252
>             Project: HBase
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.98.6
>            Reporter: Dima Spivak
>            Assignee: Dima Spivak
>         Attachments: HBASE-12252.patch
>
>
> While running {{IntegrationTestBulkLoad}} for a while, I encountered the following error:
> {code}
> 14/10/14 05:57:12 INFO mapreduce.IntegrationTestBulkLoad: Running check
> 14/10/14 05:57:12 INFO client.RMProxy: Connecting to ResourceManager at node-1.internal/10.0.0.3:8032
> 14/10/14 05:57:16 INFO util.RegionSizeCalculator: Calculating region sizes for table
"IntegrationTestBulkLoad".
> 14/10/14 05:57:16 INFO mapreduce.JobSubmitter: number of splits:16
> 14/10/14 05:57:17 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1413261370136_0012
> 14/10/14 05:57:17 INFO impl.YarnClientImpl: Submitted application application_1413261370136_0012
> 14/10/14 05:57:17 INFO mapreduce.Job: The url to track the job: http://node-1.internal:8088/proxy/application_1413261370136_0012/
> 14/10/14 05:57:17 INFO mapreduce.Job: Running job: job_1413261370136_0012
> 14/10/14 05:57:32 INFO mapreduce.Job: Job job_1413261370136_0012 running in uber mode
: false
> 14/10/14 05:57:32 INFO mapreduce.Job:  map 0% reduce 0%
> 14/10/14 05:57:52 INFO mapreduce.Job:  map 6% reduce 0%
> 14/10/14 05:57:53 INFO mapreduce.Job: Task Id : attempt_1413261370136_0012_m_000013_0,
Status : FAILED
> Error: java.io.IOException: Illegal partition for org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkKey@133c4539
(-3)
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1079)
> 	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:712)
> 	at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
> 	at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
> 	at org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:502)
> 	at org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:491)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> Container killed by the ApplicationMaster.
> Container killed on request. Exit code is 143
> Container exited with a non-zero exit code 143
> {code}
> I'm pretty sure I've tracked this down to a partition generator that can return a negative
number; I'll post a fix once I've confirmed locally.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message