Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 14 Oct 2014 06:20:33 +0000 (UTC)
From: "Dima Spivak (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.12747935.1413267558000.260778.1413267633622@Atlassian.JIRA>
In-Reply-To: <JIRA.12747935.1413267558000@Atlassian.JIRA>
References: <JIRA.12747935.1413267558000@Atlassian.JIRA>
 <JIRA.12747935.1413267558037@arcas>
Subject: [jira] [Work started] (HBASE-12252) IntegrationTestBulkLoad fails
 with illegal partition error
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HBASE-12252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on HBASE-12252 started by Dima Spivak.
-------------------------------------------
> IntegrationTestBulkLoad fails with illegal partition error
> ----------------------------------------------------------
>
>                 Key: HBASE-12252
>                 URL: https://issues.apache.org/jira/browse/HBASE-12252
>             Project: HBase
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.98.6
>            Reporter: Dima Spivak
>            Assignee: Dima Spivak
>
> While running {{IntegrationTestBulkLoad}} for a while, I encountered the following error:
> {code}
> 14/10/14 05:57:12 INFO mapreduce.IntegrationTestBulkLoad: Running check
> 14/10/14 05:57:12 INFO client.RMProxy: Connecting to ResourceManager at node-1.internal/10.0.0.3:8032
> 14/10/14 05:57:16 INFO util.RegionSizeCalculator: Calculating region sizes for table "IntegrationTestBulkLoad".
> 14/10/14 05:57:16 INFO mapreduce.JobSubmitter: number of splits:16
> 14/10/14 05:57:17 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1413261370136_0012
> 14/10/14 05:57:17 INFO impl.YarnClientImpl: Submitted application application_1413261370136_0012
> 14/10/14 05:57:17 INFO mapreduce.Job: The url to track the job: http://node-1.internal:8088/proxy/application_1413261370136_0012/
> 14/10/14 05:57:17 INFO mapreduce.Job: Running job: job_1413261370136_0012
> 14/10/14 05:57:32 INFO mapreduce.Job: Job job_1413261370136_0012 running in uber mode : false
> 14/10/14 05:57:32 INFO mapreduce.Job:  map 0% reduce 0%
> 14/10/14 05:57:52 INFO mapreduce.Job:  map 6% reduce 0%
> 14/10/14 05:57:53 INFO mapreduce.Job: Task Id : attempt_1413261370136_0012_m_000013_0, Status : FAILED
> Error: java.io.IOException: Illegal partition for org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkKey@133c4539 (-3)
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1079)
> 	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:712)
> 	at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
> 	at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
> 	at org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:502)
> 	at org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:491)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> Container killed by the ApplicationMaster.
> Container killed on request. Exit code is 143
> Container exited with a non-zero exit code 143
> {code}
> I'm pretty sure I've tracked this down to a partition generator that can return a negative number; I'll post a fix once I've confirmed locally.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)