hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13897) OOM occurs when Import importing a row that including too much KeyValue
Date Sat, 13 Jun 2015 20:31:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584804#comment-14584804
] 

Hadoop QA commented on HBASE-13897:
-----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12739437/HBASE-13897-0.98.patch
  against 0.98 branch at commit 293506c7cdef3e866c75a7b92558a423eb804d11.
  ATTACHMENT ID: 12739437

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:red}-1 tests included{color}.  The patch doesn't appear to include any new or modified
tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    {color:green}+1 hadoop versions{color}. The patch compiles with all supported hadoop versions
(2.4.1 2.5.2 2.6.0)

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 protoc{color}.  The applied patch does not increase the total number of
protoc compiler warnings.

    {color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 25 warning messages.

                {color:red}-1 checkstyle{color}.  The applied patch generated 3904 checkstyle
errors (more than the master's current 3893 errors).

		    {color:red}-1 InterfaceAudience{color}.  The patch appears to contain InterfaceAudience
from hadoop rather than hbase:
             +import org.apache.hadoop.classification.InterfaceAudience;
+import org.apache.hadoop.classification.InterfaceStability;.

    {color:green}+1 findbugs{color}.  The patch does not introduce any  new Findbugs (version
2.0.3) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 lineLengths{color}.  The patch introduces the following lines longer than
100:
    +  public static class KeyValueWritableComparablePartitioner extends Partitioner<KeyValueWritableComparable,
KeyValue> {
+  public static class KeyValueWritableComparable implements WritableComparable<KeyValueWritableComparable>
{
+  public static class KeyValueReducer extends Reducer<KeyValueWritableComparable, KeyValue,
ImmutableBytesWritable, KeyValue> {
+        org.apache.hadoop.mapreduce.Reducer<KeyValueWritableComparable, KeyValue, ImmutableBytesWritable,
KeyValue>.Context context)
+  public static class KeyValueSortImporter extends TableMapper<KeyValueWritableComparable,
KeyValue> {
+      HTable table = new HTable(context.getConfiguration(), context.getConfiguration().get(TABLE_NAME));

+      KeyValueWritableComparable[] startKeyWraps = new KeyValueWritableComparable[startKeys.length
- 1];
+      	startKeyWraps[i - 1] = new KeyValueWritableComparable(KeyValue.createFirstOnRow(startKeys[i]));

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

     {color:red}-1 core tests{color}.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.mapreduce.TestImportExport

     {color:red}-1 core zombie tests{color}.  There are 2 zombie test(s): 	at org.apache.camel.component.jetty.jettyproducer.HttpJettyProducerRecipientListCustomThreadPoolTest.testRecipientList(HttpJettyProducerRecipientListCustomThreadPoolTest.java:40)
	at org.apache.camel.component.jms.issues.JmsResequencerTest.testResequencer(JmsResequencerTest.java:54)
	at org.apache.camel.component.jms.issues.JmsResequencerTest.testBatchResequencer(JmsResequencerTest.java:37)

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/14397//testReport/
Release Findbugs (version 2.0.3) 	warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/14397//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/14397//artifact/patchprocess/checkstyle-aggregate.html

                Javadoc warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/14397//artifact/patchprocess/patchJavadocWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/14397//console

This message is automatically generated.

> OOM occurs when Import  importing a row that including too much KeyValue
> ------------------------------------------------------------------------
>
>                 Key: HBASE-13897
>                 URL: https://issues.apache.org/jira/browse/HBASE-13897
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.98.13
>            Reporter: Liu Junhong
>            Assignee: Ted Yu
>             Fix For: 0.98.13
>
>         Attachments: HBASE-13897-0.98.patch
>
>
> When importing a row has too much KeyValues (may have too much columns or versions)ļ¼ŒKeyValueReducer
will occurs OOM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message