hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13897) OOM occurs when Import importing a row that including too much KeyValue
Date Sun, 28 Jun 2015 18:01:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604811#comment-14604811
] 

Hadoop QA commented on HBASE-13897:
-----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12742397/HBASE-13897-master.patch
  against master branch at commit 7dbb2e69776bae8c2f2781f36528c0e784f93a06.
  ATTACHMENT ID: 12742397

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:red}-1 tests included{color}.  The patch doesn't appear to include any new or modified
tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    {color:green}+1 hadoop versions{color}. The patch compiles with all supported hadoop versions
(2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 protoc{color}.  The applied patch does not increase the total number of
protoc compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

                {color:red}-1 checkstyle{color}.  The applied patch generated 1906 checkstyle
errors (more than the master's current 1900 errors).

    {color:green}+1 findbugs{color}.  The patch does not introduce any  new Findbugs (version
2.0.3) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 lineLengths{color}.  The patch introduces the following lines longer than
100:
    +        Reducer<KeyValueWritableComparable, KeyValue, ImmutableBytesWritable, KeyValue>.Context
context)
+  public static class KeyValueSortImporter extends TableMapper<KeyValueWritableComparable,
KeyValue> {
+        KeyValueWritableComparable[] startKeyWraps = new KeyValueWritableComparable[startKeys.length
- 1];
+          startKeyWraps[i - 1] = new KeyValueWritableComparable(KeyValueUtil.createFirstOnRow(startKeys[i]));
+        Path partitionsPath = new Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));

  {color:green}+1 site{color}.  The mvn post-site goal succeeds with this patch.

    {color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/14594//testReport/
Release Findbugs (version 2.0.3) 	warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/14594//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/14594//artifact/patchprocess/checkstyle-aggregate.html

                Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/14594//console

This message is automatically generated.

> OOM occurs when Import  importing a row that including too much KeyValue
> ------------------------------------------------------------------------
>
>                 Key: HBASE-13897
>                 URL: https://issues.apache.org/jira/browse/HBASE-13897
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.98.13
>            Reporter: Liu Junhong
>            Assignee: Liu Junhong
>             Fix For: 0.98.14
>
>         Attachments: HBASE-13897-0.98.patch, HBASE-13897-master.patch
>
>
> When importing a row with too many KeyValues (may have too many columns or versions)ļ¼ŒKeyValueReducer
will incur OOM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message