hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16425) Vectorization: unload old hashtables before reloadHashTable
Date Wed, 12 Apr 2017 13:42:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965872#comment-15965872
] 

Hive QA commented on HIVE-16425:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12863012/HIVE-16425.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 10571 tests executed
*Failed tests:*
{noformat}
org.apache.hive.jdbc.TestJdbcDriver2.testResultSetMetaData (batchId=221)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4658/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4658/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4658/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12863012 - PreCommit-HIVE-Build

> Vectorization: unload old hashtables before reloadHashTable
> -----------------------------------------------------------
>
>                 Key: HIVE-16425
>                 URL: https://issues.apache.org/jira/browse/HIVE-16425
>             Project: Hive
>          Issue Type: Bug
>          Components: Vectorization
>            Reporter: Gopal V
>            Assignee: Gopal V
>         Attachments: HIVE-16425.1.patch
>
>
> {code}
>   @Override
>   protected void reloadHashTable(byte pos, int partitionId)
>           throws IOException, HiveException, SerDeException, ClassNotFoundException {
>     // The super method will reload a hash table partition of one of the small tables.
>     // Currently, for native vector map join it will only be one small table.
>     super.reloadHashTable(pos, partitionId);
>     MapJoinTableContainer smallTable = spilledMapJoinTables[pos];
>     vectorMapJoinHashTable = VectorMapJoinOptimizedCreateHashTable.createHashTable(conf,
>         smallTable);
>     needHashTableSetup = true;
>     LOG.info("Created " + vectorMapJoinHashTable.getClass().getSimpleName() + " from
" + this.getClass().getSimpleName());
>     if (isLogDebugEnabled) {
>       LOG.debug(CLASS_NAME + " reloadHashTable!");
>     }
>   }
> {code}
> The super call causes an OOM because of existing memory usage by vectorMapJoinHashTable.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message