Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Sat, 9 Jul 2016 18:32:11 +0000 (UTC)
From: "Hive QA (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.12987293.1467840486000.67461.1468089131110@Atlassian.JIRA>
In-Reply-To: <JIRA.12987293.1467840486000@Atlassian.JIRA>
References: <JIRA.12987293.1467840486000@Atlassian.JIRA> <JIRA.12987293.1467840486601@arcas>
Subject: [jira] [Commented] (HIVE-14172) LLAP: force evict blocks by size to
 handle memory fragmentation
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sat, 09 Jul 2016 18:32:13 -0000


    [ https://issues.apache.org/jira/browse/HIVE-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15369232#comment-15369232 ] 

Hive QA commented on HIVE-14172:
--------------------------------


Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12816890/HIVE-14172.01.patch

{color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 10281 tests executed
*Failed tests:*
{noformat}
TestMiniTezCliDriver-tez_joins_explain.q-vector_data_types.q-tez_dynpart_hashjoin_1.q-and-12-more - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_12
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_13
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_multiinsert
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_vector_complex_all
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_vector_complex_join
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.cli.TestMinimrCliDriver.org.apache.hadoop.hive.cli.TestMinimrCliDriver
org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskSchedulerService.testDelayedLocalityNodeCommErrorImmediateAllocation
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/442/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/442/console
Test logs: http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-442/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12816890 - PreCommit-HIVE-MASTER-Build

> LLAP: force evict blocks by size to handle memory fragmentation
> ---------------------------------------------------------------
>
>                 Key: HIVE-14172
>                 URL: https://issues.apache.org/jira/browse/HIVE-14172
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Nita Dembla
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-14172.01.patch, HIVE-14172.patch
>
>
> In the long run, we should replace buddy allocator with a better scheme. For now do a workaround for fragmentation that cannot be easily resolved. It's still not perfect but works for practical  ORC cases, where we have the default size and smaller blocks, rather than large allocations having trouble.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)