hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14673) Orc orc_merge_diff_fs.q and orc_llap.q test improvement
Date Wed, 31 Aug 2016 01:14:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450675#comment-15450675
] 

Prasanth Jayachandran commented on HIVE-14673:
----------------------------------------------

orc_merge_diff_fs.q now runs in 22s in TestCliDriver and orc_llap.q runs in 76s in MiniLlap.
Verified that test results are correct. 

> Orc orc_merge_diff_fs.q and orc_llap.q test improvement
> -------------------------------------------------------
>
>                 Key: HIVE-14673
>                 URL: https://issues.apache.org/jira/browse/HIVE-14673
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Tests
>    Affects Versions: 2.2.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>         Attachments: HIVE-14673.1.patch
>
>
> orc_merge_diff_fs.q and orc_llap.q are slow (350.487s and 290.877s respectively). We
can move orc_merge_diff_fs.q to MiniLlap as we are testing merge across filesystems and there
are several orc merge tests for mr. orc_llap.q seems to be creating a lot of temp tables and
running sum(hash(*)) againsts which seems to be slow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message