hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venki Korukanti (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7792) Enable tests on Spark branch (2) [Sparch Branch]
Date Fri, 22 Aug 2014 02:39:11 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Venki Korukanti updated HIVE-7792:
----------------------------------

    Attachment: HIVE-7792.1-spark.patch


Attached patch enables following tests:
{noformat}
 * metadata_only_queries.q
 * load_dyn_part2.q
 * load_dyn_part3.q
 * mapreduce1.q
 * mapreduce2.q
 * limit_pushdown.q (Order of results is different from MR, but order is deterministic)
{noformat}


{noformat}
 * load_dyn_part1.q - Failure - tracked by HIVE-7842
 * mapjoin_mapjoin.q: Results are wrong, probably because MapJoin is not  supported yet (HIVE-7613).
 * optimize_nullscan.q: Differences in table serdes and plan. Looks like the plan is not optimized
for limit 0 cases - tracked by HIVE-7844
 * orc_analyze.q - Failure - tracked by HIVE-7843
{noformat}

Stats differences such as below for rest of the q files.
{noformat}
< Statistics: Num rows: 1000 Data size: 94000 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 46 Data size: 4920 Basic stats: COMPLETE Column stats: NONE
{noformat}

Not sure if it is because we don't have stats collection from Spark job yet. Still investigating.
{noformat}
 * orc_merge1.q
 * orc_merge2.q
 * orc_merge3.q
 * orc_merge4.q
 * merge1.q
 * merge2.q
{noformat}


> Enable tests on Spark branch (2) [Sparch Branch]
> ------------------------------------------------
>
>                 Key: HIVE-7792
>                 URL: https://issues.apache.org/jira/browse/HIVE-7792
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Brock Noland
>            Assignee: Venki Korukanti
>         Attachments: HIVE-7792.1-spark.patch
>
>
> This jira is to enable *most* of the tests below. If tests don't pass because of some
unsupported feature, ensure that a JIRA exists and move on.
> {noformat}
> limit_pushdown.q,\
>   load_dyn_part1.q,\
>   load_dyn_part2.q,\
>   load_dyn_part3.q,\
>   mapjoin_mapjoin.q,\
>   mapreduce1.q,\
>   mapreduce2.q,\
>   merge1.q,\
>   merge2.q,\
>   metadata_only_queries.q,\
>   optimize_nullscan.q,\
>   orc_analyze.q,\
>   orc_merge1.q,\
>   orc_merge2.q,\
>   orc_merge3.q,\
>   orc_merge4.q,\
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message