hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]
Date Thu, 27 Nov 2014 16:31:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227812#comment-14227812
] 

Brock Noland commented on HIVE-8836:
------------------------------------

bq. Just looking through and one more quick observation, parquet_join is failing because the
table parquet_jointable1_bucketed_sorted is corrupted, with 3 files but created with 1 bucket.
It seems a problem with number of reducers in the insert statement that populate the table,
but not sure if I will have a chance to look soon.

Ahh interesting. We'll probably need to fall back to the number of buckets for bucketed tables.

> Enable automatic tests with remote spark client [Spark Branch]
> --------------------------------------------------------------
>
>                 Key: HIVE-8836
>                 URL: https://issues.apache.org/jira/browse/HIVE-8836
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Chengxiang Li
>            Assignee: Rui Li
>              Labels: Spark-M3
>             Fix For: spark-branch
>
>         Attachments: HIVE-8836.1-spark.patch, HIVE-8836.10-spark.patch, HIVE-8836.10-spark.patch,
HIVE-8836.11-spark.patch, HIVE-8836.12-spark.patch, HIVE-8836.2-spark.patch, HIVE-8836.3-spark.patch,
HIVE-8836.4-spark.patch, HIVE-8836.5-spark.patch, HIVE-8836.6-spark.patch, HIVE-8836.6-spark.patch,
HIVE-8836.6-spark.patch, HIVE-8836.7-spark.patch, HIVE-8836.8-spark.patch, HIVE-8836.9-spark.patch,
additional-enable-spark-log.patch
>
>
> In real production environment, remote spark client should be used to submit spark job
for Hive mostly, we should enable automatic test with remote spark client to make sure the
Hive feature workable with it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message