hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]
Date Wed, 26 Nov 2014 00:57:14 GMT


Brock Noland updated HIVE-8836:
    Attachment: HIVE-8836.5-spark.patch

I talked with Marcelo and he noted an odd config of {{spark.akka.heartbeat.interval}} of {{ClientUtils}}.
In this patch I changed the config based on his feedback.

I also added some debug logging to {{SparkJobMonitor}} and changed {{SparkClientImpl}} to
output to the log as opposed to stdout.

> Enable automatic tests with remote spark client.[Spark Branch]
> --------------------------------------------------------------
>                 Key: HIVE-8836
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Chengxiang Li
>            Assignee: Rui Li
>              Labels: Spark-M3
>             Fix For: spark-branch
>         Attachments: HIVE-8836.1-spark.patch, HIVE-8836.2-spark.patch, HIVE-8836.3-spark.patch,
HIVE-8836.4-spark.patch, HIVE-8836.5-spark.patch
> In real production environment, remote spark client should be used to submit spark job
for Hive mostly, we should enable automatic test with remote spark client to make sure the
Hive feature workable with it.

This message was sent by Atlassian JIRA

View raw message