hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-8835) identify dependency scope for Remote Spark Context.[Spark Branch]
Date Wed, 12 Nov 2014 07:57:33 GMT
Chengxiang Li created HIVE-8835:
-----------------------------------

             Summary: identify dependency scope for Remote Spark Context.[Spark Branch]
                 Key: HIVE-8835
                 URL: https://issues.apache.org/jira/browse/HIVE-8835
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Chengxiang Li


While submit job through Remote Spark Context, spark RDD graph generation and job submit is
executed in remote side, so we have to add hive  related dependency into its classpath with
spark.driver.extraClassPath. instead of add all hive/hadoop dependency, we should narrow the
scope and identify what dependency remote spark context required. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message