hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yuemeng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7329) Create SparkWork [Spark Branch]
Date Wed, 26 Nov 2014 03:01:17 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225635#comment-14225635
] 

yuemeng commented on HIVE-7329:
-------------------------------

hi,XueFu. i  builted hive on spark (spark branch on https://github.com/apache/hive.git),and
spark (master branch on https://github.com/apache/spark.git),and my spark assembly jar is
spark-assembly-1.2.0-SNAPSHOT-hadoop2.4.0.jar,and set this jar path into hive-env.sh (set
to HIVE_AUX_JARS_PATH),and start hive ,do follow commnad to start a query :
set hive.execution.engine=spark;
set spark.master=spark://:7077;
set spark.eventLog.enabled=true; 
set spark.executor.memory=1024m;
set spark.serializer=org.apache.spark.serializer.KryoSerializer;
but it seems it still use mr for query engine,then i remote debug it ,and  found it can't
 jump to spark engine.
i do what this https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started
be told,can u tell me anything wrong?

> Create SparkWork [Spark Branch]
> -------------------------------
>
>                 Key: HIVE-7329
>                 URL: https://issues.apache.org/jira/browse/HIVE-7329
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: 0.13.1
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>             Fix For: spark-branch
>
>         Attachments: HIVE-7329.patch
>
>
> This class encapsulates all the work objects that can be executed in a single Spark job.
> NO PRECOMMIT TESTS. This is for spark branch only.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message