spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-22419) Hive and Hive Thriftserver jars missing from "without hadoop" build
Date Thu, 02 Nov 2017 14:05:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-22419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235783#comment-16235783
] 

Sean Owen commented on SPARK-22419:
-----------------------------------

Yes, it's useful for future reference. Spark should work fine with 2.6 and later. Honestly,
the existence of a 2.6/2.7 build is vestigial at this point. You should not need your own
build, in the main. Making your own build might help version conflicts, but really you're
looking at a log4j config issue in that case.

> Hive and Hive Thriftserver jars missing from "without hadoop" build
> -------------------------------------------------------------------
>
>                 Key: SPARK-22419
>                 URL: https://issues.apache.org/jira/browse/SPARK-22419
>             Project: Spark
>          Issue Type: Question
>          Components: Build
>    Affects Versions: 2.1.1
>            Reporter: Adam Kramer
>            Priority: Minor
>
> The "without hadoop" binary distribution does not have hive-related libraries in the
jars directory.  This may be due to Hive being tied to major releases of Hadoop. My project
requires using Hadoop 2.8, so "without hadoop" version seemed the best option. Should I use
the make-distribution.sh instead?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message