spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <matei.zaha...@gmail.com>
Subject Re: How to compile Spark with customized Hadoop?
Date Fri, 09 Oct 2015 21:31:06 GMT
You can publish your version of Hadoop to your Maven cache with mvn publish (just give it a
different version number, e.g. 2.7.0a) and then pass that as the Hadoop version to Spark's
build (see http://spark.apache.org/docs/latest/building-spark.html <http://spark.apache.org/docs/latest/building-spark.html>).

Matei

> On Oct 9, 2015, at 3:10 PM, Dogtail L <spark.rui92@gmail.com> wrote:
> 
> Hi all,
> 
> I have modified Hadoop source code, and I want to compile Spark with my modified Hadoop.
Do you know how to do that? Great thanks!


Mime
View raw message