spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Nazario (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-5978) Spark examples cannot compile with Hadoop 2
Date Tue, 24 Feb 2015 21:02:04 GMT
Michael Nazario created SPARK-5978:
--------------------------------------

             Summary: Spark examples cannot compile with Hadoop 2
                 Key: SPARK-5978
                 URL: https://issues.apache.org/jira/browse/SPARK-5978
             Project: Spark
          Issue Type: Bug
          Components: Examples, PySpark
    Affects Versions: 1.2.1, 1.2.0
            Reporter: Michael Nazario


This is a regression from Spark 1.1.1.

The Spark Examples includes an example for an avro converter for PySpark. When I was trying
to debug a problem, I discovered that even though you can build with Hadoop 2 for Spark 1.2.0,
an hbase dependency depends on Hadoop 1 somewhere else in the examples code.

An easy fix would be to separate the examples into hadoop specific versions. Another way would
be to fix the hbase dependencies so that they don't rely on hadoop 1 specific code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message