spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Nazario (JIRA)" <>
Subject [jira] [Created] (SPARK-5978) Spark examples cannot compile with Hadoop 2
Date Tue, 24 Feb 2015 21:02:04 GMT
Michael Nazario created SPARK-5978:

             Summary: Spark examples cannot compile with Hadoop 2
                 Key: SPARK-5978
             Project: Spark
          Issue Type: Bug
          Components: Examples, PySpark
    Affects Versions: 1.2.1, 1.2.0
            Reporter: Michael Nazario

This is a regression from Spark 1.1.1.

The Spark Examples includes an example for an avro converter for PySpark. When I was trying
to debug a problem, I discovered that even though you can build with Hadoop 2 for Spark 1.2.0,
an hbase dependency depends on Hadoop 1 somewhere else in the examples code.

An easy fix would be to separate the examples into hadoop specific versions. Another way would
be to fix the hbase dependencies so that they don't rely on hadoop 1 specific code.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message