spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Roberts (JIRA)" <>
Subject [jira] [Created] (SPARK-17828) Changes file missing in Spark 2
Date Fri, 07 Oct 2016 13:08:20 GMT
Adam Roberts created SPARK-17828:

             Summary: Changes file missing in Spark 2
                 Key: SPARK-17828
             Project: Spark
          Issue Type: Documentation
          Components: Documentation
    Affects Versions: 2.0.2, 2.1.0
            Reporter: Adam Roberts
            Priority: Minor

In Spark 1.x releases we provided the CHANGES.txt file which proved useful to know exactly
the differences and commit IDs between releases

In Spark 2.x we made packaging changes (moving to be under dev and different
structure for the important Spark classes e.g. no big assembly jar), so I expect work wasn't
done to ensure the changes file was still being provided

Note that users can view the release notes online (
so I don't know if there is merit in including this file in the distribution, but I've had
a look in the codebase and noticed the script used to generate said file is still present
in master and definitely out of date:, here
we see the last commit is from the 27th of August 2014

SPARK_HOME = os.environ["SPARK_HOME"]

If we change this to 
SPARK_HOME = os.environ["SPARK_HOME"]

we can create a file

So I think this file should be either be removed in 2.x. or updated across our currently maintained
branches and then we'd need to run the make-distribution script to ensure the file is picked
up and included in the distribution

I see no JIRAs mentioning "changes" under the spark project and no discussion of this on either
mailing list. I downloaded the Spark 2.0.0 tgz (no 2.0.1 tgz at
and verified there is no changes file here.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message