spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-25840][BUILD] `` should not fail due to missing LICENSE-binary
Date Fri, 26 Oct 2018 03:26:20 GMT
Repository: spark
Updated Branches:
  refs/heads/master dc9b32080 -> 79f3babcc

[SPARK-25840][BUILD] `` should not fail due to missing LICENSE-binary

## What changes were proposed in this pull request?

We vote for the artifacts. All releases are in the form of the source materials needed to
make changes to the software being released. (

>From Spark 2.4.0, the source artifact and binary artifact starts to contain own proper
LICENSE files (LICENSE, LICENSE-binary). It's great to have them. However, unfortunately,
`dev/` inside source artifacts start to fail because it expects `LICENSE-binary`
and source artifact have only the LICENSE file.

`dev/` is used during the voting phase because we are voting on that source
artifact instead of GitHub repository. Individual contributors usually don't have the downstream
repository and starts to try build the voting source artifacts to help the verification for
the source artifact during voting phase. (Personally, I did before.)

This PR aims to recover that script to work in any way. This doesn't aim for source artifacts
to reproduce the compiled artifacts.

## How was this patch tested?

$ rm LICENSE-binary
$ dev/

Closes #22840 from dongjoon-hyun/SPARK-25840.

Authored-by: Dongjoon Hyun <>
Signed-off-by: Dongjoon Hyun <>


Branch: refs/heads/master
Commit: 79f3babcc6e189d7405464b9ac1eb1c017e51f5d
Parents: dc9b320
Author: Dongjoon Hyun <>
Authored: Thu Oct 25 20:26:13 2018 -0700
Committer: Dongjoon Hyun <>
Committed: Thu Oct 25 20:26:13 2018 -0700

 dev/ | 10 +++++++---
 1 file changed, 7 insertions(+), 3 deletions(-)
diff --git a/dev/ b/dev/
index 668682f..84f4ae9 100755
--- a/dev/
+++ b/dev/
@@ -212,9 +212,13 @@ mkdir -p "$DISTDIR/examples/src/main"
 cp -r "$SPARK_HOME/examples/src/main" "$DISTDIR/examples/src/"
 # Copy license and ASF files
-cp -r "$SPARK_HOME/licenses-binary" "$DISTDIR/licenses"
+if [ -e "$SPARK_HOME/LICENSE-binary" ]; then
+  cp -r "$SPARK_HOME/licenses-binary" "$DISTDIR/licenses"
+  echo "Skipping copying LICENSE files"
 if [ -e "$SPARK_HOME/CHANGES.txt" ]; then

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message