spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shiva...@apache.org
Subject spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit
Date Mon, 18 Jul 2016 16:46:41 GMT
Repository: spark
Updated Branches:
  refs/heads/master a529fc944 -> 8ea3f4eae


[SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

## What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/SPARK-16055
sparkPackages - argument is passed and we detect that we are in the R script mode, we should
print some warning like --packages flag should be used with with spark-submit

## How was this patch tested?
In my system locally

Author: krishnakalyan3 <krishnakalyan3@gmail.com>

Closes #14179 from krishnakalyan3/spark-pkg.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8ea3f4ea
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8ea3f4ea
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8ea3f4ea

Branch: refs/heads/master
Commit: 8ea3f4eaec65ee4277f9943063fcc9488d3fa924
Parents: a529fc9
Author: krishnakalyan3 <krishnakalyan3@gmail.com>
Authored: Mon Jul 18 09:46:23 2016 -0700
Committer: Shivaram Venkataraman <shivaram@cs.berkeley.edu>
Committed: Mon Jul 18 09:46:23 2016 -0700

----------------------------------------------------------------------
 R/pkg/R/sparkR.R | 4 ++++
 1 file changed, 4 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/8ea3f4ea/R/pkg/R/sparkR.R
----------------------------------------------------------------------
diff --git a/R/pkg/R/sparkR.R b/R/pkg/R/sparkR.R
index 62659b0..ff5297f 100644
--- a/R/pkg/R/sparkR.R
+++ b/R/pkg/R/sparkR.R
@@ -155,6 +155,10 @@ sparkR.sparkContext <- function(
 
   existingPort <- Sys.getenv("EXISTING_SPARKR_BACKEND_PORT", "")
   if (existingPort != "") {
+    if (length(packages) != 0) {
+      warning(paste("sparkPackages has no effect when using spark-submit or sparkR shell",
+                    " please use the --packages commandline instead", sep = ","))
+    }
     backendPort <- existingPort
   } else {
     path <- tempfile(pattern = "backend_port")


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message