spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sro...@apache.org
Subject spark git commit: [SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming
Date Wed, 12 Apr 2017 10:36:20 GMT
Repository: spark
Updated Branches:
  refs/heads/branch-2.1 b2970d971 -> dbb6d1b44


[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming

## What changes were proposed in this pull request?
Update count distinct error message for streaming datasets/dataframes to match current behavior.
These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated.

Author: jtoka <jason.tokayer@gmail.com>

Closes #17609 from jtoka/master.

(cherry picked from commit 2e1fd46e12bf948490ece2caa73d227b6a924a14)
Signed-off-by: Sean Owen <sowen@cloudera.com>


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dbb6d1b4
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/dbb6d1b4
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/dbb6d1b4

Branch: refs/heads/branch-2.1
Commit: dbb6d1b44063925aab79ebe77e4891442a31c42d
Parents: b2970d9
Author: jtoka <jason.tokayer@gmail.com>
Authored: Wed Apr 12 11:36:08 2017 +0100
Committer: Sean Owen <sowen@cloudera.com>
Committed: Wed Apr 12 11:36:16 2017 +0100

----------------------------------------------------------------------
 .../sql/catalyst/analysis/UnsupportedOperationChecker.scala     | 5 ++---
 1 file changed, 2 insertions(+), 3 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/dbb6d1b4/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
----------------------------------------------------------------------
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
index f4d016c..a5eded6 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
@@ -103,9 +103,8 @@ object UnsupportedOperationChecker {
           }
           throwErrorIf(
             child.isStreaming && distinctAggExprs.nonEmpty,
-            "Distinct aggregations are not supported on streaming DataFrames/Datasets, unless
" +
-              "it is on aggregated DataFrame/Dataset in Complete output mode. Consider using
" +
-              "approximate distinct aggregation (e.g. approx_count_distinct() instead of
count()).")
+            "Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider
" +
+              "using approx_count_distinct() instead.")
 
         case _: Command =>
           throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with
" +


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message