spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (SPARK-26297) improve the doc of Distribution/Partitioning
Date Tue, 11 Dec 2018 00:18:00 GMT


ASF GitHub Bot commented on SPARK-26297:

cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc
of Distribution/Partitioning

 File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/physical/partitioning.scala
 @@ -118,10 +115,12 @@ case class HashClusteredDistribution(
  * Represents data where tuples have been ordered according to the `ordering`
- * [[Expression Expressions]].  This is a strictly stronger guarantee than
- * [[ClusteredDistribution]] as an ordering will ensure that tuples that share the
- * same value for the ordering expressions are contiguous and will never be split across
- * partitions.
+ * [[Expression Expressions]]. Its requirement is defined as the following:
+ *   - Given any 2 adjacent partitions, all the rows of the second partition must be larger
than or
+ *     equal to any row in the first partition, according to the `ordering` expressions.
 Review comment:
   I did not change the semantic, I just correct the comment to represent what the current
semantic is.

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

> improve the doc of Distribution/Partitioning
> --------------------------------------------
>                 Key: SPARK-26297
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Wenchen Fan
>            Assignee: Wenchen Fan
>            Priority: Major

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message