spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adrian Mocanu <amoc...@verticalscope.com>
Subject RE: range partitioner with updateStateByKey
Date Fri, 02 May 2014 14:35:34 GMT
I’d like to know both ways: arrival order and sort order

-A

From: Tathagata Das [mailto:tathagata.das1565@gmail.com]
Sent: May-02-14 12:04 AM
To: user@spark.apache.org
Cc: user@spark.incubator.apache.org
Subject: Re: range partitioner with updateStateByKey

Ordered by what? arrival order? sort order?

TD


On Thu, May 1, 2014 at 2:35 PM, Adrian Mocanu <amocanu@verticalscope.com<mailto:amocanu@verticalscope.com>>
wrote:
If I use a range partitioner, will this make updateStateByKey take the tuples in order?
Right now I see them not being taken in order (most of them are ordered but not all)

-Adrian


Mime
View raw message