spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paulo Candido <pcandid...@gmail.com>
Subject Re: Microbatches length
Date Thu, 20 Oct 2016 11:30:52 GMT
In this case I haven't any alternatives to get microbatches with same
length? Using another class or any configuration? I'm using socket.

Thank you for attention.

Em qui, 20 de out de 2016 às 09:24, 王贺(Gabriel) <gabriel.wang.sh@gmail.com>
escreveu:

> The interval is for time, so you won't get micro-batches in same data size
> but same time length.
>
> Yours sincerely,
> Gabriel (王贺)
> Mobile: +86 18621263813 <+86%20186%202126%203813>
>
>
> On Thu, Oct 20, 2016 at 6:38 PM, pcandido <pcandido.m@gmail.com> wrote:
>
> Hello folks,
>
> I'm using Spark Streaming. My question is simple:
> The documentation says that microbatches arrive in intervals. The intervals
> are in real time (minutes, seconds). I want to get microbatches with same
> length, so, I can configure SS to return microbatches when it reach a
> determined length?
>
> Thanks.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Microbatches-length-tp27927.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>
> --

Paulo Cândido

Mime
View raw message