apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akshay Gore <goreaks...@gmail.com>
Subject Re: What is the backpressure story ?
Date Mon, 01 Feb 2016 02:27:48 GMT
We would like to see more details in the docs.

-Akshay
On 01-Feb-2016 05:54, "Thomas Weise" <thomas.weise@gmail.com> wrote:

> That's incorrect. Backpressure works when spooling is enabled (which is
> default). It's not handled only when you turn spooling off explicitly.
>
> On Sun, Jan 31, 2016 at 3:50 PM, Sandesh Hegde <sandesh@datatorrent.com>
> wrote:
>
>> According to Vlad, disabling the spooling will crash the buffer server
>> after it runs out of memory.
>>
>> It means Apex doesn't have a mechanism to handle backpressure yet.
>>
>> On Fri, Jan 29, 2016 at 9:34 AM Pramod Immaneni <pramod@datatorrent.com>
>> wrote:
>>
>>> By default buffer spooling is enabled so data gets spooled to file
>>> system once the buffer limits are reached, there will be some slow down but
>>> upstream will continue to process, if buffer spooling is disabled then when
>>> the buffers are filled the sender is blocked and this back pressure will
>>> propagate upstream to the first operator.
>>>
>>> On Fri, Jan 29, 2016 at 7:47 AM, Sandesh Hegde <sandesh@datatorrent.com>
>>> wrote:
>>>
>>>> Hello Team,
>>>>
>>>> My understanding of the backpressure in Apex is, Buffer server will
>>>> slow down ( because of TCP/IP congestion control ) the upstream operator
if
>>>> the downstream is slow. Is there more to it?
>>>> I don't see this topic covered in docs.
>>>>
>>>> Thanks
>>>> Sandesh
>>>>
>>>>
>>>>
>>>>
>>>
>

Mime
View raw message