giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hassan Eslami (JIRA)" <>
Subject [jira] [Resolved] (GIRAPH-1056) Setting auto-read in Netty to false
Date Tue, 26 Apr 2016 18:00:15 GMT


Hassan Eslami resolved GIRAPH-1056.
    Resolution: Fixed

> Setting auto-read in Netty to false
> -----------------------------------
>                 Key: GIRAPH-1056
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Hassan Eslami
>            Assignee: Hassan Eslami
>            Priority: Minor
> By default, auto-read flag is set to true in Netty. This means Netty proactively read
requests as they become available to a worker. However, this behavior sometime causes the
off-heap memory to increase continuously. This happens specifically in presence of a spike
in the amount of received requests. In that situation, the processing/handling rate of incoming
requests may be less than the request receipt rate leading to high-memory kill (CGroup kill
or OOM). With auto-read flag set to false, we read and process requests one by one and (hopefully/presumably)
letting the transport layer do the flow control (i.e. dropping packets or reducing congestion
window of TCP).

This message was sent by Atlassian JIRA

View raw message