flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhijiang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7406) Implement Netty receiver incoming pipeline for credit-based
Date Thu, 10 Aug 2017 03:50:00 GMT
zhijiang created FLINK-7406:

             Summary: Implement Netty receiver incoming pipeline for credit-based
                 Key: FLINK-7406
                 URL: https://issues.apache.org/jira/browse/FLINK-7406
             Project: Flink
          Issue Type: Sub-task
          Components: Network
            Reporter: zhijiang
            Assignee: zhijiang
             Fix For: 1.4.0

This is a part of work for credit-based network flow control.

Currently {{PartitionRequestClientHandler}} receives and reads {{BufferResponse}} from producer.
It will request buffer from {{BufferPool}} for holding the message. If not got, the message
is staged temporarily and {{autoread}} for channel is set false.

For credit-based mode, {{PartitionRequestClientHandler}} can always get buffer from {{RemoteInputChannel}}
for reading messages from producer.

The related works are:

* Add the backlog of producer in {{BufferResponse}} message structure
* {{PartitionRequestClientHandler}} requests buffer from {{RemoteInputChannel}} directly
* {{PartitionRequestClientHandler}} updates backlog for {{RemoteInputChannel}}, and it may
trigger requests of floating buffers from {{BufferPool}}

This message was sent by Atlassian JIRA

View raw message