hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bob Hansen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings
Date Tue, 10 Nov 2015 15:54:11 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bob Hansen updated HDFS-9228:
-----------------------------
    Attachment: HDFS-9228.HDFS-8707.001.patch

Implemented retry with fixed intervals (the java client default retry).
Defaults to no retry.

I had to move the Engine's RPC connection from a unique_ptr to a shared_ptr, since it could
be released during rpc callbacks (e.g. a comms error).

Made rpc_connection's start implicit on completing handshake to help in coordinating with
the engine.

Because the headers can now change, the Request class encodes the payload on construction,
but not the whole message.

Still needs tests over retry and recovery, but I wanted feedback on the implementation.


> libhdfs++ should respect NN retry configuration settings
> --------------------------------------------------------
>
>                 Key: HDFS-9228
>                 URL: https://issues.apache.org/jira/browse/HDFS-9228
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs-client
>            Reporter: Bob Hansen
>            Assignee: Bob Hansen
>         Attachments: HDFS-9228.HDFS-8707.001.patch
>
>
> Handle the use case of temporary network or NN hiccups and have a configurable number
of retries for NN operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message