hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Walter Su (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8798) Erasure Coding: fix the retry logic of DFSStripedInputStream
Date Fri, 24 Jul 2015 10:42:05 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Walter Su updated HDFS-8798:
----------------------------
    Attachment: HDFS-8798-HDFS-7285.02.patch

Uploaded 02 patch. The patch does:

1. removed rename {{refreshLocatedBlock}}

2. removed retry logic for connection failure. I kept
{code}
+            // re-fetch the block in case the block has been moved
+            fetchBlockAt(block.getStartOffset());
{code}
because TestBlockTokenWithDFS.testRead() has a special case that restarts all DNs in new locations/ports.
I keep the 2 lines so that the test can pass. It's a workaround so I add a {{TODO}}

3. fix OutputStream handling block tokens & add test.

4. add test for balancer moving striped blocks with token enabled.

> Erasure Coding: fix the retry logic of DFSStripedInputStream
> ------------------------------------------------------------
>
>                 Key: HDFS-8798
>                 URL: https://issues.apache.org/jira/browse/HDFS-8798
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Walter Su
>            Assignee: Walter Su
>         Attachments: HDFS-8798-HDFS-7285.02.patch, HDFS-8798.01.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message