hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8479) Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421
Date Tue, 26 May 2015 23:14:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560084#comment-14560084
] 

Jing Zhao commented on HDFS-8479:
---------------------------------

BTW, while running tests after the merge, I got this test failure:
{code}
Running org.apache.hadoop.hdfs.TestDFSStripedInputStream
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 24.727 sec <<< FAILURE!
- in org.apache.hadoop.hdfs.TestDFSStripedInputStream
testPreadWithDNFailure(org.apache.hadoop.hdfs.TestDFSStripedInputStream)  Time elapsed: 3.329
sec  <<< ERROR!
org.apache.hadoop.HadoopIllegalArgumentException: Inputs not fully corresponding to erasedIndexes
in null places
	at org.apache.hadoop.io.erasurecode.rawcoder.RSRawDecoder.doDecode(RSRawDecoder.java:132)
	at org.apache.hadoop.io.erasurecode.rawcoder.AbstractRawErasureDecoder.decode(AbstractRawErasureDecoder.java:113)
	at org.apache.hadoop.hdfs.util.StripedBlockUtil.decodeAndFillBuffer(StripedBlockUtil.java:291)
	at org.apache.hadoop.hdfs.DFSStripedInputStream.fetchOneStripe(DFSStripedInputStream.java:594)
	at org.apache.hadoop.hdfs.DFSStripedInputStream.fetchBlockByteRange(DFSStripedInputStream.java:520)
	at org.apache.hadoop.hdfs.DFSInputStream.pread(DFSInputStream.java:1472)
	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:1435)
	at org.apache.hadoop.hdfs.TestDFSStripedInputStream.testPreadWithDNFailure(TestDFSStripedInputStream.java:242)
{code}

Zhe, Do you want to include the fix here or do it in a separate jira?

> Erasure coding: fix striping related logic in FSDirWriteFileOp to sync with HDFS-8421
> -------------------------------------------------------------------------------------
>
>                 Key: HDFS-8479
>                 URL: https://issues.apache.org/jira/browse/HDFS-8479
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>         Attachments: HDFS-8479-HDFS-7285.0.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message