hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file
Date Tue, 02 May 2017 22:18:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993894#comment-15993894
] 

Andrew Wang commented on HDFS-11643:
------------------------------------

Hi Sammi, I noticed that the 007 patch doesn't include any changes to the balancer to use
the new shouldReplicate builder API. The new unit test changes work without the rest of the
patch applied because we just committed HDFS-11718 so EC files don't throw an exception on
hflush/hsync.

Can we add an assert to check that the balancer's lock file is replicated? Thanks.

> Balancer fencing fails when writing erasure coded lock file
> -----------------------------------------------------------
>
>                 Key: HDFS-11643
>                 URL: https://issues.apache.org/jira/browse/HDFS-11643
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: balancer & mover, erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Andrew Wang
>            Assignee: SammiChen
>            Priority: Blocker
>              Labels: hdfs-ec-3.0-must-do
>         Attachments: HDFS-11643.001.patch, HDFS-11643.002.patch, HDFS-11643.003.patch,
HDFS-11643.004.patch, HDFS-11643.005.patch, HDFS-11643.006.patch, HDFS-11643.007.patch
>
>
> At startup, the balancer writes its hostname to the lock file and calls hflush(). hflush
is not supported for EC files, so this fails when the entire filesystem is erasure coded.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message