hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7090) Use unbuffered writes when persisting in-memory replicas
Date Tue, 14 Oct 2014 11:46:37 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170810#comment-14170810
] 

Hudson commented on HDFS-7090:
------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #711 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/711/])
HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu
Yao. (cnauroth: rev 1770bb942f9ebea38b6811ba0bc3cc249ef3ccbb)
* hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
* hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIO.java
* hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/errno_enum.c
* hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/Errno.java
* hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/nativeio/NativeIO.c
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/Storage.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt


> Use unbuffered writes when persisting in-memory replicas
> --------------------------------------------------------
>
>                 Key: HDFS-7090
>                 URL: https://issues.apache.org/jira/browse/HDFS-7090
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: 2.6.0
>            Reporter: Arpit Agarwal
>            Assignee: Xiaoyu Yao
>             Fix For: 3.0.0
>
>         Attachments: HDFS-7090.0.patch, HDFS-7090.1.patch, HDFS-7090.2.patch, HDFS-7090.3.patch,
HDFS-7090.4.patch
>
>
> The LazyWriter thread just uses {{FileUtils.copyFile}} to copy block files to persistent
storage. It would be better to use unbuffered writes to avoid churning page cache.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message