hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7090) Use unbuffered writes when persisting in-memory replicas
Date Thu, 09 Oct 2014 06:40:33 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiaoyu Yao updated HDFS-7090:
-----------------------------
    Attachment: HDFS-7090.0.patch

Attache an initial patch that use JNI that calls sendfile() under Linux and CopyFileEx under
Windows for unbuffered file copy.

> Use unbuffered writes when persisting in-memory replicas
> --------------------------------------------------------
>
>                 Key: HDFS-7090
>                 URL: https://issues.apache.org/jira/browse/HDFS-7090
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: HDFS-6581
>            Reporter: Arpit Agarwal
>            Assignee: Xiaoyu Yao
>         Attachments: HDFS-7090.0.patch
>
>
> The LazyWriter thread just uses {{FileUtils.copyFile}} to copy block files to persistent
storage. It would be better to use unbuffered writes to avoid churning page cache.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message