hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5851) Support memory as a storage medium
Date Fri, 27 Jun 2014 18:56:29 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14046280#comment-14046280
] 

Andrew Purtell commented on HDFS-5851:
--------------------------------------

bq.  In term of discardability, what is the "eviction" policy for such data and how control
or fine tune it if needed.

Related, I was talking with [~cmccabe] in the context of HDFS-4949 about possible LRU or LFU
policy based eviction, and how that might work. Interesting open question of how to revoke
access to mapped pages shared by the datanode with another process without causing the client
process to segfault. I don't see this issue addressed in the design doc on this issue. One
possibility is a callback protocol advising the client process of pending invalidations?

> Support memory as a storage medium
> ----------------------------------
>
>                 Key: HDFS-5851
>                 URL: https://issues.apache.org/jira/browse/HDFS-5851
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: datanode
>    Affects Versions: 3.0.0
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>         Attachments: SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf,
SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf, SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf
>
>
> Memory can be used as a storage medium for smaller/transient files for fast write throughput.
> More information/design will be added later.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message