hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5851) Support memory as a storage medium
Date Wed, 18 Jun 2014 16:58:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Sanjay Radia updated HDFS-5851:

    Attachment: SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf

Slightly updated doc on DDM:
* Clarified the separation of mechanism from DDM policy as per Colin's and my comment on being
able to create memory cached file anywhere in the HDFS namespace.
 * Explained how DDMs fit  with materialized queries (julains DIMMQ).
 * Updated  references marked TBD
  * Minor improvements to the RDD/Tachyon comparison.
    Note this text was written prior to Ali and Li's comment and hence does  not address their
concern. I am rereading the Tachyon paper and will be meeting Li over the next couple of days
and will update further as needed.

> Support memory as a storage medium
> ----------------------------------
>                 Key: HDFS-5851
>                 URL: https://issues.apache.org/jira/browse/HDFS-5851
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: 3.0.0
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>         Attachments: SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf,
SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf, SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf
> Memory can be used as a storage medium for smaller/transient files for fast write throughput.
> More information/design will be added later.

This message was sent by Atlassian JIRA

View raw message