hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Virajith Jalaparti (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12777) [READ] Share URI prefix across Provided blocks to lower memory footprint.
Date Fri, 03 Nov 2017 23:57:00 GMT
Virajith Jalaparti created HDFS-12777:
-----------------------------------------

             Summary: [READ] Share URI prefix across Provided blocks to lower memory footprint.
                 Key: HDFS-12777
                 URL: https://issues.apache.org/jira/browse/HDFS-12777
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Virajith Jalaparti
            Priority: Major


As opposed to local blocks, each DN keeps track of all blocks in PROVIDED storage. This can
be millions of blocks for 100s of TBs of PROVIDED data. This JIRA aims to reduce the memory
footprint of these blocks by using a common URI prefix across all PROVIDED blocks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message