hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7847) Write a junit test to simulate a heavy BlockManager load
Date Mon, 09 Mar 2015 19:24:39 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal updated HDFS-7847:
--------------------------------
    Attachment: make_blocks.tar.gz

Hi [~clamb], I have attached a couple of rudimentary scripts I used to create DN blocks. The
scripts uses template block+meta files to create as many blocks as you need. It needs updating
post HDFS-6482 to put blocks into the correct subdirectories based on their block ID but the
fix should be simple.

On the NN side you can use CreateEditsLog.java which is in our source tree to generate files
with the generated block IDs. The edits log can be copied over to a freshly formatted namenode.

HTH.

> Write a junit test to simulate a heavy BlockManager load
> --------------------------------------------------------
>
>                 Key: HDFS-7847
>                 URL: https://issues.apache.org/jira/browse/HDFS-7847
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>    Affects Versions: HDFS-7836
>            Reporter: Colin Patrick McCabe
>            Assignee: Charles Lamb
>         Attachments: make_blocks.tar.gz
>
>
> Write a junit test to simulate a heavy BlockManager load.  Quantify native and java heap
sizes, and some latency numbers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message