hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-865) harchive: Reduce the number of open calls to _index and _masterindex
Date Thu, 13 Aug 2009 23:44:14 GMT
harchive: Reduce the number of open calls  to _index and _masterindex 
----------------------------------------------------------------------

                 Key: MAPREDUCE-865
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-865
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: harchive
            Reporter: Koji Noguchi
            Priority: Minor


When I have har file with 1000 files in it, 
   % hadoop dfs -lsr har:///user/knoguchi/myhar.har/
would open/read/close the _index/_masterindex files 1000 times.

This makes the client slow and add some load to the namenode as well.
Any ways to reduce this number?


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message