hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-452) Adding caching to Hadoop which is independent of the task trackers.
Date Sat, 12 Aug 2006 00:01:14 GMT
Adding caching to Hadoop which is independent of the task trackers.
-------------------------------------------------------------------

                 Key: HADOOP-452
                 URL: http://issues.apache.org/jira/browse/HADOOP-452
             Project: Hadoop
          Issue Type: New Feature
            Reporter: Mahadev konar
            Priority: Minor


It would be nice to have a feature in Hadoop that could cache files locally that is independent
of TaskTrackers and JobTrackers. Hadoop-288 caching is dependent on the tasktrackers. In an
environment where you would dynamically bring up and down the TaskTrackers for resource sharing,
that is problematic. It would be good to have this feature wherein you can install tasktrackers/jobtrackers
on these machines using this caching mechanism. The caching feature could use something like
Bittorent /http/rsync to copy the main hadoop.jar.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message