hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milind Bhandarkar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2911) Hamster: Hadoop And Mpi on the same cluSTER
Date Tue, 30 Aug 2011 07:04:38 GMT
Hamster: Hadoop And Mpi on the same cluSTER
-------------------------------------------

                 Key: MAPREDUCE-2911
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2911
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: mrv2
    Affects Versions: 0.23.0
         Environment: All Unix-Environments
            Reporter: Milind Bhandarkar
            Assignee: Milind Bhandarkar
             Fix For: 0.23.0


MPI is commonly used for many machine-learning applications. OpenMPI (http://www.open-mpi.org/)
is a popular BSD-licensed version of MPI. In the past, running MPI application on a Hadoop
cluster was achieved using Hadoop Streaming (http://videolectures.net/nipsworkshops2010_ye_gbd/),
but it was kludgy. After the resource-manager separation from JobTracker in Hadoop, we have
all the tools needed to make MPI a first-class citizen on a Hadoop cluster. I am currently
working on the patch to make MPI an application-master. Initial version of this patch will
be available soon (hopefully before September 10.) This jira will track the development of
Hamster: The application master for MPI.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message