hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Re: MapReduce and MPI
Date Thu, 01 Dec 2011 19:35:29 GMT
+1,  I was looking at using them together just in this past week.  but no
bandwidth to work on myself.

2011/12/1 Mahadev Konar <mahadev@hortonworks.com>

> Ralph,
>  I think there is a lot of interest in MPI over Hadoop. If you are
> counting votes here's my +1.
>
> mahadev
>
> On Thu, Dec 1, 2011 at 3:31 AM, Ralph Castain <rhc@open-mpi.org> wrote:
> > Hi folks
> >
> > I'm a lead developer on the Open MPI project, and recently joined the
> Hadoop community to help with Hamster. A couple of people have asked me
> about using MPI more generally inside MapReduce, and it does indeed seem a
> good candidate to use that method of communication.
> >
> > It seems to me, though, that a pre-requisite for moving that direction
> is a good set of Java MPI bindings. I've checked with the MPI community,
> and while there have been a couple of attempts at this, nothing really
> "adopted" by the community has been done.
> >
> > I have some spare time while I search for a new job, so I thought I
> might tackle this over the next few weeks. However, I thought I would
> assess the actual level of interest before investing the time - it isn't a
> trivial thing to do, but doable if there is interest.
> >
> > Thanks
> > Ralph
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message