hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chandra Mohan, Ananda Vel Murugan" <Ananda.Muru...@honeywell.com>
Subject RE: Calling a MATLAB library in map reduce program
Date Fri, 16 Aug 2013 08:50:36 GMT
Thanks for all the suggestion. I will explore more and raise specific questions if needed.


From: Sandy Ryza [mailto:sandy.ryza@cloudera.com]
Sent: Thursday, August 15, 2013 1:30 AM
To: user@hadoop.apache.org
Subject: Re: Calling a MATLAB library in map reduce program

To add to that, if you want to take advantage of MapReduce, e.g. you need to do a distributed
grouping or sort, pipes or streaming would be the way to go.  If you're mainly interested
in running your code in parallel on a cluster, distributed shell, a YARN application outside
of MapReduce, could be a simpler way to accomplish this.


On Wed, Aug 14, 2013 at 11:17 AM, Omkar Joshi <ojoshi@hortonworks.com<mailto:ojoshi@hortonworks.com>>
Can you take a look at distributed shell example? It will be helpful.

Omkar Joshi
Hortonworks Inc.<http://www.hortonworks.com>

On Tue, Aug 13, 2013 at 9:35 PM, Chandra Mohan, Ananda Vel Murugan <Ananda.Murugan@honeywell.com<mailto:Ananda.Murugan@honeywell.com>>

I have to run some analytics on the files present in HDFS using a MATLAB code. I am thinking
of compiling the MATLAB code into a C++ library and calling it in map reduce code. How can
I implement this? I read Hadoop streaming or Hadoop pipes can be used for this. But I have
not tried it on my own. Please share your valuable suggestions.


NOTICE: This message is intended for the use of the individual or entity to which it is addressed
and may contain information that is confidential, privileged and exempt from disclosure under
applicable law. If the reader of this message is not the intended recipient, you are hereby
notified that any printing, copying, dissemination, distribution, disclosure or forwarding
of this communication is strictly prohibited. If you have received this communication in error,
please contact the sender immediately and delete it from your system. Thank You.

View raw message