hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Using hadoop for Matrix Multiplication in NFS?
Date Sat, 14 Nov 2009 03:10:37 GMT
I think another thing to look at is Mahout - http://lucene.apache.org/mahout 

See http://mahout.markmail.org/search/matrix+multiplication

Otis
--
Sematext is hiring -- http://sematext.com/about/jobs.html?mls
Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR



----- Original Message ----
> From: Brian Bockelman <bbockelm@cse.unl.edu>
> To: common-user@hadoop.apache.org
> Cc: core-user@hadoop.apache.org
> Sent: Fri, November 13, 2009 12:06:37 PM
> Subject: Re: Using hadoop for Matrix Multiplication in NFS?
> 
> Hi,
> 
> Assuming you're doing math...
> What you want is PETSc for sparse matrices: 
> http://www.mcs.anl.gov/petsc/petsc-as/
> If you're doing dense matrices, probable scalapack: 
> http://www.netlib.org/scalapack/
> 
> You benefit from working with someone who has a background in numerical 
> analysis.
> 
> Brian
> 
> On Nov 14, 2009, at 12:42 AM, zjffdu wrote:
> 
> > See my comments
> > 
> > 
> > -----Original Message-----
> > From: Gimick [mailto:gimmickivek@gmail.com]
> > Sent: 2009年11月12日 23:22
> > To: core-user@hadoop.apache.org
> > Subject: Using hadoop for Matrix Multiplication in NFS?
> > 
> > 
> > Hi, I am new to hadoop.  I am planning to do matrix multiplication(of order
> > millions) using hadoop.
> > 
> > I have a few queries regarding the above.
> > 
> > i) Will using hadoop be a fix for this or should I try some other
> > approaches?
> > 
> > --- Hama maybe such a tool that fit for your requirement,
> > http://incubator.apache.org/hama/
> > 
> > ii) I will be using it in NFS.  Will using hadoop still be a good option?
> > --- If you want to use NFS, I guess you have to provide your own
> > InputFormat. So you'd better put your data into hdfs, it will make your work
> > easy and improve your program's performance
> > 
> > 
> > 
> > If I can use hadoop for this problem, could you plz send links to configure
> > hadoop-site.xml file for a nfs system.
> > 
> > P.S. I tried a few setup instructions via search, but everything seems to
> > give "Unable to connect to ...." error.
> > 
> > --View this message in context:
> > http://old.nabble.com/Using-hadoop-for-Matrix-Multiplication-in-NFS--tp26332
> > 382p26332382.html
> > Sent from the Hadoop core-user mailing list archive at Nabble.com.


Mime
View raw message