incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Samuel Guo" <guosi...@gmail.com>
Subject Re: add a shell file in hama
Date Wed, 17 Sep 2008 08:51:24 GMT
It seems that we cannot load a matrix from file right now.
Should we implement the I/O of Matrices first?

sth like:
Matrix Matrix.load(path file);
Matrix Matrix.load(path file, Class mrcls);

Matrix Matrix.save(path file);

we can use a mapreduce job to speed up the matrix's loading into HBase.

On Wed, Sep 17, 2008 at 3:50 PM, Edward J. Yoon <edwardyoon@apache.org>wrote:

> Thanks for your nice proposal. Looks good for me.
> If you start the work, Please open the issue in Jira. :)
>
> /Edward
>
> On Wed, Sep 17, 2008 at 12:51 PM, Samuel Guo <guosijie@gmail.com> wrote:
> > I added a wiki page : http://wiki.apache.org/hama/Shell
> >
> > But I am sorry that I am not familiar with formatting wiki pages. I will
> try
> > to make it more readable.
> >
> > On Wed, Sep 17, 2008 at 11:10 AM, Edward J. Yoon <edwardyoon@apache.org
> >wrote:
> >
> >>  Could you please add a new page for this on Wiki? :)
> >>
> >> Thanks
> >>
> >> On Wed, Sep 17, 2008 at 12:07 PM, Samuel Guo <guosijie@gmail.com>
> wrote:
> >> > yes, it is better.
> >> >
> >> > On Wed, Sep 17, 2008 at 11:00 AM, Edward J. Yoon <
> edwardyoon@apache.org
> >> >wrote:
> >> >
> >> >> Wouldn't it be better to use it like the following :
> >> >>
> >> >> // a = load "fileA" as Matrix using MyMapReduce.class
> >> >>
> >> >> In order to let the users define their own user defined parallel
> >> >> parser class for fileA.
> >> >>
> >> >> /Edward
> >> >>
> >> >> On Wed, Sep 17, 2008 at 11:48 AM, Samuel Guo <guosijie@gmail.com>
> >> wrote:
> >> >> > Yes. sth like HBase Shell.
> >> >> >
> >> >> > the shell maybe like:
> >> >> >
> >> >> > Load :
> >> >> >
> >> >> > a = load "fileA" as Matrix
> >> >> > b = load "fileB" as Matrix
> >> >> >
> >> >> > Add:
> >> >> >
> >> >> > c = a + b
> >> >> >
> >> >> > Multiply:
> >> >> >
> >> >> > d = a * b
> >> >> >
> >> >> > Save:
> >> >> >
> >> >> > write c as "fileC"
> >> >> >
> >> >> > ----
> >> >> > all the execution may be lazy until we write the Matrix, so that
we
> >> can
> >> >> > rearrange the computations to make it more efficiently.
> >> >> >
> >> >> > any suggestions?
> >> >> >
> >> >> >
> >> >> > On Wed, Sep 17, 2008 at 10:32 AM, Edward J. Yoon <
> >> edwardyoon@apache.org
> >> >> >wrote:
> >> >> >
> >> >> >> Oh, I like this Idea. Let's make a rough plan on the wiki.
(I
> think
> >> >> >> the HQL will be useful)
> >> >> >>
> >> >> >> If you need any help, Please mail here.
> >> >> >>
> >> >> >> /Edward
> >> >> >>
> >> >> >> On Wed, Sep 17, 2008 at 11:17 AM, Samuel Guo <guosijie@gmail.com>
> >> >> wrote:
> >> >> >> > Hello everyone,
> >> >> >> >
> >> >> >> > It seems that there isn't any shell in hama. I would
like to add
> a
> >> >> shell
> >> >> >> > file in hama to make the execution of examples more easily.
How
> >> could
> >> >> I
> >> >> >> do ?
> >> >> >> >
> >> >> >> > Thanks.
> >> >> >> >
> >> >> >> > Samuel
> >> >> >> >
> >> >> >>
> >> >> >>
> >> >> >>
> >> >> >> --
> >> >> >> Best regards, Edward J. Yoon
> >> >> >> edwardyoon@apache.org
> >> >> >> http://blog.udanax.org
> >> >> >>
> >> >> >
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Best regards, Edward J. Yoon
> >> >> edwardyoon@apache.org
> >> >> http://blog.udanax.org
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> Best regards, Edward J. Yoon
> >> edwardyoon@apache.org
> >> http://blog.udanax.org
> >>
> >
>
>
>
> --
> Best regards, Edward J. Yoon
> edwardyoon@apache.org
> http://blog.udanax.org
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message