Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hama-dev@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of tommaso.teofili@gmail.com
 designates 209.85.220.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAGQgZQRqYt_G2QEvEe-NRjfnxg+uhf2++FUwYE-n9yPPPDsFJQ@mail.gmail.com>
References: 
 <CAGQgZQTazWj3j_jvg1RE9duSoNy_OroyhN4fRsGG+Up3BSZZgg@mail.gmail.com>
 <CAJ-=ysmLSnh12homhKFP2z=q3_M4RyN47pyYfLG6atJx8wWCjA@mail.gmail.com>
 <CAGQgZQSB66+wzOeYyGRre2CV3A=Xow=JW6Z_kMUj8_zQKTs7Tw@mail.gmail.com>
 <CAJ-=ysk6YP5q1tssU_B2kpsXvS45eCBkADoZ8-Y6-vxPwkUUGg@mail.gmail.com>
 <CAGQgZQSCaFEJc8Zvo7gogdpqQMQuGikZ9GRfVXQRMSbayW-UAw@mail.gmail.com>
 <CAJ-=yskGQ5yqOYUDNE-U_1sU5bWnDYGCjZS-fE=8338RbmD6jQ@mail.gmail.com>
 <CAGQgZQRqYt_G2QEvEe-NRjfnxg+uhf2++FUwYE-n9yPPPDsFJQ@mail.gmail.com>
From: Tommaso Teofili <tommaso.teofili@gmail.com>
Date: Wed, 2 Nov 2011 13:09:07 +0100
Message-ID: 
 <CAGnSx079RisGDTp2s5AKkzCxyQOQOxvGJOnwCNDDeOetihFwVQ@mail.gmail.com>
Subject: Re: Please review new APIs.
To: hama-dev@incubator.apache.org
Content-Type: multipart/alternative; boundary=485b397dccfb36102504b0bf5986

--485b397dccfb36102504b0bf5986
Content-Type: text/plain; charset=ISO-8859-1

2011/11/2 Edward J. Yoon <edwardyoon@apache.org>

> > I'm sure that not every job actually needs a cleanup or a setup.
>
> You're right. Almost BSP applications should override bsp() method
> but, setup() and cleaner() methods are not as you said. Let's fix
> them.
>

Agreed +1


>
> > Generally I would suggest to integrate the OutputCollector and the
> > RecordReader into the BSPPeerImpl.
> > So our peer is like the context in Hadoop.
>
> Good idea.
>

+1 here too

Tommaso


>
> On Wed, Nov 2, 2011 at 9:03 PM, Thomas Jungblut
> <thomas.jungblut@googlemail.com> wrote:
> > Yes. When I reworked that API, I made a default implementation in our
> > abstract BSP class.
> > So the user has to override the methods for himself, if he needs to.
> > I'm sure that not every job actually needs a cleanup or a setup.
> >
> > Generally I would suggest to integrate the OutputCollector and the
> > RecordReader into the BSPPeerImpl.
> > So our peer is like the context in Hadoop.
> > But that is just a minor thing. It is a great improvement ;)
> >
> > 2011/11/2 Edward J. Yoon <edwardyoon@apache.org>
> >
> >> There're bsp(), setup() and cleaner() methods.
> >>
> >> What is you suggestion?
> >>
> >> On Wed, Nov 2, 2011 at 8:47 PM, Thomas Jungblut
> >> <thomas.jungblut@googlemail.com> wrote:
> >> > Have a look at the combiner class. I know that this is just a "test",
> but
> >> > it is really messy if the user does not use the methods, but is
> forced to
> >> > override them.
> >> >
> >> > 2011/11/2 Edward J. Yoon <edwardyoon@apache.org>
> >> >
> >> >> Why?
> >> >>
> >> >> On Wed, Nov 2, 2011 at 8:21 PM, Thomas Jungblut
> >> >> <thomas.jungblut@googlemail.com> wrote:
> >> >> > I totally dislike that BSP class now has abstract methods instead
> of
> >> >> > default implementations.
> >> >> >
> >> >> > 2011/11/2 Edward J. Yoon <edwardyoon@apache.org>
> >> >> >
> >> >> >> Hi all,
> >> >> >>
> >> >> >> As you know, recently combiners and IO are added.
> >> >> >>
> >> >> >> Please review them from user viewpoint.
> >> >> >>
> >> >> >>
> >> >> >>
> >> >>
> >>
> http://svn.apache.org/repos/asf/incubator/hama/trunk/examples/src/main/java/org/apache/hama/examples/PiEstimator.java
> >> >> >>
> >> >> >> I'm testing multiple tasks and IO features on 100 nodes cluster
> using
> >> >> >> 10 tasks per node. If there's no issue, I'll close HAMA-258.
> >> >> >>
> >> >> >> Thanks.
> >> >> >>
> >> >> >> --
> >> >> >> Best Regards, Edward J. Yoon
> >> >> >> @eddieyoon
> >> >> >>
> >> >> >
> >> >> >
> >> >> >
> >> >> > --
> >> >> > Thomas Jungblut
> >> >> > Berlin <thomas.jungblut@gmail.com>
> >> >> >
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Best Regards, Edward J. Yoon
> >> >> @eddieyoon
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Thomas Jungblut
> >> > Berlin <thomas.jungblut@gmail.com>
> >> >
> >>
> >>
> >>
> >> --
> >> Best Regards, Edward J. Yoon
> >> @eddieyoon
> >>
> >
> >
> >
> > --
> > Thomas Jungblut
> > Berlin <thomas.jungblut@gmail.com>
> >
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

--485b397dccfb36102504b0bf5986--