chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <>
Subject Re: Incubator PMC/Board report for Jul 2013 ([ppmc])
Date Sun, 07 Jul 2013 17:03:28 GMT
Hadoop has evolved in a non straight forward release branches.  Chukwa
currently works with Hadoop 1.x branch.  For moving forward to Hadoop 2.x,
the mapreduce jobs need to be using the new Yarn framework to implement
some of the missing pieces that Hadoop broke the compatibility.  HBase has
done something similar for Hadoop compatibility layer.  Chukwa may have to
do the same thing to keep up to date.  I don't know how to quantify the man
hours needed to keep up to date.  It may be one or two weeks to work on it
full time.  It may spread across several months, when we work on this part

The instrumentation points in MR v1 will needs to be migrated and
instrument Yarn.  It is going to be interesting work to monitor and analyze
Yarn.  Therefore, the work may be interesting to people that would like to
visualize yarn performance.  We probably should release 0.6 as bugfix
release before working on this.


On Sun, Jul 7, 2013 at 9:27 AM, Alan D. Cabrera <>wrote:

> On Jul 6, 2013, at 7:52 PM, Eric Yang <> wrote:
> > ChukwaChukwa is a log collection and analysis framework for Apache
> Hadoop clusters.Chukwa has been incubating since 2010-07-14.
> >
> > Three most important issues to address in the move towards graduation:
> >
> > 1. Keep code up-to-date with Hadoop trend
> > 2. Make another release
> > 3. Keep wiki page up to date and better documentation
> IMO, the number one item should be increasing an active community.
> > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> aware of?
> >
> > Chukwa code needs to be maintained to keep up with new versions of
> Hadoop.
> Can you characterize what is the scope of the work that needs to be done?
>  Especially in terms of estimated man hours needed to bring Chukwa up to
> date.
> > How has the community developed since the last report?
> >
> > Committers are communicate more actively than previous quarter.
> >
> > How has the project developed since the last report?
> >
> > More contributors have open JIRA to request features and experiment with
> code base.  Website is now svnpubsub enabled.  Javadocs are regenerated to
> remove frame injection vulnerability.
> >
> > Date of last release: January 2012
> >
> > Draft report attached for the group to review.  In Chukwa 0.6 release, we
> > have 2 outstanding issues, and hope the community will help out to make
> > this release possible.  I also updated the team list to reflect the
> current
> > state.  Let me know if there is any questions or comments.  Thanks
> >
> > regards,
> > Eric

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message