chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <eric...@gmail.com>
Subject Re: Chukwa developerWorks article
Date Tue, 07 Sep 2010 02:00:17 GMT
Sounds good.  You are correct.  HICC does not work out of the box for 0.4.

regards,
Eric

On Mon, Sep 6, 2010 at 3:23 PM, Ahmed Fathalla <afathalla@gmail.com> wrote:
> My plan for the article is to contain an introduction about the importance
> of log processing frameworks like Chukwa, Scribe and Flume. Then provide a
> description of Chukwa's architecture and finally a section on installing and
> configuring Chukwa.
>
> I can base the article on 0.4 and provide pointers about areas where users
> can expect changes in 0.5 and later.
>
> Also, you said MySQL is not supported in 0.4, does this mean that HICC
> doesn't work for 0.4 out of the box?
>
>
>
> On Tue, Sep 7, 2010 at 12:33 AM, Eric Yang <eric818@gmail.com> wrote:
>
>> Chukwa 0.5 is not going to be ready by end of this year.  There are
>> some major changes which I only work on them on long weekends.  I
>> think it's best for you to ask questions and you can choose to target
>> for Chukwa 0.4 or 0.5 on your own discretion.  For Chukwa 0.3, it was
>> prototyped to load data to HDFS and load materialized result to MySQL.
>>  For Chukwa 0.4, it is designed to load data to HDFS only.  MySQL path
>> is no longer supported.  However, there are hacks to make MySQL
>> components to work with Chukwa 0.4.  Chukwa 0.5 is designed to load
>> data to HBase for scalability reason.  However, there is a big chunk
>> of work post data loading for Chukwa 0.5 that are not written.  Hence,
>> it depends on which version that you are interested in writing
>> article.  I can provide pointers, but it is definitely going to take
>> much longer than 8 weeks for Chukwa 0.5.
>>
>> regards,
>> Eric
>>
>> On Sun, Sep 5, 2010 at 8:27 PM, Ahmed Fathalla <afathalla@gmail.com>
>> wrote:
>> > Hey Eric,
>> >                    Thanks for your feedback. Publishing an artcile
on
>> > developerWorks takes some time, you have to submit an abstract, then if
>> the
>> > abstract is accepted you submit drafts which are reviewed by editors
>> before
>> > the final version is published. The process takes no less than 8 weeks.
>> >
>> > So I suggest we get started while working on 0.5. I can start by
>> submitting
>> > an abstract and communicating with the editor, do you agree?
>> >
>> >
>> >
>> > On Mon, Sep 6, 2010 at 5:15 AM, Eric Yang <eyang@yahoo-inc.com> wrote:
>> >
>> >> Hi Ahmed,
>> >>
>> >> This is a great idea.  I am interested.  However, Chukwa is going
>> through
>> >> some major changes in Chukwa 0.5.  The changes are taking a while to be
>> >> completed.  It may be worth while to wait for the new changes to arrive
>> >> before writing the article.  What do you think?
>> >>
>> >> Regards,
>> >> Eric
>> >>
>> >> On 9/2/10 3:23 AM, "Ahmed Fathalla" <afathalla@gmail.com> wrote:
>> >>
>> >> Hello Guys,
>> >>                     I was previously speaking to Ari and he told
me
>> about
>> >> the need for more community knowledge of Chukwa. I think contributing an
>> >> article about Chukwa to IBM developerWorks would be a great way of
>> >> informing
>> >> the general community about it. IBM developerWorks is a great source of
>> >> accurate and relevant information about many subjects that interest the
>> IT
>> >> community in general, people have already contributed articles about
>> Hadoop
>> >> and Mahout and they've got positive feedback, so I think the time has
>> come
>> >> to publish one about Chukwa.
>> >>
>> >> I am willing to co-author this article with anyone who's interested.
>> What
>> >> do
>> >> u think?
>> >>
>> >> --
>> >> Ahmed Fathalla
>> >>
>> >>
>> >
>> >
>> > --
>> > Ahmed Fathalla
>> >
>>
>
>
>
> --
> Ahmed Fathalla
>

Mime
View raw message