incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Tariq <donta...@gmail.com>
Subject Re: Data collection using 0.5.0
Date Sun, 18 Dec 2011 22:42:06 GMT
Hello AD,

  I have these properties set, but it seems there is still some
problem as I can't see data moving.I have just posted a mail regarding
this.Please have a look and let me know where I am going wrong.

Regards,
    Mohammad Tariq



On Mon, Dec 19, 2011 at 4:03 AM, AD <straightflush@gmail.com> wrote:
> You *should* be able to use the pipeline writer
>
> <property>
>   <name>chukwaCollector.writerClass</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</value>
> </property>
>
> and then chain your writers
>
> <property>
>       <name>chukwaCollector.pipeline</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.hbase.HbaseWriter,org.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter</value> </property>
>
> On Sun, Dec 18, 2011 at 3:13 PM, Mohammad Tariq <dontariq@gmail.com> wrote:
>>
>> Hi Eric,
>>
>>   Thanks again for your reply.. I was just going through the updated
>> docs..I have a small question for you, is it possible to collect data
>> to HDFS and Hbase simultaneously??Thanks once again.
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Mon, Dec 19, 2011 at 1:37 AM, Eric Yang <eric818@gmail.com> wrote:
>> > For collecting data to HBase, you will need to make sure that you have
>> > a demux parser
>> > that is compatible with HBase.  TSProcessor doe not work with HBase
>> > because it does
>> > not have a targeted HBase table annotation embedded in TSProcessor.
>> >
>> > See the programming guide to stream your data to HBase:
>> >
>> > http://people.apache.org/~eyang/chukwa-0.5.0-docs/programming.html
>> >
>> > For enabling HBase as the data sink, see the configuration guide for
>> > collector:
>> >
>> > http://people.apache.org/~eyang/chukwa-0.5.0-docs/collector.html
>> >
>> > Hope this helps.
>> >
>> > regards,
>> > Eric
>> >
>> > On Sun, Dec 18, 2011 at 6:35 AM, Mohammad Tariq <dontariq@gmail.com>
>> > wrote:
>> >> Hello list,
>> >>
>> >>     Can I use the steps, I had used to collect data to the HDFS, for
>> >> Hbase as well??Or are there any changes now?? It's been quite sometime
>> >> since I had configured chukwa-0.5.0, but I couldn't proceed further
>> >> due to some tight schedule and now I want to go ahead.Many thanks.
>> >>
>> >> Regards,
>> >>     Mohammad Tariq
>
>

Mime
View raw message