Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-dev@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of asrabkin@gmail.com designates
 209.85.221.187 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:from:to:in-reply-to:content-type
         :content-transfer-encoding:x-mailer:mime-version:subject:date
         :references;
        b=EKfuBlKm13EDrIkwoO5ZW9gNICB+1MMmzvamtZqSx/13J1Erk2K+xLd9bZ3CSbLeST
         b/P3DDMYzQXbzZUXgRSLOQw95koNe+Y79JyYg+x0uIBZyf9bb5RH0+vcKBOxeq218llf
         SwPnQCzmEFvZczv3uIlQuKFxZJnlfS4AZD/ww=
Message-Id: <C2E04EFC-5F7C-46A0-9C6D-02F782351F5C@gmail.com>
From: asrabkin@gmail.com
To: "chukwa-dev@hadoop.apache.org" <chukwa-dev@hadoop.apache.org>
In-Reply-To: <C75016FC.585E%eyang@yahoo-inc.com>
Content-Type: text/plain;
	charset=us-ascii;
	format=flowed;
	delsp=yes
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (iPhone Mail 7D11)
Subject: Re: PipelineStageWriter doesn't work as expected
Date: Thu, 17 Dec 2009 20:26:51 -0500
References: <C75016FC.585E%eyang@yahoo-inc.com>

Put the SocketTeeWriter first.

sent from my iPhone; please excuse typos and brevity.

On Dec 17, 2009, at 8:12 PM, Eric Yang <eyang@yahoo-inc.com> wrote:

> Hi all,
>
> I'd setup SocketTeeWriter by itself, and having data stream to next  
> socket
> reader program.  When I tried to configure two writers, i.e.,  
> SeqFileWriter
> follow by SocketTeeWriter.  It doesn't work because SeqFileWriter  
> isn't
> extending PipelineableWriter.  I went ahead to extend SeqFileWriter as
> PipelineableWriter and do that and implemented setNextStage method,  
> and
> configured collector with:
>
>  <property>
>    <name>chukwaCollector.writerClass</name>
>
> <value> 
> org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</v
> alue>
>  </property>
>
>  <property>
>    <name>chukwaCollector.pipeline</name>
>
> <value> 
> org.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter,org.apac
> he.hadoop.chukwa.datacollection.writer.SocketTeeWriter</value>
>  </property>
>
> SeqFileWriter writes the data correctly, but when connect to
> SocketTeeWriter, there was no data visible in SocketTeeWriter.   
> Commands
> works fine, but data streaming doesn't happen.  How do I configure the
> collector and PipelineStageWriter to be able to write data into  
> multiple
> writer?  Is there something on SeqFileWriter that could prevent this  
> from
> working?
>
> Regards,
> Eric
>