Return-Path: 
 <chukwa-user-return-1164-apmail-incubator-chukwa-user-archive=incubator.apache.org@incubator.apache.org>
X-Original-To: apmail-incubator-chukwa-user-archive@www.apache.org
Delivered-To: apmail-incubator-chukwa-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id F1F069B31
	for <apmail-incubator-chukwa-user-archive@www.apache.org>;
 Fri, 16 Mar 2012 19:41:03 +0000 (UTC)
Received: (qmail 30498 invoked by uid 500); 16 Mar 2012 19:41:03 -0000
Delivered-To: apmail-incubator-chukwa-user-archive@incubator.apache.org
Received: (qmail 30471 invoked by uid 500); 16 Mar 2012 19:41:03 -0000
Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:chukwa-user-help@incubator.apache.org>
List-Unsubscribe: <mailto:chukwa-user-unsubscribe@incubator.apache.org>
List-Post: <mailto:chukwa-user@incubator.apache.org>
List-Id: <chukwa-user.incubator.apache.org>
Reply-To: chukwa-user@incubator.apache.org
Delivered-To: mailing list chukwa-user@incubator.apache.org
Received: (qmail 30464 invoked by uid 99); 16 Mar 2012 19:41:03 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Mar 2012 19:41:03 +0000
X-ASF-Spam-Status: No, hits=-0.5 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of eric818@gmail.com designates
 74.125.82.175 as permitted sender)
Received: from [74.125.82.175] (HELO mail-we0-f175.google.com) (74.125.82.175)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Mar 2012 19:40:57 +0000
Received: by wera1 with SMTP id a1so4316384wer.6
        for <chukwa-user@incubator.apache.org>;
 Fri, 16 Mar 2012 12:40:36 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        bh=Aafd6XIFLMsqQQ6VgCM+QbvuYcaeYJy3hnt4KCFkw2Y=;
        b=if3xFW0UjyVFm3zJV+LpbTj6fm3p1x3ZqRX8oScLDXMFGRLtbmbAcRtnLmcXzhG3u0
         clxvLikP7KK43oVD7J786mlxVR0pvwLf4lxUS8/deSZ+jh0A0KDi9wuJtQdObTxfX22q
         MgZg/BsvGxjiMLaW6bmB7JHFId9hPc45IJBS2mcpj0/rCDG3PDdFQis2KITiWrTnShHv
         AWNaR4EEFho9SfuLvhXm8qZUkPee/CEOV9VM0DtF7dXs8lp+SEtx7ldyR+xQZ5zuhbtH
         cbh06ovulpwAK26LInnVin6T156QG75AxF/15Zt69sFD8CtQftRsI1V8CGQddGweGLHD
         SwkQ==
MIME-Version: 1.0
Received: by 10.180.106.9 with SMTP id gq9mr1097686wib.17.1331926836037; Fri,
 16 Mar 2012 12:40:36 -0700 (PDT)
Received: by 10.216.23.144 with HTTP; Fri, 16 Mar 2012 12:40:35 -0700 (PDT)
In-Reply-To: 
 <CAM2WPyy4TYjoAeHHT75nQ-wKw-3-LAn2EwvCC7xAR2POorx=Lg@mail.gmail.com>
References: 
 <CAM2WPyzgc2=mZxVsoWSP8tYfWhZ6BpNWVN6Km=jhh2GSjASxGw@mail.gmail.com>
	<CAM2WPyy4TYjoAeHHT75nQ-wKw-3-LAn2EwvCC7xAR2POorx=Lg@mail.gmail.com>
Date: Fri, 16 Mar 2012 12:40:35 -0700
Message-ID: 
 <CADfbTpGpow=QfzD7NNSyyLBQ0JGp2FEAB8vc91M2_ZBuJDUKeg@mail.gmail.com>
Subject: Re: The collector data sink file path
From: Eric Yang <eric818@gmail.com>
To: chukwa-user@incubator.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org

Hi Ivy,

This is because the configuration is using SeqFileWriter instead of LocalWr=
iter.

You should change your configuration to:

<property>
    <name>chukwaCollector.pipeline</name>
    <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,o=
rg.apache.hadoop.chukwa.datacollection.writer.LocalWriter</value>
</property>

to use write data locally.  By using SeqFileWriter, the data is
written to hdfs://hostname:port/chukwa/logs.

regards,
Eric

On Wed, Mar 14, 2012 at 9:05 PM, IvyTang <ivytang0812@gmail.com> wrote:
> Sorry =A0, =A0got it wrong.
>
> My question is:
>
>
> The the wiki says
>
> Configuring and starting the Collector
>
> Edit etc/chukwa/chukwa-collector-conf.xml and comment out the default
> properties for chukwaCollector.writerClass, and chukwaCollector.pipeline.
> Uncomment block for HBaseWriter parameters, and save.
>
> But my conf is
> =A0 <property>
> =A0 =A0 <name>chukwaCollector.writerClass</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter=
</value>
> =A0 </property>
>
> =A0 <property>
> =A0 =A0 <name>chukwaCollector.pipeline</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,org=
.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter</value>
> =A0 </property>
>
> however , the hadoop indeed received the log .
>
> 2. The=A0chukwaCollector.localOutputDir and=A0chukwaCollector.writerClass=
 has
> been comment.
> So where is the local data sink =A0file ?
>
>
> On Thu, Mar 15, 2012 at 11:33 AM, IvyTang <ivytang0812@gmail.com> wrote:
>>
>> the chukwaCollector.localOutputDir in=A0chukwa-collector-conf.xml =A0is =
set to
>> be=A0/tmp/chukwa/dataSink/.
>>
>> when i want to see the sink file , i =A0found there is no such directory=
.
>>
>> but the log is being transfered to hadoop.
>>
>> Where the data sink file?
>>
>> --
>> Best regards,
>>
>> Ivy Tang
>>
>>
>>
>
>
>
> --
> Best regards,
>
> Ivy Tang
>
>
>