Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E6371EC5E for ; Tue, 19 Feb 2013 03:15:26 +0000 (UTC) Received: (qmail 93399 invoked by uid 500); 19 Feb 2013 03:15:26 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 93338 invoked by uid 500); 19 Feb 2013 03:15:26 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 93324 invoked by uid 99); 19 Feb 2013 03:15:26 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Feb 2013 03:15:26 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of hoo.smth@gmail.com designates 74.125.82.174 as permitted sender) Received: from [74.125.82.174] (HELO mail-we0-f174.google.com) (74.125.82.174) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Feb 2013 03:15:19 +0000 Received: by mail-we0-f174.google.com with SMTP id r6so5272737wey.5 for ; Mon, 18 Feb 2013 19:14:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=fQ1obZbEVItUKl+DidF9KDjsTJHy+QprBlF+3ryrEXY=; b=vUhTGEHz9b70yVh3yG6rRSN5B89MgPyn0iXvTihwfumNA66utNaKsxZJ3IwtiV4eNj zgnDKwuToSFERGZgtvWr7TMTDul/nUHM9eL1IIrbsW65zOvYHEw4Ic8P/M2J7czEA3ki gH/tTzfzoTQ9zf9Pfg/obDgu/0OQCiNZ5BVpKR0GZzZMCieSbEMjJzZIjGCPB93XS4dI 8z4wDOkgrXnQDW6bj1FaRUbJVPOmBFAWBFnpOvnrlRFjPgTiNSctGfbj3DD1OWPv1+A5 7vfwevVuWxc5Q3a5p1ykIEXJ9ImGudLilny/HOsoS1jVrOrBeIyQtu55nU/qPQiNfA44 ZCUg== MIME-Version: 1.0 X-Received: by 10.180.81.42 with SMTP id w10mr12735448wix.28.1361243698196; Mon, 18 Feb 2013 19:14:58 -0800 (PST) Received: by 10.216.236.194 with HTTP; Mon, 18 Feb 2013 19:14:58 -0800 (PST) In-Reply-To: References: Date: Tue, 19 Feb 2013 11:14:58 +0800 Message-ID: Subject: Re: strange flume hdfs put From: "hoo.smth" To: user@flume.apache.org Content-Type: multipart/alternative; boundary=bcaec555503e15715004d60b3f18 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec555503e15715004d60b3f18 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable =E4=BD=A0=E4=BF=AE=E6=94=B9=E4=B8=8Bhdfs sink=E7=9A=84writeFormat=E5=8D=B3= =E5=8F=AF=E3=80=82 On Tue, Feb 19, 2013 at 11:09 AM, =E5=91=A8=E6=A2=A6=E6=83=B3 wrote: > hello, > I put some data to hdfs via flume 1.3.1,but it changed! > > source data: > [zhouhh@Hadoop47 ~]$ echo "<13>Mon Feb 18 18:25:26 2013 hello world zhh > " | nc -v hadoop48 5140 > Connection to hadoop48 5140 port [tcp/*] succeeded! > > the flume agent received: > 13/02/19 10:43:46 INFO hdfs.BucketWriter: Creating > hdfs://Hadoop48:54310/flume//FlumeData.1361241606972.tmp > 13/02/19 10:44:16 INFO hdfs.BucketWriter: Renaming > hdfs://Hadoop48:54310/flume/FlumeData.1361241606972.tmp to > hdfs://Hadoop48:54310/flume/FlumeData.1361241606972 > > the content in hdfs: > > [zhouhh@Hadoop47 ~]$ hadoop fs -cat > hdfs://Hadoop48:54310/flume/FlumeData.1361241606972 > SEQ!org.apache.hadoop.io.LongWritable"org.apache.hadoop.io.BytesWritable= =E2=96=92.FI=E2=96=92Z=E2=96=92Q{2=E2=96=92,\<=E2=96=92U=E2=96=92Y)Mon > Feb 18 18:25:26 2013 hello world zhh > [zhouhh@Hadoop47 ~]$ > > I don't know why there is some data like > "org.apache.hadoop.io.LongWritable",there are some bugs? > > Best Regards, > Andy > > --bcaec555503e15715004d60b3f18 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable =E4=BD=A0=E4=BF=AE=E6=94=B9=E4=B8=8Bhdfs sink=E7=9A=84writeFormat=E5=8D=B3= =E5=8F=AF=E3=80=82

On Tue, Feb 19, 2013 a= t 11:09 AM, =E5=91=A8=E6=A2=A6=E6=83=B3 <ablozhou@gmail.com> wrote:
hello,
I put some data to hdfs via flume 1.3.1,but it changed!

source data:
[zhouhh@Hadoop47 ~]$ =C2=A0ech= o "<13>Mon Feb 18 18:25:26 2013 hello world zhh " | nc -v h= adoop48 5140
Connection to hadoop48 5140 port [tcp/*] succeeded!
the flume agent received:
13/02/19 10:43:46 INF= O hdfs.BucketWriter: Creating hdfs://Hadoop48:54310/flume//FlumeData.136124= 1606972.tmp
13/02/19 10:44:16 INFO hdfs.BucketWriter: Renaming hdfs://Hadoop48:543= 10/flume/FlumeData.1361241606972.tmp to hdfs://Hadoop48:54310/flume/FlumeDa= ta.1361241606972

the content in hdfs:

[zhouhh@Hadoop47 ~]$ hadoop fs -cat =C2=A0hdfs://H= adoop48:54310/flume/FlumeData.1361241606972
SEQ!org.apache.hadoop= .io.LongWritable"org.apache.hadoop.io.BytesWritable=E2=96=92.FI=E2=96= =92Z=E2=96=92Q{2=E2=96=92,\<=E2=96=92U=E2=96=92Y)Mon Feb 18 18:25:26 201= 3 hello world zhh=C2=A0
[zhouhh@Hadoop47 ~]$

I don't know w= hy there is some data like "org.apache.hadoop.io.LongWritable",th= ere are some bugs?

Best Regards,
Andy


--bcaec555503e15715004d60b3f18--