Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
Received-SPF: pass (athena.apache.org: domain of gshapira@cloudera.com
 designates 209.85.212.178 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CA+A96v0g8Jm2aevn9o0vsfoGvZQmerrxT=CgJE=bZMMitzKEOA@mail.gmail.com>
References: 
 <CA+A96v0g8Jm2aevn9o0vsfoGvZQmerrxT=CgJE=bZMMitzKEOA@mail.gmail.com>
Date: Tue, 14 Apr 2015 09:52:03 -0700
Message-ID: 
 <CAHBV8WfFu-y4=Jir8m+yvT+Z_q1N=sYMNod9OOrNusEKNr-Tig@mail.gmail.com>
Subject: Re: [KafkaSource] Write timestamp in the header
From: Gwen Shapira <gshapira@cloudera.com>
To: user@flume.apache.org
Content-Type: text/plain; charset=UTF-8

Are you sure KafkaSource does that? Or do you have an Interceptor?

On Tue, Apr 14, 2015 at 9:50 AM, Tao Li <litao.buptsse@gmail.com> wrote:
> Hi all:
>
> I found that KafkaSource will put "System.currentTimeMillis()" as
> "timestamp" field in header. If we use HDFSEventSink, the HDFS log can be
> rotate by the timestamp.
>
> But the web server log usually contains "timestamp" string, and it indicate
> the true timestamp, other than "System.currentTimeMillis()". So I think if
> have a feature to allow to customarize the "timestamp" field, will be
> better.