Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of eric818@gmail.com designates
 74.125.82.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAM2WPywKhprgUJkUz7dDbk=pacAKoZPcOqHxx7eJE2NN=bpMQQ@mail.gmail.com>
References: 
 <CAM2WPywKhprgUJkUz7dDbk=pacAKoZPcOqHxx7eJE2NN=bpMQQ@mail.gmail.com>
Date: Sat, 19 May 2012 16:51:25 -0700
Message-ID: 
 <CADfbTpHKOv9bY2=Z7Zx9K-YXmHpONx7_M506mMdd+j_G+HHKsg@mail.gmail.com>
Subject: Re: the check point offset is bigger than the log file size
From: Eric Yang <eric818@gmail.com>
To: chukwa-user@incubator.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I am unable to reproduce this if the log file has not rotated.

I know there is a separated bug that when file is rotated, the check
point offset does not change until the new file exceeds the last check
point offset.

I only use Log4j SocketAppender and SocketAdaptor for streaming data.
I don't use CharFileTailingAdaptorUTF8 adaptor.

regards,
Eric

On Mon, May 14, 2012 at 4:01 AM, IvyTang <ivytang0812@gmail.com> wrote:
> The gamelog size is=A0158023223, but the check point file is
>
> ADD adaptor_2963225a90653a309cf779d4a1d815a3 =3D
> org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailin=
gAdaptorUTF8
> Gamelog 0 /var/log/dataproxy/gamelog 229406124
>
> The gamelog didn't rotate , i'm sure.
>
> But the check point file size is bigger than the file size , the chukwa
> WARN Thread-2 FileTailingAdaptor -
> Adaptor|adaptor_2963225a90653a309cf779d4a1d815a3| file:
> /var/log/dataproxy/gamelog, has rotated and no detection - reset counters=
 to
> 0L
> And the agent began to transfer the whole log file.
>
> I just feel confused why agent generate a offset size is bigger than the =
log
> size when the gamelog did not rotate.
>
> The chukwa version is 0.4.0
>
> --
> Best regards,
>
> Ivy Tang
>
>
>