Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of tanjiaqi@gmail.com designates
 209.85.219.219 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type:content-transfer-encoding;
        b=LOQyGh1jkGVaoK7r0BKv1n4HyddsLrVwIOaLEhpbjQUJokdRdoI4YaLtBBdo9Q4iyL
         QNfSVNO8sOkRR+DtgQxQ6D1UR8gMW0R22bUDazp4RoU7wKTLqnlqSgs7QEyBbWZT9tB5
         bYJBU+cey4+4dbc2xXocjtiMYoKoeGz6hluZM=
MIME-Version: 1.0
In-Reply-To: <f80a104a0906040952p2a9ad271sbb9c188be5ff7f46@mail.gmail.com>
References: <f80a104a0906040952p2a9ad271sbb9c188be5ff7f46@mail.gmail.com>
From: Jiaqi Tan <tanjiaqi@gmail.com>
Date: Thu, 4 Jun 2009 10:17:01 -0700
Message-ID: <f80a104a0906041017yf293b8w91ef3e623cf9c999@mail.gmail.com>
Subject: Re: Gotcha's in writing ChukwaRecords using ChukwaRecordOutputFormat?
To: chukwa-dev@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

Hi,

I changed my number of reducers from 2 to 1 and that fixed the
problem. Does the MultipleOutputFormat require that writes to the same
file be performed by only one reduce?

Jiaqi

On Thu, Jun 4, 2009 at 9:52 AM, Jiaqi Tan <tanjiaqi@gmail.com> wrote:
> Hi,
>
> I'm having weird behaviour in writing ChukwaRecords using the
> ChukwaRecordOutputFormat. I wrote 200 records out, and Hadoop reports
> that I had a total of 200 output records from my job, but when I used
> bin/dumpRecord.sh on the output file, I had only 100 records in the
> SequenceFile. Any idea what the problem could be?
>
> I've checked the values used for the ChukwaRecordKey's, and they're
> all unique strings.
>
> Thanks,
> Jiaqi
>