Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; c=nofws; d=darose.net; h=message-id:date
	:from:mime-version:to:subject:references:in-reply-to
	:content-type:content-transfer-encoding; q=dns; s=darose.net; b=
	DyoYTolmlJ0+4n1ftrkuzj+NMHFhWR2EfHgWZQh9X2BwU14+eHHKHVBUEpieuW8X
	9SW+17PkLZZNgG3KO9EYwK36lLXpgb3EhWSYiMfFXOsO6/qp/YB3AEvaBK6eEWIT
	PHPcZ9wMzvkWP+pR3cKcS9qEK6Ka/hRY1RAURgD2pqo=
Message-ID: <4C60BEF6.80908@darose.net>
Date: Mon, 09 Aug 2010 22:52:38 -0400
From: David Rosenstrauch <darose@darose.net>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.9.2.8) Gecko/20100806 Lanikai/3.1.2
MIME-Version: 1.0
To: mapreduce-user@hadoop.apache.org
Subject: Re: How to set SequenceFile.Metadata from within
 SequenceFileOutputFormat?
References: <4C5CF40F.1000606@darose.net>
 <AANLkTikct1Mu9hD8H0d3x+DgYW4Asby2Ae+EWB3ZZ-=C@mail.gmail.com>
 <4C605E8D.4060507@darose.net> <4C6076F8.5090608@darose.net>
 <4C607A68.6090601@darose.net>
 <AANLkTi=eH=VbBsw5yUeVTvrBOL4boF1GjH-r+L8WQfYt@mail.gmail.com>
In-Reply-To: <AANLkTi=eH=VbBsw5yUeVTvrBOL4boF1GjH-r+L8WQfYt@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

On 08/09/2010 09:14 PM, Harsh J wrote:
> Another solution would be to create a custom named output using
> mapred.lib.MultipleOutputs and collecting to that instead of the
> job-set output format (which one can set to NullOutputFormat so it
> doesn't complain about existing paths, etc.).
>
> So if you'd want 'foo' prefix to your 00000-NNNNN numbered output
> files (instead of default 'part'), you'd create it with
> MultipleOutputs.addNamedOutput(Conf, "foo", YourOutFormat.class,
> Key.class, Value.class);
>
> The extension, I believe, can be changed too, while 'getting' the path
> from the FileOutputFormat while building your RecordWriter. Something
> like:
> Path outPath = FileOutputFormat.getTaskOutputPath(job, name+YOUR_EXTENSION);
> // Now create the 'writer' on this path.

Tnx for the tip - didn't know about MultipleOutputs.  (Though it's 
probably overkill for what I'm doing.)

Thanks again,

DR