avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: AvroMultipleOutput ignores schemas (other than default)
Date Thu, 31 Jan 2013 18:52:24 GMT
Johannes,

Can you (or someone) please file an issue in Jira for this?

Thanks!

Doug

On Wed, Jan 30, 2013 at 2:32 PM, Johannes Schulte
<johannes.schulte@gmail.com> wrote:
> Hi!
>
> Maybe I'm the only one ever used this :D.
>
> Adding namedOutputs with AvroMultipleOutputs.addNamedOutput just adds them
> to a static map which is of course not available on the cluster during
> reduce execution. The unit tests pass though since the Instance of
> AvroMultipleOutputs is the same in the Reducer as in the Job's main class,
> so the added schemas there are present.
> Fix would be to add the namedOutput schemas to the job configuration so they
> can be parsed in the reducers. Example patch for the new mapreduce api here:
>
> https://gist.github.com/4677875
>
> Have a nice evening,
>
> Johannes
>

Mime
View raw message