avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1179) AvroMultipleOutputs does not seem to be generating different base output paths
Date Wed, 17 Oct 2012 20:14:03 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478325#comment-13478325

Harsh J commented on AVRO-1179:

Hi Ashish,

I think the specific error happens when you use the MO.write(KEY, VALUE, STRING) signature,
which allows MO users to generally write outputs without defining a named output first. In
this case, the STRING part is passed into the record writer fetch call, but is ignored there.
> AvroMultipleOutputs does not seem to be generating different base output paths
> ------------------------------------------------------------------------------
>                 Key: AVRO-1179
>                 URL: https://issues.apache.org/jira/browse/AVRO-1179
>             Project: Avro
>          Issue Type: Bug
>          Components: java
>    Affects Versions: 1.7.2
>            Reporter: Viji
> In the implementation at http://svn.apache.org/repos/asf/avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapreduce/AvroMultipleOutputs.java,
the following line in {{getRecordWriter(TaskAttemptContext taskContext, String baseFileName)}}
has been commented out:
> {code}//FileOutputFormat.setOutputName(taskContext, baseFileName);{code}
> Hence, when we call {{mo.write(outKey, NullWritable.get(), "subdir/samp");}} the output
still goes to the default output directory and not under the string path we specify.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message