hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <>
Subject [jira] [Updated] (HIVE-3234) getting the reporter in the recordwriter
Date Tue, 13 Nov 2012 21:20:12 GMT


Owen O'Malley updated HIVE-3234:

    Status: Patch Available  (was: Open)

This patch passes in the real mapreduce reporter as the progressable for getHiveReportWriter.
OutputFormats should still protect themselves from null in the Progressable, but the FileSinkOperator
passes a Reporter from the mapreduce job.
> getting the reporter in the recordwriter
> ----------------------------------------
>                 Key: HIVE-3234
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Serializers/Deserializers
>    Affects Versions: 0.9.1
>         Environment: any
>            Reporter: Jimmy Hu
>            Assignee: Owen O'Malley
>              Labels: newbie
>             Fix For: 0.9.1
>         Attachments: HIVE-3234.D6699.1.patch
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> We would like to generate some custom statistics and report back to map/reduce later
wen implement the 
>  FileSinkOperator.RecordWriter interface. However, the current interface design doesn't
allow us to get the map reduce reporter object. Please extend the current FileSinkOperator.RecordWriter
interface so that it's close() method passes in a map reduce reporter object. 
> For the same reason, please also extend the RecordReader interface too to include a reporter
object so that users can passes in custom map reduce  counters.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message