hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Ziemba (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2226) TaggedInputSplit should be public
Date Fri, 23 Mar 2018 00:30:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410619#comment-16410619
] 

Dan Ziemba commented on MAPREDUCE-2226:
---------------------------------------

[~esammer] Is there a recommended better way to get the Path of the original InputSplit when
using MR2? As a user of hadoop 2.6.0 (cloudera dist), this is still affecting me.  I have
not found a better way to access this info other than reflection hackery as described in https://stackoverflow.com/a/11130420/1270447.

> TaggedInputSplit should be public
> ---------------------------------
>
>                 Key: MAPREDUCE-2226
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2226
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 0.20.1
>            Reporter: E. Sammer
>            Assignee: E. Sammer
>            Priority: Major
>         Attachments: MAPREDUCE-2226.diff
>
>
> Currently it's not possible to get at the original InputSplits when using MultipleInputs.
This is because TaggedInputSplit (used by DelegatingInputFormat used by MultipleInputs) is
not public. This means things like the following do not work:
> {code}
> public void map(...) {
>   FileSplit fis = (FileSplit)((TaggedInputSplit) reporter.getInputSplit()).getInputSplit();
>   Path p = fis.getPath();
> }
> {code}
> This prevents users from getting at input split specific data.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message