tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Turner Eagles (Jira)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-4264) Make vertex id available from MROutputCommitter
Date Fri, 15 Jan 2021 15:49:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266138#comment-17266138
] 

Jonathan Turner Eagles commented on TEZ-4264:
---------------------------------------------

The OutputCommitterContext I believe contains the vertex name already. Is this API available
to you?
https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/runtime/api/OutputCommitterContext.java#L55

> Make vertex id available from MROutputCommitter
> -----------------------------------------------
>
>                 Key: TEZ-4264
>                 URL: https://issues.apache.org/jira/browse/TEZ-4264
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>         Attachments: TEZ-4264.1.patch
>
>
> In order for the innerĀ org.apache.hadoop.mapreduce.OutputCommitter instance of MROutputCommitter
to have access to the vertex id when committing the entire job, we should copy the vertex
id from the context object into the job conf.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message