hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopal Vijayaraghavan <>
Subject Re: unique-id for the mapper task with tez execution engine
Date Wed, 23 Dec 2015 05:28:50 GMT

(x-posts to bcc:)

On 12/22/15, 9:19 PM, "Amey Barve" <> wrote:

>Now I want to run same hive queries with tez engine and I want to know
>should be my unique-id. Is there any property from configuration or other
>that can give me unique-id from the mapper task?
>I am using conf.get("mapreduce.task.partition") property, Is that
>to give unique - id for tez?

That's populated in Tez in pretty much the exact format used by MRv2.

But beware, each mapper & reducer think it's the only one of its kind out
there, so there are collisions between DAG stages for the unique name.


View raw message