hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amey Barve <ameybarv...@gmail.com>
Subject Re: unique-id for the mapper task with tez execution engine
Date Wed, 23 Dec 2015 07:24:46 GMT
Ok Thanks.

Can I get this *<attempt_..._m_000000_0>, **<attempt_..._m_000000_1>*from
some conf to be absolutely sure that I get unique id ?

Regards,
Amey

On Wed, Dec 23, 2015 at 12:06 PM, Gopal Vijayaraghavan <gopalv@apache.org>
wrote:

> Hi,
>
> > So what do you suggest to get unique-id for mapper task with tez
> >execution engine?
> >
> > conf.get("mapreduce.task.partition");
> >
> > Is this correct?
>
> Yes, that is correct - but it can only be unique within a Mapper vertex.
>
> Tez plans sort of look like this for complex queries
>
> http://people.apache.org/~gopalv/tpch-plans/q2_minimum_cost_supplier.svg
>
>
> Every MapTezProcessor there will go from 0-n, for that config parameter.
>
> So all those Map 1, Map 2 ... Map 17 will have a task.partition 0 with the
> same <attempt_..._m_000000_0> in the attempt id, because there's no room
> for a vertex-id in there.
>
> Cheers,
> Gopal
>
>
>
>
>
>
>
>

Mime
View raw message