hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <>
Subject [jira] [Commented] (HIVE-5052) Set parallelism when generating the tez tasks
Date Wed, 14 Aug 2013 09:43:49 GMT


Gunther Hagleitner commented on HIVE-5052:


- next power of two in java can be done in a simpler way: 
j = Integer.higestOneBit(i);
i==j return i : j<<1;

- We shouldn't change the default for BYTESPERREDUCER. If we want a different default for
TEZ we should probably create a different var.
- The comment should mention what happens with multi parent reduce-work
- There seems to be some dead code at the end of the file
- The setting of the var can be broken into separate method in the class
- If the reducesink specifies a specific number of reducers, do we need to carry that number
through additional stages? Right now you will add other stuff to it during the walk.
> Set parallelism when generating the tez tasks
> ---------------------------------------------
>                 Key: HIVE-5052
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gunther Hagleitner
>            Assignee: Vikram Dixit K
>             Fix For: tez-branch
>         Attachments: HIVE-5052.1.patch.txt, HIVE-5052.2.patch.txt
> In GenTezTask any intermediate task has parallelism set to 1. This needs to be fixed.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message