hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5948) Output file name is random when using Tez with "insert overwrite local directory"
Date Wed, 04 Dec 2013 22:40:36 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13839425#comment-13839425
] 

Thejas M Nair commented on HIVE-5948:
-------------------------------------

I understand the expected dir name (ie behavior with MR) is of the form "000000_0" , ie the
task id.

Can you also add a comment to the setupMRLegacyConfigs function explaining why those configs
are being set.

It will also be good to have a unit test for this, you can take a look at ql/src/test/queries/clientpositive/insert_overwrite_local_directory_1.q
{code}
insert overwrite local directory '../../data/files/local_src_table_1'
select * from src ;
dfs -cat ../../data/files/local_src_table_1/000000_0;
{code}

You need to add the query file name to itests/qtest/pom.xml under  <minitez.query.files>
.
To generate the benchmark output file, run
mvn test -Dtest=TestMiniTezCliDriver -Dqfile=<new test file>.q -Phadoop-2



> Output file name is random when using Tez with "insert overwrite local directory" 
> ----------------------------------------------------------------------------------
>
>                 Key: HIVE-5948
>                 URL: https://issues.apache.org/jira/browse/HIVE-5948
>             Project: Hive
>          Issue Type: Bug
>          Components: Tez
>            Reporter: Hitesh Shah
>            Priority: Minor
>         Attachments: HIVE-5948.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message