hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Thusoo (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-205) file sink operator needs unique file names
Date Mon, 05 Jan 2009 15:11:44 GMT

    [ https://issues.apache.org/jira/browse/HIVE-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660781#action_12660781
] 

Ashish Thusoo commented on HIVE-205:
------------------------------------

what happens in the test

./ql/src/test/queries/clientpositive/union.q

the seems to have the same general pattern as the reported query...


> file sink operator needs unique file names
> ------------------------------------------
>
>                 Key: HIVE-205
>                 URL: https://issues.apache.org/jira/browse/HIVE-205
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Zheng Shao
>
> a query like "SELECT * FROM (SELECT 'a' from table UNION ALL SELECT 'b' from table) c"
will fail, because the 2 sub queries of "UNION" will be executed inside the same mapper (because
the input is the same) towards the same destination table, and the 2 file sink operators will
have the same output file name.
> We need to append the file sink operator id to the file name to make it unique.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message