hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1570) referencing an added file by it's name in a transform script does not work in hive local mode
Date Wed, 15 Sep 2010 23:18:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12909943#action_12909943
] 

Ning Zhang commented on HIVE-1570:
----------------------------------

Joy, scriptfile1.q actually failed on TestMinimrCliDriver with the command 

ant test -Dhadoop.version=0.20.0 -Dtestcase=TestMinimrCliDriver -Dminimr.query.files=scriptfile1.q

It gives NPE on ExecDriver.java:625. This NPE is a different issue and it can be solved by
changing 'conf' to 'job'. But even after this change the NPE is gone and the test still failed.
Should we move this test outside minimr.query.files for now before this JIRA is fixed?

> referencing an added file by it's name in a transform script does not work in hive local
mode
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1570
>                 URL: https://issues.apache.org/jira/browse/HIVE-1570
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Joydeep Sen Sarma
>            Assignee: Joydeep Sen Sarma
>
> Yongqiang tried this and it fails in local mode:
> add file ../data/scripts/dumpdata_script.py;
> select count(distinct subq.key) from
> (FROM src MAP src.key USING 'python dumpdata_script.py' AS key WHERE src.key = 10) subq;
> this needs to be fixed because it means we cannot choose local mode automatically in
case of transform scripts (since different paths need to be used for cluster vs. local mode
execution)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message