hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1570) referencing an added file by it's name in a transform script does not work in hive local mode
Date Thu, 19 Aug 2010 22:31:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900501#action_12900501
] 

Joydeep Sen Sarma commented on HIVE-1570:
-----------------------------------------

hmmm - how come scriptfile1.q works then?


CREATE TABLE dest1(key INT, value STRING);

ADD FILE src/test/scripts/testgrep;

FROM (
  FROM src
  SELECT TRANSFORM(src.key, src.value)
         USING 'testgrep' AS (tkey, tvalue) 
  CLUSTER BY tkey 
) tmap
INSERT OVERWRITE TABLE dest1 SELECT tmap.tkey, tmap.tvalue;


> referencing an added file by it's name in a transform script does not work in hive local
mode
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1570
>                 URL: https://issues.apache.org/jira/browse/HIVE-1570
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Joydeep Sen Sarma
>
> Yongqiang tried this and it fails in local mode:
> add file ../data/scripts/dumpdata_script.py;
> select count(distinct subq.key) from
> (FROM src MAP src.key USING 'python dumpdata_script.py' AS key WHERE src.key = 10) subq;
> this needs to be fixed because it means we cannot choose local mode automatically in
case of transform scripts (since different paths need to be used for cluster vs. local mode
execution)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message