hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bennie Schut (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1019) java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
Date Fri, 01 Apr 2011 15:01:06 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014640#comment-13014640
] 

Bennie Schut commented on HIVE-1019:
------------------------------------

Just found at least one way to cause/reproduce this:

CREATE TABLE test_1 (
  test_field     STRING
, network        STRING
, version_type   STRING
, country        STRING
, test_ID        BIGINT
) PARTITIONED BY (appendkey_id INT) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe'
STORED AS RCFILE;

CREATE TABLE test_2 (
  test_field        STRING
, test_ID            BIGINT
) PARTITIONED BY (appendkey_id INT) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe'
STORED AS RCFILE;

CREATE TABLE test_month (
  network           STRING
, version_type      STRING
, country           STRING
, total             INT
) PARTITIONED BY (month STRING, appendkey_id INT)
  ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe' STORED AS RCFILE;


from ( select network, version_type, country
from test_1 t1 join test_2 t2 on (t1.test_ID=t2.test_ID)) subq1  
 
insert overwrite table test_month partition(month='2004-07', appendkey_id=0) select network,
 version_type,  country , count(*) total
group by network, version_type, country 

insert overwrite table test_month partition(month='2004-07', appendkey_id=1) select network,
 version_type,  country , count(*) total
group by network, version_type, country 


On our server it completely kills the hive service.

> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> --------------------------------------------------------------------
>
>                 Key: HIVE-1019
>                 URL: https://issues.apache.org/jira/browse/HIVE-1019
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.6.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>         Attachments: HIVE-1019-1.patch, HIVE-1019-2.patch, HIVE-1019-3.patch, HIVE-1019-4.patch,
HIVE-1019-5.patch, HIVE-1019-6.patch, HIVE-1019-7.patch, HIVE-1019-8.patch, HIVE-1019.patch,
stacktrace2.txt
>
>
> I keep getting errors like this:
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> and :
> java.io.IOException: cannot find dir = hdfs://victoria.ebuddy.com:9000/tmp/hive-dwh/801467596/10002
in partToPartitionInfo!
> when running multiple threads with roughly similar queries.
> I have a patch for this which works for me.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message