hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1019) java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
Date Mon, 22 Mar 2010 20:39:27 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ning Zhang updated HIVE-1019:
-----------------------------

    Attachment: HIVE-1019-8.patch

The changes look fine in general. However, I found a new issue related to this JIRA. I'm uploading
a new patch HIVE-1019-8.patch to include the fix as well.

Basically the issue is that when we set hive.exec.parallel=true and two parallel jobs are
reading the PLAN for the same file. This is an existing issue and it exists when applying
to your patch. The reason is that the session ID (which now used as the Plan file suffix)
is not changed for different session. We need to generate a new session ID for each started
session in the parallel execution case. A unit test is also added to reproduce the issue in
the current trunk.

Bennie, is it possible to add a new unit test for the case you are solving?



> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> --------------------------------------------------------------------
>
>                 Key: HIVE-1019
>                 URL: https://issues.apache.org/jira/browse/HIVE-1019
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.6.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1019-1.patch, HIVE-1019-2.patch, HIVE-1019-3.patch, HIVE-1019-4.patch,
HIVE-1019-5.patch, HIVE-1019-6.patch, HIVE-1019-7.patch, HIVE-1019-8.patch, HIVE-1019.patch,
stacktrace2.txt
>
>
> I keep getting errors like this:
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> and :
> java.io.IOException: cannot find dir = hdfs://victoria.ebuddy.com:9000/tmp/hive-dwh/801467596/10002
in partToPartitionInfo!
> when running multiple threads with roughly similar queries.
> I have a patch for this which works for me.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message