hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-453) external table metastore and execution codepaths use default FileSystem object instead of using one derived from the supplied path
Date Tue, 28 Apr 2009 18:16:30 GMT

     [ https://issues.apache.org/jira/browse/HIVE-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Joydeep Sen Sarma updated HIVE-453:
-----------------------------------

    Summary: external table metastore and execution codepaths use default FileSystem object
instead of using one derived from the supplied path  (was: external table creation uses default
FileSystem object instead of using one derived from the supplied path)

generalizing - there seems to be issues in execution time code path as well. after patching
metastore issues:

hive> create external table kvu(key int, val string) location 's3n://data.s3ndemo.hive/kv1.txt';
create external table kvu(key int, val string) location 's3n://data.s3ndemo.hive/kv1.txt';
OK
Time taken: 13.49 seconds
hive> select * from kvu;
select * from kvu;
OK
Failed with exception Wrong FS: s3n://data.s3ndemo.hive/kv1.txt, expected: file:///

java.lang.IllegalArgumentException: Wrong FS: s3n://data.s3ndemo.hive/kv1.txt, e
xpected: file:///
        at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
        at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem
.java:52)
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSys
tem.java:416)
        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.
java:244)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:651)
        at org.apache.hadoop.hive.ql.exec.FetchTask.getNextPath(FetchTask.java:1
79)
        at org.apache.hadoop.hive.ql.exec.FetchTask.getRecordReader(FetchTask.ja
va:223)
        at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:287)
        at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:322)


> external table metastore and execution codepaths use default FileSystem object instead
of using one derived from the supplied path
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-453
>                 URL: https://issues.apache.org/jira/browse/HIVE-453
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Joydeep Sen Sarma
>            Priority: Critical
>
> with fs.default.name set to file:///:
> hive> create external table kvu(key int, val string) location 's3n://data.s3ndemo.hive/kv1.txt'
> FAILED: Error in metadata: java.lang.IllegalArgumentException: Wrong FS: s3n://data.s3ndemo.hive/kv1.txt,
expected: file:///
> stack trace:
>         at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
>         at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem
> .java:52)
>         at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
> a:308)
>         at org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.jav
> a:462)
>         at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:90)
>         at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_tabl
> e(HiveMetaStore.java:293)
>         at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(Hive
> MetaStoreClient.java:252)
>         at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:256)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message