hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abdelrahman Shettia <ashet...@hortonworks.com>
Subject Re: What is pfile in pom.xml
Date Mon, 11 Nov 2013 22:52:45 GMT
Hi Jie, 

Seems that there is an error related to:

No FileSystem for scheme: pfile

 Have you tried to replace the line? 

<test.warehouse.scheme>pfile://</test.warehouse.scheme> 

With: 
/test

So that it would work in this format:

CREATE TABLE rename_partition_table (key STRING, value STRING) PARTITIONED BY (part STRING)
STORED AS RCFILE
LOCATION 'pfile:${system:test.tmp.dir}/rename_partition_table';

Basically it is the following conf:

<property>
  <name>hive.exim.uri.scheme.whitelist</name>
  <value>hdfs,pfile</value>
  <description>A comma separated list of acceptable URI schemes for import and export.</description>
</property>


Thanks
-Abdelrahman


On Nov 10, 2013, at 6:06 AM, 金杰 <hellojinjie@gmail.com> wrote:

> When I run mvn test on my Ubuntu box, I got the following error message.
> I also run mvn test on CentOS, there is no error about pfile.
> This error message only happen on my ubuntu box.
> So, how to fix this?
> 
> org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat  Time elapsed: 11.811 sec  <<<
ERROR!
> java.lang.Exception: MetaException(message:Got exception: java.io.IOException No FileSystem
for scheme: pfile)
>     at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:22138)
>     at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:22106)
>     at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:22032)
>     at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
>     at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:797)
>     at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:783)
>     at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:487)
>     at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:476)
>     at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.createTable(TestHCatMultiOutputFormat.java:256)
>     at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.initalizeTables(TestHCatMultiOutputFormat.java:234)
>     at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.initializeSetup(TestHCatMultiOutputFormat.java:215)
>     at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.setup(TestHCatMultiOutputFormat.java:192)
> 
> org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat  Time elapsed: 11.811 sec  <<<
ERROR!
> java.io.IOException: No FileSystem for scheme: pfile
>     at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1443)
>     at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
>     at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)
>     at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)
>     at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
>     at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.tearDown(TestHCatMultiOutputFormat.java:265)
> 
> 
> 
> Best Regards
> 金杰 (Jie Jin)
> 
> 
> On Sun, Nov 10, 2013 at 7:08 PM, 金杰 <hellojinjie@gmail.com> wrote:
> Hi, All
> 
> I found a line in pom.xml
> 
> <test.warehouse.scheme>pfile://</test.warehouse.scheme>
> 
> You can check it on https://github.com/apache/hive/blob/trunk/pom.xml#L61
> ​What is pfile? Is pfile a file system schema, same as hdfs:// ?​
> 
> Best Regards
> 金杰 (Jie Jin)
> 


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
View raw message