hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zsolt Tóth <toth.zsolt....@gmail.com>
Subject Fwd: Can't access file in Distributed Cache in Hive 1.1.0
Date Tue, 05 May 2015 14:12:19 GMT
Hi,

I've just upgraded to Hive 1.1.0 and it looks like there is a problem with
the distributed cache.
I use ADD FILE, then an UDF that wants to read the file. The following
syntax works in Hive 1.0.0 but Hive can't find the file in 1.1.0 (testfile
exists on hdfs, the built-in udf in_file is just an example):

add file hdfs:///tmp/testfile;
select in_file('a', './testfile') from a;

However, it works with the local path:

select in_file('a',
'/tmp/462e6854-10f3-4a68-a290-615e6e9d60ff_resources/testfile') from a;

When I try to list the files in the directory "./" in Hive 1.1.0, it lists
the cluster's root directory. It looks like the working directory changed
in Hive 1.1.0. Is this intended? If so, how can I access the files in the
distributed cache added with ADD FILE?

Regards,
Zsolt

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message