hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Zhang <zjf...@gmail.com>
Subject Re: hive -e run tez query error
Date Mon, 29 Jun 2015 05:23:12 GMT
> But keeping that client cache disabled when running against trunk generally
kills queries all the time with occasional errors like these.

I think tez staging directory is supposed to be deleted when JVM exit
(deleteOnExit), why killing query will cause the path deleted ?



On Sat, Jun 27, 2015 at 11:48 AM, Gopal Vijayaraghavan <gopalv@apache.org>
wrote:

>
> > perhaps deleteOnExit() is set somewhere
>
> fs.cache.disable settings from hdfs-site.xml are usually to blame for that.
>
> Till hive-1.0, HiveServer2 used to leak filesystem objects, so the cache
> was disabled.
>
> > 2015-06-25 15:54:33,673 INFO FSNamesystem.audit: allowed=true
> >ugi=lujian (auth:SIMPLE)    ip=/10.17.28.11 <http://10.17.28.11/>
> >cmd=delete
> >src=/user/lujian/lujian/_tez_session_dir/abb91da9-ac07-4024-a09f-8622ee1ca
> >edf   dst=null    perm=null
>
>
> But keeping that client cache disabled when running against trunk
> generally kills queries all the time with occasional errors like these.
>
> Cheers,
> Gopal
>
>
>


-- 
Best Regards

Jeff Zhang

Mime
View raw message