hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Created] (HIVE-15142) CompactorMR fails with FileNotFoundException
Date Mon, 07 Nov 2016 20:40:58 GMT
Eugene Koifman created HIVE-15142:

             Summary: CompactorMR fails with FileNotFoundException
                 Key: HIVE-15142
             Project: Hive
          Issue Type: Bug
          Components: Transactions
    Affects Versions: 1.0.0
            Reporter: Eugene Koifman
            Priority: Critical

No of maps and reduces are 0 job_1478131263487_0009
Job commit failed: File hdfs://....../_tmp_80e50691-c9fe-485a-8e1e-ba20331c7d97
does not exist.
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(
at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(
at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(
at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(
at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorOutputCommitter.commitJob(
at org.apache.hadoop.mapred.OutputCommitter.commitJob(
at java.util.concurrent.ThreadPoolExecutor.runWorker(
at java.util.concurrent.ThreadPoolExecutor$

when Compactor doesn't have permissions to write to the table dir.

Evidently we loose the exception when creating CompactorMR.TMP_LOCATION and only see that
the file is not there on commit of the job

This message was sent by Atlassian JIRA

View raw message