hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Prakash <ravi...@ymail.com>
Subject Re: yarn jobhistory server not displaying all jobs
Date Mon, 26 Jan 2015 19:22:34 GMT
Hi Matt!

Take a look at the mapreduce.jobhistory.* configuration parameters here for the delay in moving
finished jobs to the HistoryServer:https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml

I've seen this error "hadoop is not allowed to impersonate hadoop" when I tried configuring
hadoop proxy users
 

     On Friday, January 23, 2015 10:43 AM, Matt K <matvey1414@gmail.com> wrote:
   

 Hello,
I am an issue with Yarn's JobHistory Server, which is making it painful to debug jobs. The
latest jobs (from the last 12 hours or so) are missing from the JobHistory Server, but present
in ResourceManager Yarn UI. I am seeing 8 jobs only in the JobHistory, and 15 in Yarn UI.
Not much useful stuff in the logs. Every few hours, this exception pops up in mapred-hadoop-historyserver.log,
but I don't know if it's related.
2015-01-23 03:41:40,003 WARN org.apache.hadoop.mapreduce.v2.hs.KilledHistoryService: Could
not process job filesorg.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException):
User: hadoop is not allowed to impersonate hadoop        at org.apache.hadoop.ipc.Client.call(Client.java:1409) 
      at org.apache.hadoop.ipc.Client.call(Client.java:1362)        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) 
      at com.sun.proxy.$Proxy9.getBlockLocations(Unknown Source)        at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown
Source)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
      at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186) 
      at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) 
      at com.sun.proxy.$Proxy9.getBlockLocations(Unknown Source)        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getBlockLocations(ClientNamenodeProtocolTranslatorPB.java:219) 
      at org.apache.hadoop.hdfs.DFSClient.callGetBlockLocations(DFSClient.java:1137) 
      at org.apache.hadoop.hdfs.DFSClient.getLocatedBlocks(DFSClient.java:1127)     
  at org.apache.hadoop.hdfs.DFSClient.getLocatedBlocks(DFSClient.java:1117)        at
org.apache.hadoop.hdfs.DFSInputStream.fetchLocatedBlocksAndGetLastBlockLength(DFSInputStream.java:264) 
      at org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:231)     
  at org.apache.hadoop.hdfs.DFSInputStream.<init>(DFSInputStream.java:224)     
  at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1290)        at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:300) 
      at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:296) 
      at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) 
      at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:296) 
      at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764)        at org.apache.hadoop.mapreduce.v2.hs.KilledHistoryService$FlagFileHandler.buildJobIndexInfo(KilledHistoryService.java:196) 
      at org.apache.hadoop.mapreduce.v2.hs.KilledHistoryService$FlagFileHandler.access$100(KilledHistoryService.java:85) 
      at org.apache.hadoop.mapreduce.v2.hs.KilledHistoryService$FlagFileHandler$1.run(KilledHistoryService.java:128) 
      at org.apache.hadoop.mapreduce.v2.hs.KilledHistoryService$FlagFileHandler$1.run(KilledHistoryService.java:125) 
      at java.security.AccessController.doPrivileged(Native Method)        at javax.security.auth.Subject.doAs(Subject.java:415) 
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) 
      at org.apache.hadoop.mapreduce.v2.hs.KilledHistoryService$FlagFileHandler.run(KilledHistoryService.java:125) 
      at java.util.TimerThread.mainLoop(Timer.java:555)        at java.util.TimerThread.run(Timer.java:505)
Has anyone ran into this before?
Thanks,-Matt

   
Mime
View raw message