falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaik Idris Ali (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-241) The job logs are not copied during Post-Processing step in Replication workflows
Date Thu, 02 Jan 2014 10:53:50 GMT

    [ https://issues.apache.org/jira/browse/FALCON-241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860125#comment-13860125
] 

Shaik Idris Ali commented on FALCON-241:
----------------------------------------

Yeah, I verified I think this is because of new start and end nodes as you pointed out.

So the fix should be generic or we should be able to specify the oozie version to work with.

> The job logs are not copied during Post-Processing step in Replication workflows
> --------------------------------------------------------------------------------
>
>                 Key: FALCON-241
>                 URL: https://issues.apache.org/jira/browse/FALCON-241
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Suhas Vasu
>            Assignee: Suhas Vasu
>
> The post processing step in Replication workflows is failing with Exception:
> 2013-12-30 11:23:08,889 ERROR - Exception in log mover: (LogMover:117)
> java.lang.IllegalArgumentException: JobId string : - is not properly formed
> 	at org.apache.hadoop.mapreduce.JobID.forName(JobID.java:149)
> 	at org.apache.hadoop.mapred.JobID.forName(JobID.java:78)
> 	at org.apache.falcon.logging.LogMover.getTTlogURL(LogMover.java:203)
> 	at org.apache.falcon.logging.LogMover.copyTTlogs(LogMover.java:137)
> 	at org.apache.falcon.logging.LogMover.run(LogMover.java:98)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> 	at org.apache.falcon.logging.LogMover.main(LogMover.java:72)
> 	at org.apache.falcon.workflow.FalconPostProcessing.invokeLogProducer(FalconPostProcessing.java:172)
> 	at org.apache.falcon.workflow.FalconPostProcessing.run(FalconPostProcessing.java:101)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.falcon.workflow.FalconPostProcessing.main(FalconPostProcessing.java:88)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:491)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:260)
> The job id is not retrieved the right way which is causing this exception, as a result
of which the job logs are not copied for Replication workflows



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message