hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1424) Error logs of streaming should not be placed in output location
Date Thu, 20 May 2010 17:31:16 GMT

    [ https://issues.apache.org/jira/browse/PIG-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869688#action_12869688
] 

Ashutosh Chauhan commented on PIG-1424:
---------------------------------------

Since all the logs generated by Pig in backend end up in log directory of task tracker, logs
generated by streaming binary should also go there and not into the output location.
The place where this setting of location happens is in JobControlCompiler.java, line 460:
{code}
                conf.set("pig.streaming.log.dir", 
                            new Path(outputPath, LOG_DIR).toString());
{code} 

> Error logs of streaming should not be placed in output location
> ---------------------------------------------------------------
>
>                 Key: PIG-1424
>                 URL: https://issues.apache.org/jira/browse/PIG-1424
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Ashutosh Chauhan
>             Fix For: 0.8.0
>
>
> This becomes a problem when output location is anything other then a filesystem. Output
will be written to DB but where the logs generated by streaming should go? Clearly, they cant
be written into DB. This blocks PIG-1229 which introduces writing to DB from Pig.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message