hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1424) Error logs of streaming should not be placed in output location
Date Thu, 01 Jul 2010 17:55:51 GMT

    [ https://issues.apache.org/jira/browse/PIG-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884365#action_12884365
] 

Ashutosh Chauhan commented on PIG-1424:
---------------------------------------

This turns out to be much more involved then I initially thought. Assumption that output/input
location is a file based path exists at more then one place in Pig. In particular, Streaming
kind of make this explicit assumption and has it in the semantics. We need to be careful about
streaming semantics before we fix this. More at: http://wiki.apache.org/pig/PigStreamingFunctionalSpec

> Error logs of streaming should not be placed in output location
> ---------------------------------------------------------------
>
>                 Key: PIG-1424
>                 URL: https://issues.apache.org/jira/browse/PIG-1424
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Ashutosh Chauhan
>             Fix For: 0.8.0
>
>
> This becomes a problem when output location is anything other then a filesystem. Output
will be written to DB but where the logs generated by streaming should go? Clearly, they cant
be written into DB. This blocks PIG-1229 which introduces writing to DB from Pig.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message