pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vivek Padmanabhan" <pvi...@yahoo-inc.com>
Subject Review Request: Provide configuration to disable persistence of _logs for streaming commands
Date Mon, 19 Dec 2011 09:48:34 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3256/
-----------------------------------------------------------

Review request for pig.


Summary
-------

For Pig scripts which has streaming commands , the stderr is saved into hdfs under _logs folder
in the output directory.
This behavior was not seen with Pig 0.8 by default, but from 0.9 onwards, we are seeing _logs
folder.
Hence it would be nice to have a configuration to disable this feature.


Sample script
DEFINE mycmd `t.pl` ship ('t.pl');
a = load 'i1' as (f1:chararray,f2:chararray);
b = stream a through mycmd;
store b into 'output';


This addresses bug PIG-2363.
    https://issues.apache.org/jira/browse/PIG-2363


Diffs
-----


Diff: https://reviews.apache.org/r/3256/diff


Testing
-------


Thanks,

Vivek


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message