incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Friedrich (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-21) Make temporary directory configurable
Date Sat, 21 Jul 2012 09:07:33 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Friedrich updated CRUNCH-21:
-------------------------------------

    Attachment: 0001-CRUNCH-21-Make-temporary-dir-configurable.patch

Hadoop has a property "hadoop.tmp.dir" so I suggest going with "crunch.tmp.dir" instead of
Pig's "pig.temp.dir".
                
> Make temporary directory configurable
> -------------------------------------
>
>                 Key: CRUNCH-21
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-21
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.3.0
>            Reporter: Matthias Friedrich
>            Assignee: Matthias Friedrich
>            Priority: Minor
>             Fix For: 0.3.0
>
>         Attachments: 0001-CRUNCH-21-Make-temporary-dir-configurable.patch
>
>
> In pig it's possible to set the temporary directory using the pig.temp.dir property.
Being able to redirect temporary output is useful in production systems to automatically clean
up after aborted runs (or stuff accidentally left behind). We should have this in Crunch,
too.
> This is also a prerequisite for cleaning up the integration test suite. Right now it
leaves 80 files behind on /tmp making it unsuitable for continuous integration in a shared
environment.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message