crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Ortiz <dpo5...@gmail.com>
Subject Re: Delete output folder automatically in CRUNCH (FlumeJava)
Date Thu, 19 Feb 2015 04:48:16 GMT
Exactly.  That's the object I mean is the hdfs Filesystem.  I believe that
would work for both mr and spark implementations.

On Wed, Feb 18, 2015, 11:44 PM unmesha sreeveni <unmeshabiju@gmail.com>
wrote:

> Is filesystem object similar to mapreduce?
>
> *Configuration conf = new Configuration();*
> *FileSystem fs = FileSystem.get(conf);*
> *if (fs.exists(new Path(args[1]))) {*
> * fs.delete(new Path(args[1]), true);*
> *}*
>
> ** *Is there any good tutorial on Flume Java other than
> https://crunch.apache.org/user-guide.html?
>
> On Thu, Feb 19, 2015 at 10:04 AM, David Ortiz <dortiz@videologygroup.com>
> wrote:
>
>>  You would want to create a Filesystem object in your tool and use it to
>> delete the output directory.
>>
>>
>>  Sent from my T-Mobile 4G LTE Device
>>
>>
>> -------- Original message --------
>> From: unmesha sreeveni
>> Date:02/18/2015 11:21 PM (GMT-05:00)
>> To: user@crunch.apache.org
>> Subject: Fwd: Delete output folder automatically in CRUNCH (FlumeJava)
>>
>>
>>   Hi
>> I am new to FlumeJava.I ran wordcount in the same.But how can I
>> automatically delete the outputfolder in the code block. Instead of going
>> back and deleting the folder.
>> Thanks in advance.
>>  --
>>    *Thanks & Regards *
>>
>>
>> *Unmesha Sreeveni U.B *
>> *Hadoop, Bigdata Developer*
>> *Centre for Cyber Security | Amrita Vishwa Vidyapeetham*
>>  http://www.unmeshasreeveni.blogspot.in/
>>
>>
>>    *This email is intended only for the use of the individual(s) to whom
>> it is addressed. If you have received this communication in error, please
>> immediately notify the sender and delete the original email.*
>>
>
>
>
> --
> *Thanks & Regards *
>
>
> *Unmesha Sreeveni U.B*
> *Hadoop, Bigdata Developer*
> *Centre for Cyber Security | Amrita Vishwa Vidyapeetham*
> http://www.unmeshasreeveni.blogspot.in/
>
>
>

Mime
View raw message