hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject Fwd: FileUtil.fullyDelete does ?
Date Tue, 26 Jul 2016 11:09:15 GMT
Resending to right list
---------- Forwarded message ----------
From: "Divya Gehlot" <divya.htconex@gmail.com>
Date: Jul 26, 2016 6:51 PM
Subject: FileUtil.fullyDelete does ?
To: "user @spark" <user@spark.apache.org>
Cc:

Hi,
When I am doing the using theFileUtil.copymerge function

val file = "/tmp/primaryTypes.csv"

FileUtil.fullyDelete(new File(file))

 val destinationFile= "/tmp/singlePrimaryTypes.csv"

FileUtil.fullyDelete(new File(destinationFile))

 val counts = partitions.

reduceByKey {case (x,y) => x + y}.

sortBy {case (key, value) => -value}.

map { case (key, value) => Array(key, value).mkString(",") }

 counts.saveAsTextFile(file)

 merge(file, destinationFile)


I am wondering here what does  FileUtil.fullyDelete(new
File(destinationFile)) do ?

  does it delete the merged file ....If yes,then how will we access
the merged file ..?


Confused here ...



Thanks,

Divya

Mime
View raw message