hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject read multiple files
Date Tue, 27 Sep 2016 07:52:12 GMT
Hi,
The input data files for my spark job generated at every five minutes file
name follows epoch time convention  as below :

InputFolder/batch-1474959600000
InputFolder/batch-1474959900000
InputFolder/batch-1474960200000
InputFolder/batch-1474960500000
InputFolder/batch-1474960800000
InputFolder/batch-1474961100000
InputFolder/batch-1474961400000
InputFolder/batch-1474961700000
InputFolder/batch-1474962000000
InputFolder/batch-1474962300000

As per requirement I need to read one month of data from current timestamp.

Would really appreciate if anybody could help me .

Thanks,
Divya

Mime
View raw message