hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Murillo Flores <muri...@chaordic.com.br>
Subject Input file with length zero crash
Date Sat, 26 Apr 2014 15:03:13 GMT
Hello everyone,

I'm trying to run a MR job in hadoop 2.2.0 with the input files coming from
s3. One of these input files is an empty file (zero byte length) and
because of that my job fail at the map phase, because it tries to read a
range of this input file that does not exists. The exception I see in logs
is something like this:

s3native.NativeS3FileSystem: Opening 's3n://bucket/folder/_FINISHED' for
s3native.NativeS3FileSystem: Opening key 'folder/_FINISHED' for reading at
position '0'
pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' -
Unexpected response code 416, expected 206
pl.rest.httpclient.RestS3Service: Response '/folder%2F_FINISHED' - Received
error response with XML message
<?xml version="1.0" encoding="UTF-8"?>
<Message>The requested range is not satisfiable</Message>

Does anyone knows how to fix this?

Thanks a lot.


*www.chaordic.com.br <http://www.chaordic.com.br/>*
55 48 3232.3200

View raw message