crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shawn Smith (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CRUNCH-53) AvroFileReaderFactory does not close input files
Date Tue, 28 Aug 2012 20:05:07 GMT
Shawn Smith created CRUNCH-53:
---------------------------------

             Summary: AvroFileReaderFactory does not close input files
                 Key: CRUNCH-53
                 URL: https://issues.apache.org/jira/browse/CRUNCH-53
             Project: Crunch
          Issue Type: Bug
          Components: IO
            Reporter: Shawn Smith
            Priority: Minor


The AvroFileReaderFactory read() method does not close its DataFileReader.  With the Hadoop
NativeS3FileSystem this can lead to the following warning:

    org.jets3t.service.impl.rest.httpclient.HttpMethodReleaseInputStream: Successfully released
HttpMethod in finalize(). You were lucky this time... Please ensure S3 response data streams
are always fully consumed or closed.
    WARN  [2012-08-28 19:26:16,035] org.jets3t.service.impl.rest.httpclient.HttpMethodReleaseInputStream:
Attempting to release HttpMethod in finalize() as its response data stream has gone out of
scope. This attempt will not always succeed and cannot be relied upon! Please ensure S3 response
data streams are always fully consumed or closed to avoid HTTP connection starvation.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message