nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tony Kurc (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (NIFI-937) PutS3 Processor cannot upload files larger than 5 GB
Date Tue, 10 Nov 2015 20:52:11 GMT

     [ https://issues.apache.org/jira/browse/NIFI-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tony Kurc updated NIFI-937:
---------------------------
    Labels: beginner  (was: )

> PutS3 Processor cannot upload files larger than 5 GB
> ----------------------------------------------------
>
>                 Key: NIFI-937
>                 URL: https://issues.apache.org/jira/browse/NIFI-937
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 0.3.0
>            Reporter: John Titus
>            Priority: Minor
>              Labels: beginner
>
> Tried to use the PutS3 processor to upload a large file. Got the error shown below.
> S3 doesn't allow  you to upload > 5GB unless you use multi-part upload. It'd be nice
if the processor handled this transparently, as the aws cli does.
> 2015-09-08 14:20:38,991 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.aws.s3.PutS3Object
>  PutS3Object[id=14280a26-a34a-47f6-aa7e-df404c960634] Failed to put StandardFlowFileRecord[uuid=ba7e
> 8332-4140-44f4-a71d-e5529f0ab6ad,claim=1441721637937-1157587,offset=0,name=redacted,size
> =5672981796] to Amazon S3 due to com.amazonaws.services.s3.model.AmazonS3Exception: Your
proposed up
> load exceeds the maximum allowed size (Service: Amazon S3; Status Code: 400; Error Code:
EntityTooLa
> rge; Request ID: 56B1AE1E6D8068C0), S3 Extended Request ID: lQImEwX+c7TUC3+Qr97kFult/95qinlRTFM/CF6v
> Z4b9DQwbwCn6auAc8epWlfHmHaU3AZCEvDc=: com.amazonaws.services.s3.model.AmazonS3Exception:
Your propos
> ed upload exceeds the maximum allowed size (Service: Amazon S3; Status Code: 400; Error
Code: Entity
> TooLarge; Request ID: 56B1AE1E6D8068C0), S3 Extended Request ID: lQImEwX+c7TUC3+Qr97kFult/95qinlRTFM
> /CF6vZ4b9DQwbwCn6auAc8epWlfHmHaU3AZCEvDc=



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message