nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (Jira)" <>
Subject [jira] [Commented] (NIFI-7591) Allow PutS3Object to post to AWS Snowball
Date Fri, 10 Jul 2020 16:26:00 GMT


ASF subversion and git services commented on NIFI-7591:

Commit ae877b9908aa1357c71e2e3d039829d6b7658fd4 in nifi's branch refs/heads/main from Peter
[;h=ae877b9 ]

NIFI-7591: Allow PutS3Object to post to AWS Snowball

Added properties to enable/disable chunked encoding and path-style access
for endpoints that do not support chunked encoding / only support path-style access.

Signed-off-by: Pierre Villard <>

This closes #4386.

> Allow PutS3Object to post to AWS Snowball
> -----------------------------------------
>                 Key: NIFI-7591
>                 URL:
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Juan C. Sequeiros
>            Assignee: Peter Turcsanyi
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
> When posting using PutS3Object to AWS SNOWBALL [1]it fails with "
> In short it supports the AWS s3 API in a limited function [2]
> [1][]
> [2][]
> {code:java}
> Chunk encoding is not supported yet (Service: Amazon S3; Status Code: 501; Error Code:
NotImplemented; Request ID: null; S3 Extended Request ID: null)         at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(
        at com.amazonaws.http.AmazonHttpClient.execute(    
        at org.apache.nifi.processor.AbstractProcessor.onTrigger(
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(
        at org.apache.nifi.controller.tasks.ConnectableTask.invoke(
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$
        at org.apache.nifi.engine.FlowEngine$         at
java.util.concurrent.Executors$         at java.util.concurrent.FutureTask.runAndReset(
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(
        at java.util.concurrent.ScheduledThreadPoolExecutor$
        at java.util.concurrent.ThreadPoolExecutor.runWorker(
        at java.util.concurrent.ThreadPoolExecutor$
        at {code}
> {code}
> AWS docs state this: [2]
> "If your solution uses the AWS SDK for Java version 1.11.0 or newer, you must use the
following S3ClientOptions" 
> {code:java}
> disableChunkedEncoding() – Indicates that chunked encoding is not supported with the
> setPathStyleAccess(true) – Configures the adapter to use path-style access for all
> [1]
> [2]{code}

This message was sent by Atlassian Jira

View raw message