hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13334) AmazonClient 30x exceptions to include redirect URL in message
Date Thu, 30 Jun 2016 17:57:10 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357561#comment-15357561
] 

Steve Loughran commented on HADOOP-13334:
-----------------------------------------

{code}
  org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on s3a://landsat-pds/scene_list.gz:
com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service: Amazon S3;
Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88), S3 Extended
Request ID: ZrrcD+fiQ/H3B945SNuLm69beK1rfa/CcL0Zwg6QN+837odqsH067OM2ctBZ8qRlaUqnQ3brl7U=:
Moved Permanently (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently;
Request ID: 68FA0CDF257E8E88)
  at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:127)
  at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:69)
  at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1459)
  at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:113)
  at org.apache.hadoop.fs.Globber.getFileStatus(Globber.java:64)
  at org.apache.hadoop.fs.Globber.doGlob(Globber.java:269)
  at org.apache.hadoop.fs.Globber.glob(Globber.java:148)
  at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1697)
  at org.apache.hadoop.fs.s3a.S3AFileSystem.globStatus(S3AFileSystem.java:1912)
  at org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:266)
  ...
  Cause: com.amazonaws.services.s3.model.AmazonS3Exception: Moved Permanently (Service: Amazon
S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: 68FA0CDF257E8E88)
  at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:1182)
  at com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:770)
  at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:489)
  at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:310)
  at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3785)
  at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1050)
  at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1027)
  at org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:925)
  at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:1444)
  at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:113)
  ...
{code}

> AmazonClient 30x exceptions to include redirect URL in message
> --------------------------------------------------------------
>
>                 Key: HADOOP-13334
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13334
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Steve Loughran
>            Priority: Minor
>
> It'd be easier to work out what's happening when s3a calls against different endpoints
fail if the 301 exceptions forwarded up included the URL in the header which (presumably)
says where things moved to



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message