hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class
Date Tue, 29 Nov 2016 11:44:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15705056#comment-15705056
] 

Steve Loughran commented on HADOOP-13811:
-----------------------------------------

you are getting an exception on line 248 of S3a, where it's calling {{partSize = conf.getLong(MULTIPART_SIZE,
DEFAULT_MULTIPART_SIZE)}}.

Now, that line only exists on branch-2.7.x; it's not on the branch-2 line, where we use getLongBytes()
to support byte unit measurement s (M, K, P, T, G). Which means that somehow you are getting
to 2.7 binaries in your jobs.

You could make that error move off that line by changing the option {{fs.s3a.multipart.size}}
to {{104857600}}. But you've still got that mix of binaries there, and that means your problem
isn't going to go away.

> s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize
XML document destined for handler class
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-13811
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13811
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 2.8.0, 2.7.3
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>
> Sometimes, occasionally, getFileStatus() fails with a stack trace starting with {{com.amazonaws.AmazonClientException:
Failed to sanitize XML document destined for handler class}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message