hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15310) s3a: option to disable s3a://landsat-pds/ tests
Date Wed, 14 Mar 2018 10:29:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398370#comment-16398370

Steve Loughran commented on HADOOP-15310:

no worries. FWIW, I'd recommend copying a snapshot of that file to your store and referencing
it in the config option...its used to test read IO perf & identify issues. 

> s3a: option to disable s3a://landsat-pds/ tests
> -----------------------------------------------
>                 Key: HADOOP-15310
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15310
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Vasu Kulkarni
>            Priority: Major
> when testing with s3 like servers in our own lab, It is worth having an option where
we can disable the landsat-pds test, the default behavior is it fails if the bucket is not
available, a better option can be provide to disable this test when testing with local s3a
servers that dont have the public bucket.
> <property>
>   <name>fs.s3a.scale.test.csvfile</name>
>   <value>s3a://landsat-pds/scene_list.gz</value>
> </property>

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message