hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-14918) remove the Local Dynamo DB test option
Date Sun, 01 Oct 2017 19:04:00 GMT
Steve Loughran created HADOOP-14918:
---------------------------------------

             Summary: remove the Local Dynamo DB test option
                 Key: HADOOP-14918
                 URL: https://issues.apache.org/jira/browse/HADOOP-14918
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 3.0.0
            Reporter: Steve Loughran


I'm going to propose cutting out the localdynamo test option for s3guard

* the local DDB JAR is unmaintained/lags the SDK We work with...eventually there'll be differences
in API.
* as the local dynamo DB is unshaded. it complicates classpath setup for the build. Remove
it and there's no need to worry about versions of anything other than the shaded AWS
* it complicates test runs. Now we need to test for both localdynamo *and* real dynamo
* but we can't ignore real dynamo, because that's the one which matters

While the local option promises to reduce test costs, really, it's just adding complexity.
If you are testing with s3guard, you need to have a real table to test against., And with
the exception of those people testing s3a against non-AWS, consistent endpoints, everyone
should be testing with S3Guard.

Straightforward to remove.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message