accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Newton (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-3871) run integration tests as a map/reduce job
Date Thu, 04 Jun 2015 15:33:38 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572979#comment-14572979
] 

Eric Newton commented on ACCUMULO-3871:
---------------------------------------

I'm running into some trickiness finishing this work.

Several tests have some test dependencies. I've been adding these to my {{-libjars}} list,
but some of these tests have a lot of transitive dependencies (I'm looking at you, Kerberos).

So, the [suggested way|https://maven.apache.org/plugins/maven-jar-plugin/examples/create-test-jar.html]
of fixing this would be to move the test/src/test/java code into it's own project, and move
the classes from test/src/test/java to project/src/main/java.

The fact that these two jars share the org.apache.accumulo.test namespace has already been
an issue, so I had to stop Sealing the test-jar.

So, I would like to move these tests to a new project (it-test? test-it? cluster-test?), and
maybe shade in the dependencies so invoking the map-reduce job is simpler. I've never used
shading before, so I'm not sure if this would be prohibitive.  Of course, the test jar would
not be in the {{accumulo-bin.tar.gz}} file unless we use a specific profile.

Alternatively, there might be some way to use maven to discover the recursive test dependencies
and pull them down at runtime.

Any thoughts?


> run integration tests as a map/reduce job
> -----------------------------------------
>
>                 Key: ACCUMULO-3871
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3871
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: test
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.8.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> When the functional tests were moved to java, we lost the ability to run the tests via
map/reduce.  It would be nice to run the ITs in under 2 hours. and take advantage of an entire
cluster, especially after making large sweeping changes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message