accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2944) Generated configuration files and scripts assume SUN as JVM
Date Wed, 09 Jul 2014 18:13:05 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056552#comment-14056552
] 

ASF GitHub Bot commented on ACCUMULO-2944:
------------------------------------------

GitHub user haydenmarchant reopened a pull request:

    https://github.com/apache/accumulo/pull/9

    ACCUMULO-2944 Fixes harded coded Sun JVM in config and env

    ACCUMULO-2944 add support for multiple java vendors in conf & scripts
    
    Support for multiple java vendors is added by getting the
    bootstrap_config.sh to generate correct configuration depending on 
    specified java vendor. Following details depend on Java vendor
    
    * GC settings
    * Exclude/Include JAXP implementation
    * Default NRG provider
    
     
    A new question is being asked in the bootstrap_config.sh for Java 
    vendor. This is then used to set GC settings, exclude/include JAXP 
    implementation in ACCUMULO_OPTS. Also, default NRG provider is being 
    injected as system property on command line since IBM JVM does not 
    have SUN registered as default provider.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/haydenmarchant/accumulo ACCUMULO-2944

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/accumulo/pull/9.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #9
    
----
commit a20e19fc4f7c7989ba1b50459d9f762063e3e631
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-03-28T00:35:32Z

    ACCUMULO-1487, ACCUMULO-1491 Stop packaging docs for monitor
    
    Moved docs out of monitor and into docs directory. Added docs to assemblies.
    Remove unnecessary goals from release profile. Remove links from docs to
    apidocs. Restricted rpms/debs from being placed in lib/ and docs/ in tarball.

commit e5070d0ad084f218d283b9daa58246184afdb477
Author: Eric C. Newton <eric.newton@gmail.com>
Date:   2014-03-28T16:58:19Z

    ACCUMULO-2455 1s timeout is too tight for testing

commit d2089c898c64ce2ac6588b9052505dc4c49d971f
Author: Bill Havanki <bhavanki@cloudera.com>
Date:   2014-03-13T20:34:55Z

    ACCUMULO-2470 Unit tests for server/base module
    
    This commit adds unit tests to code under the server/base module. It also includes changes
    to o.a.a.server.problems.ProblemReport to enable comprehensive testing.

commit 3354b92af1820ca12c9dbe5dc4d0db7d8d0a640a
Author: Mike Drob <mdrob@cloudera.com>
Date:   2014-03-28T21:24:33Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT

commit 9843911d939bafc2808f3edb30903881cb7fa04d
Author: Mike Drob <mdrob@cloudera.com>
Date:   2014-03-29T04:49:59Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT

commit f4a9626a5a5e2a66c201218b13aeef558b63506c
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-03-31T17:40:35Z

    ACCUMULO-1996 Add some javadocs to SimpleMacIT to define its scope

commit dda2fb06ba6452d5af6bda3809684ec2f3413022
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-03-31T18:11:36Z

    ACCUMULO-2392 Log the MAC directory used by a test
    
    Add a log message to SimpleMacIT to inform which MiniAccumuloCluster instance is
    in use for each SimpleMacIT test, to make it easier to debug a failed test.
    
    Additionally, renamed a trivial helper method to more accurately reflect its
    purpose.

commit fff852fce6d971e7e76c91ae911fbfca2e26426b
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-03-31T18:40:26Z

    ACCUMULO-2470 Clean up warnings introduced by previous commit
    
    (Unused fields and imports)

commit 67c15ffa24d2515e5e39562d2128e96094598492
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-03-31T19:36:49Z

    ACCUMULO-2595 Remove jar for init module

commit 4a77566a314aaa6c2086d8d07d228a073a437777
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-03-31T19:46:08Z

    ACCUMULO-2595 Remove dep. mgmt entry for accumulo-init jar

commit 4956b15a6f86bca303074b907b2e62f783d395bf
Author: Eric C. Newton <eric.newton@gmail.com>
Date:   2014-04-01T15:45:28Z

    ACCUMULO-2601 remove initialization from rpm

commit 7a68838ac5650dbc1bfe64818506875c4dacc099
Author: Eric C. Newton <eric.newton@gmail.com>
Date:   2014-04-01T17:50:07Z

    ACCUMULO-2601 test for the existence of /accumulo in hdfs

commit 7ac4b54a76b85314a483378e01980c73f891a900
Author: Eric C. Newton <eric.newton@gmail.com>
Date:   2014-04-01T18:46:17Z

    ACCUMULO-2605 list slf4j as a test dependency

commit 3a1b38719c69d34abb27e181fce3bfdb7758bf92
Author: Josh Elser <elserj@apache.org>
Date:   2014-03-26T22:04:05Z

    ACCUMULO-2592 Create AccumuloCluster and AccumuloConfig interfaces to allow for proper
non-minicluster implementations.
    
    Includes package-level javadocs in lieu of some specific annotation specifying api "experimental"
status.

commit 86cafd972793330026c6e4739a2a94320608a333
Author: Josh Elser <elserj@apache.org>
Date:   2014-04-01T21:08:00Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT
    
    Conflicts:
    	core/src/main/java/org/apache/accumulo/core/client/mapred/InputFormatBase.java
    	core/src/main/java/org/apache/accumulo/core/client/mapreduce/InputFormatBase.java

commit a1814fc0dbdf0fb095ad87385dfb133c5a1f35df
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-04-01T21:48:12Z

    ACCUMULO-2606 Remove system-level packaging stuff
    
    Removing RPM/DEB build tasks and maven profiles, related documentation,
    and system-specific packaging resources and scripts, in order to defer such
    things to downstream package maintainers.

commit d896bf37d2dcf1834e32425b7364e6d5963e4c12
Author: Sean Busbey <busbey@cloudera.com>
Date:   2014-03-28T21:47:00Z

    ACCUMULO-2590 Updates our Public API declaration to be more explicit.

commit 09388f5671a3979c3c83c5de8f63eb55a3e83fcb
Author: Eric C. Newton <eric.newton@gmail.com>
Date:   2014-04-02T15:02:37Z

    ACCUMULO-2584 use IteratorSettings to push the scan iterator, not a zookeeper setting

commit e2552a89f4436292817e1bf94aa0cfa4f7e88339
Author: Josh Elser <elserj@apache.org>
Date:   2014-04-02T18:42:39Z

    ACCUMULO-2592 Fix incorrect javadoc

commit aaa8afb9fe28d6af3437428dc30490fc079f2836
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-04-02T20:24:11Z

    ACCUMULO-2616 Bump maven plugin/parent POM versions
    
    Change Apache parent POM to version 14. Drop resulting redundant and/or
    unnecessary plugin versions, configuration, and properties.
    
    Update bouncycastle test dependency version and incorporate into the
    dependencyManagement section and fix resulting deprecation warnings.
    
    Drop redundant m2e container in assembly POM. Migrate to non-deprecated
    surefire/failsafe fork settings. Update other plugin versions to latest.

commit 2c1454e73f50a1e5fa2183deb193f58d6a8337a8
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-04-03T15:11:50Z

    ACCUMULO-2620 Make table names more unique and cleanup unused field.
    
    Support parallel tests better with more better uniqueness in table names.

commit b3f6e0f8f6dda80f98c5b031baaec7061cecf0c5
Author: Mike Drob <mdrob@cloudera.com>
Date:   2014-04-04T01:57:01Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT

commit 6960570252751a6a2fcda6da19755462405f6116
Author: Josh Elser <elserj@apache.org>
Date:   2014-04-04T16:32:24Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT

commit d137a4f9e49ca05c4967ac3ed09ba3e3206b2ec6
Author: jpmcnamee <jpm34@terpmail.umd.edu>
Date:   2014-03-06T20:34:14Z

    ACCUMULO-1395 Generate example configuration
    
    Signed-off-by: Christopher Tubbs <ctubbsii@apache.org>

commit 527913a317eaff502cbf16a8cc8aba810bb20b0a
Author: John Vines <vines@apache.org>
Date:   2014-04-04T18:58:21Z

    Revert "ACCUMULO-1395 Generate example configuration"
    
    This reverts commit d137a4f9e49ca05c4967ac3ed09ba3e3206b2ec6.

commit 902446659c2d030d787f2c92138afa305d05248d
Author: Josh Elser <elserj@apache.org>
Date:   2014-04-04T20:33:11Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT
    
    Conflicts:
    	test/src/test/java/org/apache/accumulo/test/ShellServerTest.java

commit c60e3e593809b67b194a4e377e03bdcdb5c8e844
Author: Mike Drob <mdrob@cloudera.com>
Date:   2014-04-04T23:16:20Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT (-sours)

commit 2cb526e5e11a54e6e1932cf37fa715b2cae22533
Author: Christopher Tubbs <ctubbsii@apache.org>
Date:   2014-04-04T23:55:25Z

    ACCUMULO-2455 Remove JVM reuse, causing some test failures
    
      Forked JVMs are reused, but a JVM can be left in a bad state, causing
      a cascade of other test failures. This reuse can speed up the tests,
      but I'm disabling it, until we can figure out which tests leave the
      JVM in a bad (non-reusable) state and whether we can actually avoid
      that or not, such that it'd be safe to turn JVM reuse back on.

commit 957c9d1b34afb8a5b7347921ba2d5b0b22bbc828
Author: Sean Busbey <busbey@cloudera.com>
Date:   2014-04-05T00:27:39Z

    Merge branch '1.5.2-SNAPSHOT' into 1.6.0-SNAPSHOT
    
      Conflicts:
          fate/src/main/java/org/apache/accumulo/fate/AdminUtil.java
          fate/src/main/java/org/apache/accumulo/fate/TStore.java
          server/base/src/main/java/org/apache/accumulo/server/Accumulo.java
          server/src/main/java/org/apache/accumulo/server/master/Master.java
          server/src/main/java/org/apache/accumulo/server/util/MetadataTable.java
          server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java

commit e4aa11e1b1a046dec9116273eb57f053aa68fd3f
Author: Sean Busbey <busbey@cloudera.com>
Date:   2014-04-04T08:35:01Z

    ACCUMULO-2519 Updates Classes added in 1.6.0 for read only fate changes.

----


> Generated configuration files and scripts assume SUN as JVM
> -----------------------------------------------------------
>
>                 Key: ACCUMULO-2944
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2944
>             Project: Accumulo
>          Issue Type: Sub-task
>          Components: build
>    Affects Versions: 1.6.0
>         Environment: IBM JVM
>            Reporter: Hayden Marchant
>            Assignee: Hayden Marchant
>             Fix For: 1.6.1, 1.7.0
>
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> There are a few issues, detailed below:
>  a. The generated configuration files contain references to GC 
> params that are specific to Sun JVM. In accumulo-env.sh, the 
> ACCUMULO_TSERVER_OPTS contains -XX:NewSize and -XX:MaxNewSize , and also in ACCUMULO_GENERAL_OPTS,
> -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 are used.
> b. in bin/accumulo, get ClassNotFoundException due to 
> specification of JAXP Doc Builder: 
> -Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl

> . 
>         The Sun implementation of Document Builder Factory does not exists 
> in IBM JDK, so a ClassNotFoundException is thrown on running accumulo 
> script
> c. MiniAccumuloCluster - in the MiniAccumuloClusterImpl, 
> Sun-speciifc GC params are passed as params to the java process (similar 
> to section a. )
> Single proposal for solving all 3 issues:
> Enhance bootstrap_config.sh with request to select Java vendor. 
> Selecting this will set correct values for GC params (they differ between 
> IBM and Sun), inclusion/ommision of JAXP setting. The 
> MiniAccumuloClusterImpl can read the same env variable that was set in 
> code for the GC Params, and use in the exec command.
> For exampel, doing this will result in CMS settings existing for SUN JVM, but when using
IBM JVM, the relevant GC parameter for IBM JVM will be used instead. In addition, the SUN
JAXP implementation will be omitted on non-SUN JVM.
> For now, I plan on having 4 options in new question
> 1. Sun
> 2. OpenJDK
> 3. IBM
> 4. Other



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message