hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-10548) PerfEval work around wrong runtime dependency version
Date Tue, 18 Feb 2014 22:31:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904716#comment-13904716
] 

Andrew Purtell edited comment on HBASE-10548 at 2/18/14 10:30 PM:
------------------------------------------------------------------

I think the change is needed to rectify the issue for both Hadoop 1 and Hadoop 2 (at least
2.2.x is also affected). There is no reason for us to diverge from Hadoop on the version of
this dependency.




was (Author: apurtell):
I think the change is needed to unbreak MR for both Hadoop 1 and Hadoop 2 (at least 2.2.x
is also affected)



> PerfEval work around wrong runtime dependency version
> -----------------------------------------------------
>
>                 Key: HBASE-10548
>                 URL: https://issues.apache.org/jira/browse/HBASE-10548
>             Project: HBase
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.96.2, 0.98.1, 0.99.0
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>            Priority: Minor
>         Attachments: HBASE-10548.00.patch, HBASE-10548.01.patch
>
>
> From my [comment|https://issues.apache.org/jira/browse/HBASE-10511?focusedCommentId=13902238&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13902238]
on HBASE-10511:
> I have hadoop-1.2.1 installed from tgz, which packages commons-math-2.1. This is *different*
from the listed maven dependency, 2.2.
> {noformat}
> $ tar tvf hadoop-1.2.1.tar.gz | grep commons-math
> -rw-rw-r--  0 0      0      832410 Jul 22  2013 hadoop-1.2.1/lib/commons-math-2.1.jar
> $ mvn -f pom.xml.hadoop1 dependency:tree | grep commons-math
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
> {noformat}
> This is a problem because the 2.1 version of [DescriptiveStatistics|http://commons.apache.org/proper/commons-math/javadocs/api-2.1/org/apache/commons/math/stat/descriptive/DescriptiveStatistics.html]
doesn't have a double[] constructor. Running the MR job, mappers fail:
> {noformat}
> java.lang.NoSuchMethodError: org.apache.commons.math.stat.descriptive.DescriptiveStatistics.<init>([D)V
> 	at org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest.testTakedown(PerformanceEvaluation.java:1163)
> 	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:984)
> 	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1401)
> 	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:522)
> 	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:474)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message