hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: HBase 0.98.x dependency problems
Date Fri, 27 Jun 2014 12:04:02 GMT
Thanks for finding this issue, Cos.

I opened HBASE-11422 and attached a patch there - there is no dependency on
2.2.0 if -Dhadoop-two.version=2.3.0 is specified.

Cheers


On Thu, Jun 26, 2014 at 9:43 PM, Konstantin Boudnik <cos@apache.org> wrote:

> Weird... running
>   mvn install dependency:tree -Dhadoop-two.version=2.3.0
> keeps pulling in 2.2.0 for test artifacts. An easy way to reproduce it is
> to
> wipe out clean hadoop 2.2.0 artifacts from ~/.m2 as well as 0.98.2* (if
> installed) and then run the command above. Something like this can be seen:
>
> [INFO] +- org.apache.hbase:hbase-shell:jar:0.98.2:compile
> [INFO] |  +- org.apache.hbase:hbase-prefix-tree:jar:0.98.2:runtime
> [INFO] |  +- com.yammer.metrics:metrics-core:jar:2.1.2:compile
> [INFO] |  +- org.jruby:jruby-complete:jar:1.6.8:compile
> [INFO] |  +- org.apache.hadoop:hadoop-client:jar:2.3.0:compile
> [INFO] |  |  +-
> org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.3.0:compile
> [INFO] |  |  +- org.apache.hadoop:hadoop-yarn-api:jar:2.3.0:compile
> [INFO] |  |  \-
> org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.3.0:compile
> [INFO] |  +- org.apache.hadoop:hadoop-hdfs:jar:2.3.0:compile
> [INFO] |  |  \- commons-daemon:commons-daemon:jar:1.0.13:compile
> [INFO] |  \- org.apache.hadoop:hadoop-hdfs:test-jar:tests:2.2.0:compile
>
> I have fixed a problem with site target, but still see this...
>
> Any ideas are very appreciated! Thanks.
>   Cos
>
>
> On Tue, Jun 17, 2014 at 08:33PM, Konstantin Boudnik wrote:
> > Thank you very much Ted - that helped beautifully! I think the build
> system
> > becomes a product on its own :)
> >
> > Regards,
> >   Cos
> >
> > On Tue, Jun 17, 2014 at 12:40PM, Ted Yu wrote:
> > > Have you tried the following command ?
> > >
> > > mvn dependency:tree -Dhadoop-two.version=2.3.0
> > >
> > > The output of the above has 2.3.0 as the dependency.
> > >
> > > Cheers
> > >
> > >
> > > On Tue, Jun 17, 2014 at 11:40 AM, Konstantin Boudnik <cos@apache.org>
> wrote:
> > >
> > > > Guys,
> > > >
> > > > I have noticed an interesting problem with HBase 0.98 line. I have
> ended
> > > > up with
> > > > a crappy Hadoop 2.2.0 artifacts in my local M2 cache - don't ask me
> how
> > > > that
> > > > happen ;( - which causes compilation problems in HBase. And that
> brought
> > > > this
> > > > whole issue into the light. Here's the essence of it:
> > > >
> > > > while running for hbase-server module
> > > >   % mvn dependency:tree  -Dhadoop.version=2.3.0
> > > > I am getting a reference to hadoop 2.2.0
> > > >
> > > > [INFO] +- org.apache.hadoop:hadoop-common:jar:2.2.0:compile
> > > > ..
> > > > [INFO] +- org.apache.hadoop:hadoop-auth:jar:2.2.0:compile
> > > > [INFO] +- org.apache.hadoop:hadoop-client:jar:2.2.0:compile
> > > >
> > > > This only happens for 0.98. On master the reference goes to 2.4.0
> > > > The problem here is that -Dhadoop.version is being seemingly
> ignored, which
> > > > might lead to binaries with dependencies inconsistent with what it
> was
> > > > built
> > > > against. I am not sure if this had came up before, but certainly
> would
> > > > appreciate the community's input, if any.
> > > >
> > > > Thanks a lot!
> > > > --
> > > > Take care,
> > > >   Cos
> > > >
> > > >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message