= wrote: >=20 > > Hello, > > > > I am using storm version 0.9.0.1. > > My application depends on apache http-client version 4.3.2 - but = storm depends on http-client version 4.1.1. > > > > What is the best way to override this dependency? > > > > Thanks > > Vinay >=20 >=20 >=20 >=20 --Apple-Mail=_56AF7B89-6CA3-4FE1-93A4-C2597C50EA53 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 I=92m = glad the shader plugin worked for you.

Updating = dependencies can be tricky as it can easily introduce = regressions.

Ultimately we need to figure = out the best solution to avoiding conflicts between user code (i.e. = dependencies in topology jar files) and Storm=92s = libraries.

The classloader approach has been = attempted, but IMO Storm=92s use of serialization complicates things = significantly. Package relocation seems to be a relatively lightweight = solution.

If that=92s a direction we pursue, = then it introduces the question of whether Storm should relocate its = dependencies, or if that should be left up to the user (topology = developer).

Elastic Search has gone down the = path of relocating some of their dependencies [1] (not necessarily an = endorsement, just an observation).

I=92ve CC=92d = dev@ since this is all related to the infamous issue #115, which is now = STORM-129 [2].

- = Taylor

[1] https://github.com/elasticsearch/elasticsearch/blob/master/pom.xml#= L474

[2] https://issues.ap= ache.org/jira/browse/STORM-129

On Feb 6, 2014, at 7:25 PM, = Vinay Pothnis <vinay.pothnis@gmail.com> = wrote:

Thank you all for replies! The = shader-plugin solution seems to work for us.

I = wonder if we can create a JIRA ticket for storm to upgrade the = http-client library as part of their next release.

-Vinay

On Thu, Feb 6, = 2014 at 2:38 PM, Michael Rose <michael@fullcontact.com> wrote:

We've = done this with SLF4j and Guava as well without issues.

Michael Rose (@Xorlev)
Senior Platform = Engineer, FullContact
michael@fullcontact.com

On Thu, Feb 6, 2014 at 3:03 PM, Mark = Greene <mark@evertrue.com> wrote:

We had this problem as well. We modified our chef = cookbook to just replace the older version with the newer one and storm = didn't complain or have any other issues as a result.

On Wed, Feb 5, 2014 at 10:31 AM, P. = Taylor Goetz <ptgoetz@gmail.com> wrote:
Your best bet is probably to use the shade plugin to relocate the = http-client package so it doesn=92t conflict with the version storm = uses.

Storm does this with the libtrhift dependency in storm-core:

https://github.com/apache/incubator-storm/blob/master/st= orm-core/pom.xml#L220

(You can ignore the clojure transformer in that config, unless you have = non-AOT clojure code that uses the http-client library).

More information on using the shade plugin to do package relocations can = be found here:

http://maven.apache.org/plugins/maven-shade-plugin/examp= les/class-relocation.html

- Taylor

On Feb 4, 2014, at 4:27 PM, Vinay Pothnis <vinay.pothnis@gmail.com> wrote:

> Hello,
>
> I am using storm version 0.9.0.1.
> My application depends on apache http-client version 4.3.2 - but = storm depends on http-client version 4.1.1.
>
> What is the best way to override this dependency?
>
> Thanks
> Vinay

= --Apple-Mail=_56AF7B89-6CA3-4FE1-93A4-C2597C50EA53-- --Apple-Mail=_280451FC-2CC1-42CE-8C49-C040DEBFA60C Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJS9DqaAAoJEI3gOWLoC4/91uUH/ip3meCSK1JNp+L75jzuvhO9 A0aiWs18wQL/MlAT3mn2cwymH+btZiKnbffkG3E0KbRYTrACyqT23l6hyAnFLJ2v lVpb8VUV+VJXmwtevD5K1OV7D7mVD6yGFlWGGn/f0eHBX766+Me5AhfRzYZD0PDu oc+TRJCP3KY+TyM98pbsllFFWh3UogmGRvRCVwo/Zq6nA5y88LvGqtKZfDwr69RX v/PAG1b1MMQLILlEwdjkg9lIwEGANFDCqEmv/0M23Vt42cZ9EWLq9hl7CYr8kkq1 rf6z+SYvMmVHx7IoOZFVXsjuTcE+pcsr+aZuLk4nTbFgilvaleOlz+d/ggXuWCY= =cn3M -----END PGP SIGNATURE----- --Apple-Mail=_280451FC-2CC1-42CE-8C49-C040DEBFA60C--