hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Liren Ding <sky.gonna.bri...@gmail.com>
Subject Hadoop library version issues and conflict
Date Thu, 28 Jan 2016 19:33:35 GMT
My MR job use following libs:

   - commons-codec-1.9,
   - commons-compress-1.7,
   - guava-12.0.1,
   - httpclient-4.3.1
   - httpcore-4.

But the versions in hadoop libs are:

   - commons-codec-1.4
   - commons-compress-1.4.1
   - guava-11.0.2
   - httpclient-4.2.5
   - httpcore-4.2.5

This conflict causes a "java.lang.NoSuchMethodError" error. One insane
solution is replacing all libs allover the cluster with new versions. But
the approach is not practical in production environment. Is there a decent
way to solve the hadoop libraries version conflict issue?

View raw message