Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of sampath06@gmail.com designates
 209.85.210.182 as permitted sender)
MIME-Version: 1.0
Date: Wed, 5 Dec 2012 17:23:42 +0530
Message-ID: 
 <CABSF0oBF1EpL0jmeCJjQkBN7wgi8bdc_VQSmoUQC5xZufE752w@mail.gmail.com>
Subject: Issue with third party library
From: Sampath Herga <sampath06@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8f83a54f53b09504d019a2fd

--e89a8f83a54f53b09504d019a2fd
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I was just trying to setup hadoop and run some sample programs. I ran into
some issues when trying to add a required library. I tried using the
DistributedCache methods to try adding to the classpath.

The basic code is:
  Path mysqlJar = new
Path("target/classes/META-INF/mysql-connector-java-3.1.12-bin.jar");
  fs.copyFromLocalFile(mysqlJar, mysqlJar);
  DistributedCache.addArchiveToClassPath(mysqlJar, jobConf, fs);

I did a copyFromLocal since I wasnt sure where it would get picked from. I
tried both addArchiveToClassPath and addFileToClassPath. But with both, I
get a ClassNotFoundException.

Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
com.mysql.jdbc.Driver
    at
org.apache.hadoop.mapred.lib.db.DBInputFormat.configure(DBInputFormat.java:271)
    ... 16 more

The job seems to have got the file added and also checked in the
tasktracker local dir and the file seems to be present.

<property><name>mapred.job.classpath.archives</name><value>target/classes/META-INF/mysql-connector-java-3.1.12-bin.jar</value></property>

Any clues would be helpful. I dont think I can use -libjars since I am
trying to execute the hadoop jobs from within another application and not
from the command line.

Regards,
Sampath.

--e89a8f83a54f53b09504d019a2fd
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,<br><br>I was just trying to setup hadoop and run some sample programs. =
I ran into some issues when trying to add a required library. I tried using=
 the DistributedCache methods to try adding to the classpath. <br><br>The b=
asic code is:<br>
=A0 Path mysqlJar =3D new Path(&quot;target/classes/META-INF/mysql-connecto=
r-java-3.1.12-bin.jar&quot;);<br><div id=3D":zv">=A0 fs.copyFromLocalFile(m=
ysqlJar, mysqlJar);<br>=A0 DistributedCache.addArchiveToClassPath(mysqlJar,=
 jobConf, fs);<br>
<br>I did a copyFromLocal since I wasnt sure where it would get picked from=
. I tried both addArchiveToClassPath and addFileToClassPath. But with both,=
 I get a ClassNotFoundException.<br>
<br>Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException=
: com.mysql.jdbc.Driver<br>=A0=A0=A0 at org.apache.hadoop.mapred.lib.db.DBI=
nputFormat.configure(DBInputFormat.java:271)<br>=A0=A0=A0 ... 16 more<br><b=
r>The job seems to have got the file added and also checked in the tasktrac=
ker local dir and the file seems to be present.<br>
<br>&lt;property&gt;&lt;name&gt;mapred.job.classpath.archives&lt;/name&gt;&=
lt;value&gt;target/classes/META-INF/mysql-connector-java-3.1.12-bin.jar&lt;=
/value&gt;&lt;/property&gt;</div><br>Any clues would be helpful. I dont thi=
nk I can use -libjars since I am trying to execute the hadoop jobs from wit=
hin another application and not from the command line.<br>
<br>Regards,<br>Sampath.<br>

--e89a8f83a54f53b09504d019a2fd--