From user-return-30573-archive-asf-public=cust-asf.ponee.io@flink.apache.org Wed Oct 30 03:46:45 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id C80821804BB for ; Wed, 30 Oct 2019 04:46:44 +0100 (CET) Received: (qmail 58998 invoked by uid 500); 30 Oct 2019 03:46:39 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 58897 invoked by uid 99); 30 Oct 2019 03:46:38 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Oct 2019 03:46:38 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 6BA4BC1961; Wed, 30 Oct 2019 03:46:38 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id L06QwoNWvcrT; Wed, 30 Oct 2019 03:46:36 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.160.176; helo=mail-qt1-f176.google.com; envelope-from=hello123.cn@gmail.com; receiver= Received: from mail-qt1-f176.google.com (mail-qt1-f176.google.com [209.85.160.176]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 5D7A2C1989; Wed, 30 Oct 2019 03:41:17 +0000 (UTC) Received: by mail-qt1-f176.google.com with SMTP id x14so1377076qtq.3; Tue, 29 Oct 2019 20:41:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to:cc; bh=QhIWdby3bPcSVsX9PRbuTkhULu0NRisfkByi/pK2DyE=; b=uc5y+vwQ1MyfL3qo25oma2oYzNzqVKQcERGoZGhcVMK12qvJt7EY9uirtmpGmrM4D8 6b9LNvbjdYyUi39GZmnFgIRkF4UhaORonapicrzDnU915fF9b9i2xm/JtGURGET+2SP1 mEVTOJHPKrAks+PaK7oQI3RkbKqAKhsyuzr5z3rlMA1RTzLskQqbnQPurTYCrbJ5oUr3 ZYAboznMJ9T3scndYYA0aKDPA49C+ni2+i4iGlQkd0tkPcPuq7CRuk+Wmh5PflM4Wm65 F1wia5rW8vlE+zRT0ORXk/rz1eZu2dD5nUq2xPWrTlcE2FSzy8DcTOj/vhuZkriQR56c VLlw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=QhIWdby3bPcSVsX9PRbuTkhULu0NRisfkByi/pK2DyE=; b=QJd98f/8Es8tv08SVLD2zYRrGI9dXRfcT41yJXIEK44//nuARErTgywGV0jNon/WoF bifWiCxxdbtg3DewSik0MRNcR+v24pNRbaL7MwK2cgeMduDDI86d2wFdXuubZmhMxy/E lxmfpeLiV522BsOP+vnUtIALxpsjttSmQMTCMuuIbW2PwS6QuU4eb8iy1bsVfJ92WoNu B0tzh1YlJnoJ2YPsJ3S4r1tzjCb2uIdxakNf5/QhkDGYiEbnyfyGXwUF+4SiNGSEgu5T JgHJY0BlNIhjaxVGHttnSMu69u6ECperrTvfQAk1UP9TFuXMQQcpheNMa93uEZpnuQfk ITwA== X-Gm-Message-State: APjAAAWgog6EBiOIGga86pdlkwlll4hhU9bl31Ou4uqg9g1FFiG0BicL 8aGDsX+qVY8RJL5e9K3wrB+Ne8zrSoTRsNlG2cXAyfPT X-Google-Smtp-Source: APXvYqyx0oK41GUGqPF9SY7YfV4BIQDKkUsfW0HRvzOoBaNmoeKy2iOefwMxL/pxqNRKYDXXmc4gZd8AsJeF/a6x0yM= X-Received: by 2002:a0c:fca5:: with SMTP id h5mr27085500qvq.149.1572406870760; Tue, 29 Oct 2019 20:41:10 -0700 (PDT) MIME-Version: 1.0 From: Alex Wang Date: Wed, 30 Oct 2019 11:40:36 +0800 Message-ID: Subject: flink run jar throw java.lang.ClassNotFoundException: com.mysql.jdbc.Driver To: user@flink.apache.org, user-zh@flink.apache.org Cc: imjark@gmail.com Content-Type: multipart/alternative; boundary="000000000000f960290596188009" --000000000000f960290596188009 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello everyone, I am a newbie. I am learning the flink-sql-submit project. From @Jark Wu : https://github.com/wuchong/flink-sql-submit My local environment is: 1. flink1.9.0 standalone 2. kafka_2.11-2.2.0 single I configured Flink Connectors and Formats jars to $FLINK_HOME/lib . Reference: https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/table/conne= ct.html#connectors Then I run flink-sql-submit , sh run.sh q1 Throw java.lang.ClassNotFoundException: com.mysql.jdbc.Driver. My question is: I configured mysql-connector-java in the pom.xml file, mvn build jar include com.mysql.jdbc.Driver. Why is this error still reported? I put the jar package in $FLINK_HOME/lib and the problem can be solved. Do you need to put these jars in $FLINK_HOME/lib when the project relies on too many jar packages? If I don't put mysql-connector-java.jar in $FLINK_HOME/lib, how can I solve this problem? Can @Jark Wu give me some advice? Or can someone give me some advice? Thank you. 1. pom.xml > mysql > mysql-connector-java > 5.1.38 > 2. mvn clean; mvn package $ ll -rth target > > [=C2=B1master =E2=97=8F] > total 32312 > drwxr-xr-x 3 alex staff 96B Oct 30 11:32 generated-sources > drwxr-xr-x 5 alex staff 160B Oct 30 11:32 classes > drwxr-xr-x 3 alex staff 96B Oct 30 11:32 maven-archiver > -rw-r--r-- 1 alex staff 7.2M Oct 30 11:32 > flink-sql-submit-1.0-SNAPSHOT.jar > -rw-r--r-- 1 alex staff 8.2M Oct 30 11:32 flink-sql-submit.jar > 3. flink-sql-submit.jar include java.sql.Driver " zip.vim version v28 > " Browsing zipfile > /Users/alex/IdeaProjects/alex/flink_learn/flink-sql-submit/target/flink-s= ql-submit.jar > " Select a file with cursor and press ENTER > > META-INF/MANIFEST.MF > META-INF/ > q1.sql > user_behavior.log > com/ > com/github/ > com/github/wuchong/ > com/github/wuchong/sqlsubmit/ > com/github/wuchong/sqlsubmit/SqlSubmit$1.class > com/github/wuchong/sqlsubmit/SqlSubmit.class > com/github/wuchong/sqlsubmit/SourceGenerator.class > com/github/wuchong/sqlsubmit/cli/ > com/github/wuchong/sqlsubmit/cli/SqlCommandParser$SqlCommandCall.class > com/github/wuchong/sqlsubmit/cli/SqlCommandParser.class > com/github/wuchong/sqlsubmit/cli/SqlCommandParser$SqlCommand.class > com/github/wuchong/sqlsubmit/cli/CliOptions.class > com/github/wuchong/sqlsubmit/cli/CliOptionsParser.class > META-INF/maven/ > META-INF/maven/com.github.wuchong/ > META-INF/maven/com.github.wuchong/flink-sql-submit/ > META-INF/maven/com.github.wuchong/flink-sql-submit/pom.xml > META-INF/maven/com.github.wuchong/flink-sql-submit/pom.properties > META-INF/services/ > META-INF/services/java.sql.Driver > com/mysql/ > com/mysql/fabric/ > com/mysql/fabric/FabricCommunicationException.class > com/mysql/fabric/FabricConnection.class > com/mysql/fabric/FabricStateResponse.class > com/mysql/fabric/HashShardMapping$ReverseShardIndexSorter.class > com/mysql/fabric/HashShardMapping.class > com/mysql/fabric/RangeShardMapping$RangeShardIndexSorter.class > com/mysql/fabric/RangeShardMapping.class > com/mysql/fabric/Response.class > com/mysql/fabric/Server.class > com/mysql/fabric/ServerGroup.class > com/mysql/fabric/ServerMode.class > com/mysql/fabric/ServerRole.class > etc ... > $FLINK_DIR/bin/flink run -d -p 3 target/flink-sql-submit.jar -w "${PROJECT_DIR}"/src/main/resources/ -f "$1".sql Eerror: 2019-10-30 10:27:35 java.lang.IllegalArgumentException: JDBC driver class not found. At org.apache.flink.api.java.io.jdbc.JDBCUpsertOutputFormat.open(JDBCUpsertOut= putFormat.java:112) At org.apache.flink.api.java.io.jdbc.JDBCUpsertSinkFunction.open(JDBCUpsertSin= kFunction.java:42) At org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(Funct= ionUtils.java:36) At org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(Abs= tractUdfStreamOperator.java:102) At org.apache.flink.streaming.api.operators.StreamSink.open(StreamSink.java:48= ) At org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(Stream= Task.java:532) At org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:= 396) At org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705) At org.apache.flink.runtime.taskmanager.Task.run(Task.java:530) At java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: com.mysql.jdbc.Driver At java.net.URLClassLoader.findClass(URLClassLoader.java:381) At java.lang.ClassLoader.loadClass(ClassLoader.java:424) At sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) At java.lang.ClassLoader.loadClass(ClassLoader.java:357) At java.lang.Class.forName0(Native Method) At java.lang.Class.forName(Class.java:264) At org.apache.flink.api.java.io.jdbc.AbstractJDBCOutputFormat.establishConnect= ion(AbstractJDBCOutputFormat.java:66) At org.apache.flink.api.java.io.jdbc.JDBCUpsertOutputFormat.open(JDBCUpsertOut= putFormat.java:99) ... 9 more --=20 Best --000000000000f960290596188009 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello everyone, I am a newbie.
I am learning the flink-= sql-submit project. From @Jark Wu =C2=A0:https://github.com/wuchong/flink-sq= l-submit

My local environment is:
1. flink1.9.0 standalone2. kafka_2.11-2.2.0 single

I configured Flink Connectors and Format= s jars to $FLINK_HOME/lib .
Reference: https://ci.apache.org/projects/flink/flink-docs-release-1.9= /dev/table/connect.html#connectors

Then I run flink-sql-submit ,= sh run.sh q1
Throw=C2=A0 java.lang.ClassNotFoundException: com.mysql.jd= bc.Driver.

My question is:=C2=A0
= I configured mysql-connector-java in the pom.xml fi= le, mvn build jar include com.mysql.jdbc.Driver.=C2=A0
Why is this error still reported?=C2=A0I put = the jar package in $FLINK_HOME/lib and the problem can be solved.
Do you need to put these jars in $FLINK_HOM= E/lib when the project relies on too many jar packages?
If I don't put mysql-connector-java.jar in $F= LINK_HOME/lib, how can I solve this problem?

Can @= Jark Wu =C2=A0give me some advice? Or can someone give me some advice? Than= k you.

1. pom.xml

<dependency>
<groupId>mysql</gro= upId>
<artifactId>mysql-connector-java</artifactId>
&l= t;version>5.1.38</version>
</dependency>
2. mvn clean; mvn package

$ ll -rth target =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0[=C2= =B1master =E2=97=8F]
total 32312
drwxr-xr-x =C2=A03 alex =C2=A0staff = =C2=A0 =C2=A096B Oct 30 11:32 generated-sources
drwxr-xr-x =C2=A05 alex = =C2=A0staff =C2=A0 160B Oct 30 11:32 classes
drwxr-xr-x =C2=A03 alex =C2= =A0staff =C2=A0 =C2=A096B Oct 30 11:32 maven-archiver
-rw-r--r-- =C2=A01= alex =C2=A0staff =C2=A0 7.2M Oct 30 11:32 flink-sql-submit-1.0-SNAPSHOT.ja= r
-rw-r--r-- =C2=A01 alex =C2=A0staff =C2=A0 8.2M Oct 30 11:32 flink-sql= -submit.jar

3. flink-sql-submit.jar include java.sql.Driver =C2=A0

" zip.vim version v28
"= Browsing zipfile /Users/alex/IdeaProjects/alex/flink_learn/flink-sql-submi= t/target/flink-sql-submit.jar
" Select a file with cursor and press= ENTER

META-INF/MANIFEST.MF
META-INF/
q1.sql
user_behavior.= log
com/
com/github/
com/github/wuchong/
com/github/wuchong/sql= submit/
com/github/wuchong/sqlsubmit/SqlSubmit$1.class
com/github/wuc= hong/sqlsubmit/SqlSubmit.class
com/github/wuchong/sqlsubmit/SourceGenera= tor.class
com/github/wuchong/sqlsubmit/cli/
com/github/wuchong/sqlsub= mit/cli/SqlCommandParser$SqlCommandCall.class
com/github/wuchong/sqlsubm= it/cli/SqlCommandParser.class
com/github/wuchong/sqlsubmit/cli/SqlComman= dParser$SqlCommand.class
com/github/wuchong/sqlsubmit/cli/CliOptions.cla= ss
com/github/wuchong/sqlsubmit/cli/CliOptionsParser.class
META-INF/m= aven/
META-INF/maven/com.github.wuchong/
META-INF/maven/com.github.wu= chong/flink-sql-submit/
META-INF/maven/com.github.wuchong/flink-sql-subm= it/pom.xml
META-INF/maven/com.github.wuchong/flink-sql-submit/pom.proper= ties
META-INF/services/
META-INF/services/java.sql.Driver
com/mysq= l/
com/mysql/fabric/
com/mysql/fabric/FabricCommunicationException.cl= ass
com/mysql/fabric/FabricConnection.class
com/mysql/fabric/FabricSt= ateResponse.class
com/mysql/fabric/HashShardMapping$ReverseShardIndexSor= ter.class
com/mysql/fabric/HashShardMapping.class
com/mysql/fabric/Ra= ngeShardMapping$RangeShardIndexSorter.class
com/mysql/fabric/RangeShardM= apping.class
com/mysql/fabric/Response.class
com/mysql/fabric/Server.= class
com/mysql/fabric/ServerGroup.class
com/mysql/fabric/ServerMode.= class
com/mysql/fabric/ServerRole.class
etc ...

=C2=A0

$FLINK_DIR/bin/flink run -d -p 3 targ= et/flink-sql-submit.jar -w "${PROJECT_DIR}"/src/main/resources/ -= f "$1".sql =C2=A0
Eerror:
2019-10-30 10:27:35java.lang.IllegalArgumentException: JDBC driver class not found.
At org= .apache.flink.api.java.io.jdbc.JDBCUpsertOutputFormat.open(JDBCUpsertOutput= Format.java:112)
At org.apache.flink.api.java.io.jdbc.JDBCUpsertSinkFunc= tion.open(JDBCUpsertSinkFunction.java:42)
At org.apache.flink.api.common= .functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
At org= .apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(Abstra= ctUdfStreamOperator.java:102)
At org.apache.flink.streaming.api.operator= s.StreamSink.open(StreamSink.java:48)
At org.apache.flink.streaming.runt= ime.tasks.StreamTask.openAllOperators(StreamTask.java:532)
At org.apache= .flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:396)
At= org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
At org.a= pache.flink.runtime.taskmanager.Task.run(Task.java:530)
At java.lang.Thr= ead.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: co= m.mysql.jdbc.Driver
At java.net.URLClassLoader.findClass(URLClassLoader.= java:381)
At java.lang.ClassLoader.loadClass(ClassLoader.java:424)
At= sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
At java.l= ang.ClassLoader.loadClass(ClassLoader.java:357)
At java.lang.Class.forNa= me0(Native Method)
At java.lang.Class.forName(Class.java:264)
At org.= apache.flink.api.java.io.jdbc.AbstractJDBCOutputFormat.establishConnection(= AbstractJDBCOutputFormat.java:66)
At org.apache.flink.api.java.io.jdbc.J= DBCUpsertOutputFormat.open(JDBCUpsertOutputFormat.java:99)
... 9 more

--
Best
--000000000000f960290596188009--