From user-return-33205-archive-asf-public=cust-asf.ponee.io@flink.apache.org Wed Mar 4 23:58:16 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id E10F218063F for ; Thu, 5 Mar 2020 00:58:15 +0100 (CET) Received: (qmail 79214 invoked by uid 500); 4 Mar 2020 23:58:14 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 79204 invoked by uid 99); 4 Mar 2020 23:58:14 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Mar 2020 23:58:14 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 87F2C1A32F2 for ; Wed, 4 Mar 2020 23:58:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.641 X-Spam-Level: X-Spam-Status: No, score=-1.641 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_SBL_CSS=3.558, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=wnco.com header.b=jriBvjHX; dkim=fail (1024-bit key) reason="fail (body has been altered)" header.d=wnco.onmicrosoft.com header.b=ImrSP2Gq Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id ARUHcq_la_kd for ; Wed, 4 Mar 2020 23:58:12 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=64.143.215.210; helo=mail01-a.wnco.com; envelope-from=norm.vilmer@wnco.com; receiver= Received: from MAIL01-A.wnco.com (mail01-a.wnco.com [64.143.215.210]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 06F0ABB801 for ; Wed, 4 Mar 2020 23:58:11 +0000 (UTC) Received: from pps.filterd (ppmail01-a.swacorp.com [127.0.0.1]) by ppmail01-a.swacorp.com (8.16.0.27/8.16.0.27) with SMTP id 024LrZSJ007549 for ; Wed, 4 Mar 2020 17:58:11 -0600 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wnco.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=swajul19; bh=BzcCAbi6zjQWv8NsehxuozDyPqPGe/j5juRGaLYMzpk=; b=jriBvjHXPKHMVfJfm1DgxtB66Tj4FzQFiF1UAuLMZYxLdQrG0AqAkomOZB8ECFFLpKop gD8BhBop+psRckxAfo2pw576TXDADnSfFqrMtXntqJywglz8MkIXd9qVOIkS3rCtktjB 7ucnr8IIDOxnsvb5Kw5GtvVuT8osawHWEvbDXhgC2FYTZAV+OMRTFYN8Zh7Ll+s57E7y UNadtR2XgJJB8zaShJDjU7S8/LyFs0NdEoF1y6yHl3ebzBPcIEwS7hi2s+f2QRAKBW/q lHcVNwBiRDQpMI6SmXizrt31LCEkPFfKfuJjhkneF6a4fWo5U6Ow0LsylbLDFRXpdIEC Yw== Authentication-Results: swacorp.com; dkim=pass header.d=wnco.onmicrosoft.com header.s=selector2-wnco-onmicrosoft-com Received: from wpht04.luv.ad.swacorp.com (wpht04.luv.ad.swacorp.com [172.23.50.33]) by ppmail01-a.swacorp.com with ESMTP id 2yjmn5gjf2-1 (version=TLSv1 cipher=AES128-SHA bits=128 verify=NOT) for ; Wed, 04 Mar 2020 17:58:10 -0600 Received: from wpexchmg02.LUV.AD.SWACORP.COM (172.31.55.21) by WPHT04.LUV.AD.SWACORP.com (172.23.50.33) with Microsoft SMTP Server (TLS) id 14.3.408.0; Wed, 4 Mar 2020 17:58:10 -0600 Received: from wpexchmg02.LUV.AD.SWACORP.COM (172.31.55.21) by wpexchmg02.LUV.AD.SWACORP.com (172.31.55.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1531.3; Wed, 4 Mar 2020 17:58:10 -0600 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (172.19.106.112) by wpexchmg02.LUV.AD.SWACORP.COM (172.31.55.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1531.3 via Frontend Transport; Wed, 4 Mar 2020 17:58:10 -0600 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=OR9JfyfwhzvWbksXigKB8H5pLD6tQ9lRSloaE9wZB2TLtlARJVyxF7i6iBEsH1iwCSCHN1D8Lc2IGug1nhPxxi75R9xOpPzvcW9PDzdu/d48Y1z3eItQrebBmgMrf+xoLAfG31zk5gmr8xEBNiis5VqT9ZJFH0aa2HqOlxk2USoBAIW+lrTPpjlqbm5SgCtQdJ3c3OSUINVGYpcEjESw427nVhQPtalQeJGCz8uotgEqhwjA95aloN2mWNFijN0PEiOXF0mbT7+rwiv9KprM/qmexI5xG/ed83HYBhiPxps+gSNMTHwTJzYwRXrOnNwESkIrEwNp1ElmKthZmRjM3A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+5ReJlS8ruYsiv5VEAmMSUt7CWojsuPTRm0D07cyBwM=; b=PfTdcU4ECiRQ6+qQnXVpt86Ug6ZGNnUxZ/DEYSXOWwObe4tM/t47poIe5TALLeHcd7QAahSd03pIAP9u+yRnYNri51mVXcFTzrttH4nr+wuSY0MpRgN+CmNXoFF6/lfWWmvZBIFeOyTyHpaTpPQMph1cTnpRBzGHRFqsMJsa7ENhq6BNjY+ObqeEKo5fhhCF1ITr2qU6N9BVeYF7vhNZgShTEJBU+BkOR8f0121aXA8KNykgz8C+ferSV6zoxZyMA9EIyxvddAnKpNJImRyJXLj9jHFSpVUN7FzWl42/PO8fZikjwsNUt6zdjeCh3QmpKSxKkZHEpn/SvrAdxrWIVw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=wnco.com; dmarc=pass action=none header.from=wnco.com; dkim=pass header.d=wnco.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wnco.onmicrosoft.com; s=selector2-wnco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+5ReJlS8ruYsiv5VEAmMSUt7CWojsuPTRm0D07cyBwM=; b=ImrSP2Gq7e7+aU+tSVYo0StAw1FwvVfKJgH4GJCuNJuBVMYohJibiH1fUdTVUrVP6U8AtWO9ivgYoirv67TblGruaTAlhCwC+3N9yoJTiXPEENXCGVNcaHgSJUWZSEwrX0mGKzxUpuQDBBKdMm+BSyAwls6J4SWOyLTU0xOZeIM= Received: from DM6PR17MB2843.namprd17.prod.outlook.com (2603:10b6:5:12e::30) by DM6PR17MB3513.namprd17.prod.outlook.com (2603:10b6:5:201::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2772.18; Wed, 4 Mar 2020 23:58:08 +0000 Received: from DM6PR17MB2843.namprd17.prod.outlook.com ([fe80::48:47f7:bacd:a1e2]) by DM6PR17MB2843.namprd17.prod.outlook.com ([fe80::48:47f7:bacd:a1e2%4]) with mapi id 15.20.2772.019; Wed, 4 Mar 2020 23:58:08 +0000 From: "Norm Vilmer (Contractor)" To: "Norm Vilmer (Contractor)" , "user@flink.apache.org" Subject: RE: Teradata as JDBC Connection Thread-Topic: Teradata as JDBC Connection Thread-Index: AdXyQPCDGKhE4J78RUm4qtz6k9aA+QAP5RJg Date: Wed, 4 Mar 2020 23:58:08 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [208.94.154.7] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 1655b46f-06fa-4a90-f439-08d7c097e3b6 x-ms-traffictypediagnostic: DM6PR17MB3513: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:7219; x-forefront-prvs: 0332AACBC3 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(366004)(189003)(199004)(2940100002)(66946007)(2906002)(53546011)(52536014)(6506007)(76116006)(186003)(81166006)(55016002)(8936002)(86362001)(966005)(66476007)(26005)(498600001)(66446008)(8676002)(64756008)(7696005)(33656002)(66556008)(9686003)(3480700007)(81156014)(71200400001)(5660300002)(110136005)(21314003);DIR:OUT;SFP:1102;SCL:1;SRVR:DM6PR17MB3513;H:DM6PR17MB2843.namprd17.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;MX:1;A:0; received-spf: None (protection.outlook.com: wnco.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 2a6sLnafdpOhG0kp2iGmpcV0exmLUqqfr/SfBc23s220ixTYYTmOdBF1qqpOW+zcW2YrM8NsRt5NNKYVqGCd/Fx/gYsAZ16gcD6WjJZl7i3DxrHNXW/9zIHZZ6yMAWjLrWYa8taFy7KfQYnvaGys64Id9h/xH3Jar3KEGQGJCYYGqN3KMPFXzYgTp3334mmI5tqAMOR8WlhGh633s9C35VjuDQvjq53q09WmvUemAAVjdwOjKKDuNNawUNy0Q7WKacgd7f+BsKP7D9Xx8pXiB8WZkpBEgauO/XCfS8Ratq34umwZ1m8nDNgMAnmezoKqlYwktGAmLgrIj9TR17xT7qNE4JkagOFKDMcIRydrmpLjAZf5GzA5wMq3READCLeagXb+4i/t1C54eQ4L2DsrNYbqoYTC9nOBn0GNHaBietmCzsFx4E33DGtxusCeBFvz3p+hwWW1COQvqXo6EKWp+7evw3SKNuHn9lIwsIyERvKc+bMvMzl/21HuTXnDEXCzEtK0NC0crA42CCJrgvsGAF5sMzMqvMwY2ntNud2ji+cjKwJ9LqtO56SqY8OnPUs/ x-ms-exchange-antispam-messagedata: cjFEXPCldJUtUzhtrMRV6vol1phA/5lPx0mdufMa+3ZVqayZbe3MgfKcXNv1+CqiKscNTRadsXiVX4qPdc/2FT9jR9uIH1KntGz3KgGnQftZdPXnllQ/UhywZbftE1DmJAp1g8LKYA1DoYUPPVjOtQ== Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 1655b46f-06fa-4a90-f439-08d7c097e3b6 X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Mar 2020 23:58:08.7978 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: f5d3bd9c-a8c2-4efc-9493-ddf2d4b42f17 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 8d5gcKphfABXW6LCtFmMFd+GAK/uOWVDy02UN8aqAljmIuUIDZve1ZqnmvawHoPLPcBpCc9zqYb+DrSj77cfZA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR17MB3513 X-OriginatorOrg: wnco.com X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.138,18.0.572 definitions=2020-02-29_01:2020-02-28,2020-02-29 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-2002050000 definitions=main-2002290046 Same error with this change: public class Teradata extends ConnectorDescriptor { /** * Constructs a {@link ConnectorDescriptor}. */ public Teradata() { super("jdbc", 1, false); } @Override protected Map toConnectorProperties() { Map map =3D new HashMap<>(); map.put(JDBCValidator.CONNECTOR_DRIVER, "com.teradata.jdbc.TeraDriv= er"); map.put(JDBCValidator.CONNECTOR_URL, "jdbc:teradata://myserver/data= base=3Dmydb,LOGMECH=3DLDAP"); map.put(JDBCValidator.CONNECTOR_USERNAME, "..."); map.put(JDBCValidator.CONNECTOR_PASSWORD, "...!"); return map; } } -----Original Message----- From: Norm Vilmer (Contractor) =20 Sent: Wednesday, March 4, 2020 10:37 AM To: user@flink.apache.org Subject: EXTERNAL - Teradata as JDBC Connection Caution: Sender is from outside SWA. Take caution before opening links/atta= chments or replying with sensitive data. If suspicious, forward to 'suspici= ous@wnco.com'. Using Flink 1.10 and coding in Java 11, is it possible use to write to Tera= data in append mode? MySQL, PostgreSQL, and Derby are the only supported dr= ivers listed. Thanks. https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__ci.apache.org_projec= ts_flink_flink-2Ddocs-2Dstable_dev_table_connect.html-23connectors&d=3DDwIF= Ag&c=3DdyyteaO_66X5RejcGgaVFCWGX8V6S6CQobBcYjo__mc&r=3Da8BqCmWrJ1FuU14JVrlQ= LeWdeeSBWSiCJA9Y5xTWafg&m=3DkfV3arAbKYvpd5IvCtggkHsoDXKTgA1RrGMWrbcWZOo&s= =3Dn91D15kGNf9TDtKedGYD8EfDYxnvEzY8POgNtSE-icY&e=3D=20 I created the ConnectorDescriptor below and am using it from tableEnvironme= nt.connect() but get the exception shown below. public class Teradata extends ConnectorDescriptor { /** * Constructs a {@link ConnectorDescriptor}. */ public Teradata() { super("jdbc", 1, false); } @Override protected Map toConnectorProperties() { Map map =3D new HashMap<>(); map.put("Drivername", "com.teradata.jdbc.TeraDriver"); map.put("DBUrl", "jdbc:teradata://myserver/database=3Dmydb,LOGMECH= =3DLDAP"); map.put("Username", "..."); map.put("Password", "..."); return map; } } org.apache.flink.table.api.NoMatchingTableFactoryException: Could not find = a suitable table factory for 'org.apache.flink.table.factories.TableSinkFac= tory' in the classpath. Reason: No factory supports all properties. The matching candidates: org.apache.flink.api.java.io.jdbc.JDBCTableSourceSinkFactory Unsupported property keys: drivername update-mode password dburl username The following properties are requested: connector.property-version=3D1 connector.type=3Djdbc dburl=3Djdbc:teradata://myserver/database=3Dmydb,LOGMECH=3DLDAP drivername=3Dcom.teradata.jdbc.TeraDriver password=3Dxxx schema.0.data-type=3DVARCHAR(1) schema.0.name=3Df0 schema.1.data-type=3DVARCHAR(1) schema.1.name=3Df1 schema.2.data-type=3DVARCHAR(1) schema.2.name=3Df2 update-mode=3Dappend username=3Dxxx The following factories have been considered: org.apache.flink.table.sinks.CsvBatchTableSinkFactory org.apache.flink.table.sinks.CsvAppendTableSinkFactory org.apache.flink.api.java.io.jdbc.JDBCTableSourceSinkFactory org.apache.flink.streaming.connectors.kafka.Kafka011TableSourceSinkFactory org.apache.flink.streaming.connectors.kafka.Kafka010TableSourceSinkFactory org.apache.flink.streaming.connectors.kafka.Kafka09TableSourceSinkFactory ******* CONFIDENTIALITY NOTICE ******* This e-mail message and all attachments transmitted with it may contain leg= ally privileged and confidential information intended solely for the use of= the addressee. If the reader of this message is not the intended recipient= , you are hereby notified that any reading, dissemination, distribution, co= pying, or other use of this message or its attachments is strictly prohibit= ed. If you have received this message in error, please notify the sender im= mediately and delete this message from your system. Thank you. ******* CONFIDENTIALITY NOTICE ******* This e-mail message and all attachments transmitted with it may contain leg= ally privileged and confidential information intended solely for the use of= the addressee. If the reader of this message is not the intended recipient= , you are hereby notified that any reading, dissemination, distribution, co= pying, or other use of this message or its attachments is strictly prohibit= ed. If you have received this message in error, please notify the sender im= mediately and delete this message from your system. Thank you.