Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5D446200498 for ; Tue, 29 Aug 2017 19:27:08 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5B66616205D; Tue, 29 Aug 2017 17:27:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A542C1619B0 for ; Tue, 29 Aug 2017 19:27:07 +0200 (CEST) Received: (qmail 6931 invoked by uid 500); 29 Aug 2017 17:27:06 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 6901 invoked by uid 99); 29 Aug 2017 17:27:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Aug 2017 17:27:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 3775A188AF2 for ; Tue, 29 Aug 2017 17:27:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id NmxCnHHItH9D for ; Tue, 29 Aug 2017 17:27:04 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 0F56760F06 for ; Tue, 29 Aug 2017 17:27:04 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 37056E0044 for ; Tue, 29 Aug 2017 17:27:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 97B1E24166 for ; Tue, 29 Aug 2017 17:27:00 +0000 (UTC) Date: Tue, 29 Aug 2017 17:27:00 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-7556) Fix fetch size configurable in JDBCInputFormat for MySQL Driver MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 29 Aug 2017 17:27:08 -0000 [ https://issues.apache.org/jira/browse/FLINK-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145732#comment-16145732 ] ASF GitHub Bot commented on FLINK-7556: --------------------------------------- GitHub user nycholas opened a pull request: https://github.com/apache/flink/pull/4617 [FLINK-7556] Fix fetch size configurable in JDBCInputFormat for MySQL Driver According to the MySQL documentation[1], it follows: * ResultSet > By default, ResultSets are completely retrieved and stored in memory. In most cases this is the most efficient way to operate and, due to the design of the MySQL network protocol, is easier to implement. If you are working with ResultSets that have a large number of rows or large values and cannot allocate heap space in your JVM for the memory required, you can tell the driver to stream the results back one row at a time. > To enable this functionality, create a Statement instance in the following manner: ``` stmt = conn.createStatement(java.sql.ResultSet.TYPE_FORWARD_ONLY, java.sql.ResultSet.CONCUR_READ_ONLY); stmt.setFetchSize(Integer.MIN_VALUE); ``` > The combination of a forward-only, read-only result set, with a fetch size of Integer.MIN_VALUE serves as a signal to the driver to stream result sets row-by-row. After this, any result sets created with the statement will be retrieved row-by-row. Allow the Integer.MIN_VALUE to be accepted as a parameter for setFetchSize. [1] - https://dev.mysql.com/doc/connector-j/5.1/en/connector-j-reference-implementation-notes.html You can merge this pull request into a Git repository by running: $ git pull https://github.com/cenobites/flink master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/4617.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #4617 ---- commit 82535fd09cf52cb3e1c3da162dc807d7d889ac19 Author: Nycholas de Oliveira e Oliveira Date: 2017-08-29T17:21:03Z [FLINK-7556] Fix fetch size configurable in JDBCInputFormat for MySQL Driver ---- > Fix fetch size configurable in JDBCInputFormat for MySQL Driver > --------------------------------------------------------------- > > Key: FLINK-7556 > URL: https://issues.apache.org/jira/browse/FLINK-7556 > Project: Flink > Issue Type: Bug > Components: Batch Connectors and Input/Output Formats > Affects Versions: 1.3.2 > Reporter: Nycholas de Oliveira e Oliveira > Priority: Trivial > > According to the MySQL documentation[1], it follows: > * ResultSet > {quote}By default, ResultSets are completely retrieved and stored in memory. In most cases this is the most efficient way to operate and, due to the design of the MySQL network protocol, is easier to implement. If you are working with ResultSets that have a large number of rows or large values and cannot allocate heap space in your JVM for the memory required, you can tell the driver to stream the results back one row at a time. > {quote} > {quote}To enable this functionality, create a Statement instance in the following manner:{quote} > {code:java} > stmt = conn.createStatement(java.sql.ResultSet.TYPE_FORWARD_ONLY, > java.sql.ResultSet.CONCUR_READ_ONLY); > stmt.setFetchSize(Integer.MIN_VALUE); > {code} > {quote}The combination of a forward-only, read-only result set, with a fetch size of Integer.MIN_VALUE serves as a signal to the driver to stream result sets row-by-row. After this, any result sets created with the statement will be retrieved row-by-row.{quote} > Allow the *Integer.MIN_VALUE* to be accepted as a parameter for _setFetchSize_. > [1] - https://dev.mysql.com/doc/connector-j/5.1/en/connector-j-reference-implementation-notes.html -- This message was sent by Atlassian JIRA (v6.4.14#64029)