Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4AB281793F for ; Fri, 8 May 2015 18:49:02 +0000 (UTC) Received: (qmail 94554 invoked by uid 500); 8 May 2015 18:49:02 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 94495 invoked by uid 500); 8 May 2015 18:49:02 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 94484 invoked by uid 99); 8 May 2015 18:49:02 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 May 2015 18:49:02 +0000 Date: Fri, 8 May 2015 18:49:02 +0000 (UTC) From: "Ravi Prakash (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (MAPREDUCE-1290) DBOutputFormat does not support rewriteBatchedStatements when using MySQL jdbc drivers MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated MAPREDUCE-1290: ------------------------------------ Resolution: Fixed Target Version/s: (was: ) Status: Resolved (was: Patch Available) > DBOutputFormat does not support rewriteBatchedStatements when using MySQL jdbc drivers > -------------------------------------------------------------------------------------- > > Key: MAPREDUCE-1290 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1290 > Project: Hadoop Map/Reduce > Issue Type: Bug > Affects Versions: 0.20.1 > Reporter: Joe Crobak > Labels: DBOutoutFormat, patch > Attachments: MAPREDUCE-1290.003.patch, MAPREDUCE-1290.patch, MapReduce-1290-trunk.patch > > > The DBOutputFormat adds a semi-colon to the end of the INSERT statement that it uses to save fields to the database. Semicolons are typically used in command line programs but are not needed when using the JDBC API. In this case, the stray semi-colon breaks rewriteBatchedStatement support. See: http://forums.mysql.com/read.php?39,271526,271526#msg-271526 for an example. > In my use case, rewriteBatchedStatement is very useful because it increases the speed of inserts and reduces memory consumption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)