Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 540DD18CE5 for ; Thu, 21 Jan 2016 11:23:52 +0000 (UTC) Received: (qmail 8235 invoked by uid 500); 21 Jan 2016 11:23:50 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 8162 invoked by uid 500); 21 Jan 2016 11:23:50 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 8152 invoked by uid 99); 21 Jan 2016 11:23:50 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jan 2016 11:23:50 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 1F6A4C0860 for ; Thu, 21 Jan 2016 11:23:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.02 X-Spam-Level: X-Spam-Status: No, score=-0.02 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=criteois.onmicrosoft.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id MsYit3GEGEYl for ; Thu, 21 Jan 2016 11:23:42 +0000 (UTC) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0116.outbound.protection.outlook.com [104.47.2.116]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 4383924EB7 for ; Thu, 21 Jan 2016 11:23:42 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=criteois.onmicrosoft.com; s=selector1-criteo-com; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=PArNTXEHghzgSynF78kMZK/XWe+STo/pb4+eo9QCIAY=; b=spp2398lKEUsRpxFFD0tUu68TlcozHTxdVHMJ7b3XLtK00nSxDNVU7C/S1T5e4Dx6xdeMy2NyyeEetcvNJAOB0KDCHAH7moE6pSBR2I6eYC/lGEaL5WaPlmJRuWmDOqnUmv/khfGwiu4TxvQ5KbKhVV8kIA9ZzMaq02MyLQ1RxM= Received: from DB5PR04MB1318.eurprd04.prod.outlook.com (10.162.157.12) by DB5PR04MB1317.eurprd04.prod.outlook.com (10.162.157.11) with Microsoft SMTP Server (TLS) id 15.1.365.19; Thu, 21 Jan 2016 11:23:35 +0000 Received: from DB5PR04MB1318.eurprd04.prod.outlook.com ([10.162.157.12]) by DB5PR04MB1318.eurprd04.prod.outlook.com ([10.162.157.12]) with mapi id 15.01.0365.024; Thu, 21 Jan 2016 11:23:35 +0000 From: Thomas Achache To: Gopal Vijayaraghavan , "user@hive.apache.org" Subject: RE: HIVE CLI does not escape \t ? Thread-Topic: HIVE CLI does not escape \t ? Thread-Index: AdFT4CkgRoGOqKR0S3WrtF1/lWXtAwAAuFqAABB5d5A= Date: Thu, 21 Jan 2016 11:23:34 +0000 Message-ID: References: In-Reply-To: Accept-Language: fr-FR, en-US Content-Language: fr-FR X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=t.achache@criteo.com; x-originating-ip: [91.199.242.236] x-microsoft-exchange-diagnostics: 1;DB5PR04MB1317;5:o8+/TDhLrataEGVNwr12vZ1+7mvQzSR0k6sa79F7u34hznOAlRYd2ccdWRUHQM1AxPJU5i3MJ/x7hVcH0iR1bxxpZSWFsI5r48708q7WlfNrPBRSt1JKsfPl1KHzOCoBIeuWESeKng9SCTOCD3N27Q==;24:gFzKHqMD/rjM3hz0KHAdfYZjeaXv9MIt0rqo5YDVKEQY/xojBMZ3a1tAfImCdkP1TRL2SMIU5lajtZ0YS1O/WZfaQiGKYyhMrooIT2rWebA= x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DB5PR04MB1317; x-ms-office365-filtering-correlation-id: a08e7785-82d3-4e3a-a61a-08d322554d2e x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(279538565370033); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(601004)(2401047)(520078)(8121501046)(5005006)(10201501046)(3002001);SRVR:DB5PR04MB1317;BCL:0;PCL:0;RULEID:;SRVR:DB5PR04MB1317; x-forefront-prvs: 08286A0BE2 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(6009001)(199003)(55784002)(189002)(10400500002)(5003600100002)(6116002)(5004730100002)(102836003)(107886002)(5001960100002)(3846002)(19580395003)(189998001)(586003)(66066001)(5008740100001)(19580405001)(1096002)(97736004)(11100500001)(1220700001)(101416001)(5001770100001)(5002640100001)(81156007)(86362001)(40100003)(122556002)(2900100001)(105586002)(77096005)(87936001)(2906002)(106356001)(54356999)(76176999)(33656002)(92566002)(2950100001)(2501003)(76576001)(74316001)(50986999)(217873001);DIR:OUT;SFP:1102;SCL:1;SRVR:DB5PR04MB1317;H:DB5PR04MB1318.eurprd04.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: criteo.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: criteo.com X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Jan 2016 11:23:34.9964 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 2a35d8fd-574d-48e3-927c-8c398e225a01 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR04MB1317 Thanks Gopal I tried that but it generates as many files as mappers (no reducers in this= query).=20 Tried:=20 - set hive.exec.max.created.files=3D1; does not work, execution stops after= more than 1 file is created - set mapred.map.tasks=3D1; does not work either, still using 35 mappers I use the workaround cat * >> output.tsv but that's not ideal.=20 Any way to constrain the number of files to 1 automatically? =20 -----Message d'origine----- De=A0: Gopal Vijayaraghavan [mailto:gopal@hortonworks.com] De la part de Go= pal Vijayaraghavan Envoy=E9=A0: jeudi 21 janvier 2016 01:31 =C0=A0: user@hive.apache.org Cc=A0: Thomas Achache Objet=A0: Re: HIVE CLI does not escape \t ? > I=B9m exporting a table with Hive CLI using hive =ADf query.hql > file.ts= v=20 > Use ^A as a separator =20 ... > Maybe using an alternative SerDe could solve that? =20 Have you tried using the actual SerDe instead of the stdout formatter? INSERT OVERWRITE LOCAL DIRECTORY '...'