Return-Path: 
 <user-return-4603-apmail-hadoop-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id A68ACE938
	for <apmail-hadoop-user-archive@minotaur.apache.org>;
 Fri, 25 Jan 2013 06:18:31 +0000 (UTC)
Received: (qmail 64865 invoked by uid 500); 25 Jan 2013 06:18:26 -0000
Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org
Received: (qmail 64525 invoked by uid 500); 25 Jan 2013 06:18:25 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 64496 invoked by uid 99); 25 Jan 2013 06:18:24 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 25 Jan 2013 06:18:24 +0000
X-ASF-Spam-Status: No, hits=1.7 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of nitinpawar432@gmail.com
 designates 209.85.128.173 as permitted sender)
Received: from [209.85.128.173] (HELO mail-ve0-f173.google.com)
 (209.85.128.173)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 25 Jan 2013 06:18:18 +0000
Received: by mail-ve0-f173.google.com with SMTP id b10so9200vea.18
        for <user@hadoop.apache.org>; Thu, 24 Jan 2013 22:17:57 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:x-received:in-reply-to:references:date:message-id
         :subject:from:to:content-type;
        bh=tOOCUa2mgn6z1qY2DJGUKY+TO1AzliiacXuwtrph13c=;
        b=zhLgkNpQJuFWT4IMP0mu1epEH7byqO1vJEda9otvWgMn2jlxY1bFY9NYMbWMNPsCjn
         eO+OjOYFFersm7CqF+5DRl+/dqBsmSkU/OVc0OohHOKJG0XFCpLdPf9kRE8H8CJtxzzn
         uzzGHraQyNg3/vYG22QxPk4J/jAUdvoJI4IxQiS0qDUGXUE37XCcuCZngRr/t9KaI/Yp
         v8kFHIgVV/PHAu6i8MNLg/icXQAI3QR4YLDPfr04rBfb41Ot1FlZvmoGksK6tnxw/hET
         16HPEQKRq3ozKPhxNxHZY2lKjLqQbMu86vVUTFNQzXjRaNbBjH2mjZ2QbMEjAP7Zbr8I
         GP2g==
MIME-Version: 1.0
X-Received: by 10.52.74.33 with SMTP id q1mr4317564vdv.36.1359094677545; Thu,
 24 Jan 2013 22:17:57 -0800 (PST)
Received: by 10.59.9.67 with HTTP; Thu, 24 Jan 2013 22:17:57 -0800 (PST)
In-Reply-To: 
 <CANx3uAhF8kO0WTaYzqhtmVfz45FODyLzAT++mfiLy2rU-o-bvg@mail.gmail.com>
References: 
 <CANx3uAhF8kO0WTaYzqhtmVfz45FODyLzAT++mfiLy2rU-o-bvg@mail.gmail.com>
Date: Fri, 25 Jan 2013 11:47:57 +0530
Message-ID: 
 <CAORpBsgNrUeFpZE5LAknXsZ639TLzZpk3xCkV0NB82gE=me7fQ@mail.gmail.com>
Subject: Re: UTF16
From: Nitin Pawar <nitinpawar432@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf307f346078a29004d416e32b
X-Virus-Checked: Checked by ClamAV on apache.org

--20cf307f346078a29004d416e32b
Content-Type: text/plain; charset=ISO-8859-1

hive by default supports utf-8

I am not sure about utf-16
you can refer to this https://issues.apache.org/jira/browse/HIVE-2859


On Fri, Jan 25, 2013 at 10:23 AM, Koert Kuipers <koert@tresata.com> wrote:

> is it safe to upload UTF16 encoded (unicode) text files to hadoop for
> processing by map-reduce, hive, pig, etc?
> thanks! koert
>



-- 
Nitin Pawar

--20cf307f346078a29004d416e32b
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">hive by default supports utf-8=A0<div><br></div><div style=
>I am not sure about utf-16=A0</div><div style>you can refer to this=A0<a h=
ref=3D"https://issues.apache.org/jira/browse/HIVE-2859">https://issues.apac=
he.org/jira/browse/HIVE-2859</a></div>
</div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Fri,=
 Jan 25, 2013 at 10:23 AM, Koert Kuipers <span dir=3D"ltr">&lt;<a href=3D"m=
ailto:koert@tresata.com" target=3D"_blank">koert@tresata.com</a>&gt;</span>=
 wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><font face=3D"courier new,monospace">is it s=
afe to upload UTF16 encoded (unicode) text files to hadoop for processing b=
y map-reduce, hive, pig, etc?<br>
thanks! koert<br></font>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Nitin Pawar<=
br>
</div>

--20cf307f346078a29004d416e32b--