Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=yOacXdUAS0zX9Fe9gIFoB95ve0cMXqMKjOUtzaLBPltLHc8JGNTodNjcPD+u41JfYbSXRxUVAWQg6ruXXM7pfTEHqrjwzqlHeL11OjuhHOnzq6B8vG3Fw3e/iIZURBwOm4Tc+JM5XJh7rPl5sjpBB0NktUYds42htBspCs3L49I=;
References: 
 <CAJ-d8XeGewFJW0zqhBgu05F5TOMWSHyXf2PeRALLJ7bY1sN+-g@mail.gmail.com>
Message-ID: <1334934771.46854.YahooMailNeo@web121203.mail.ne1.yahoo.com>
Date: Fri, 20 Apr 2012 08:12:51 -0700 (PDT)
From: Bejoy Ks <bejoy_ks@yahoo.com>
Reply-To: Bejoy Ks <bejoy_ks@yahoo.com>
Subject: Re: How you manage inserts into dynamic partitions
To: "user@hive.apache.org" <user@hive.apache.org>
In-Reply-To: 
 <CAJ-d8XeGewFJW0zqhBgu05F5TOMWSHyXf2PeRALLJ7bY1sN+-g@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="1087320363-811728659-1334934771=:46854"

--1087320363-811728659-1334934771=:46854
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Jagat=0A=A0 =A0 =A0Hive has a beautiful functionality for doing so, Dynamic=
 Partition Insert.=0AMore details:=0Ahttps://cwiki.apache.org/Hive/dynamicp=
artitions.html=0A=0A=0ARegards=0ABejoy KS=0A=0A=0A_________________________=
_______=0A From: Jagat <jagatsingh@gmail.com>=0ATo: user@hive.apache.org =
=0ASent: Friday, April 20, 2012 8:38 PM=0ASubject: How you manage inserts i=
nto dynamic partitions=0A =0A=0AHello Everyone ,=0A=0AWe have a pig based E=
TL process and output of those are processed csv files.=0A=0ANow just want =
to learn about best practices on how you guys insert the data in dynamicall=
y generated partitions , do you use some shell script ? or some other utili=
ty to do the insertion ?=0A=0AHow you handle situations like a csv having d=
ata which should go to two separate partitions in hive ? Do you use Pig spi=
lt to do this kind of division or outside pig.=0A=0AJust curious to know be=
st practices to handle insertion into dynamic partitions , when data has be=
en partitioned on time factor ( e,g Month , Week , Day etc)=0A=0AHave a gre=
at weekend ahead,=0A=0AThanks and Regards,=0A=0AJagat Singh
--1087320363-811728659-1334934771=:46854
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

<html><body><div style=3D"color:#000; background-color:#fff; font-family:ve=
rdana, helvetica, sans-serif;font-size:10pt"><div style=3D"font-family: ver=
dana, helvetica, sans-serif; font-size: 10pt; "><span>Jagat</span></div><di=
v style=3D"font-family: verdana, helvetica, sans-serif; font-size: 10pt; ">=
<span>&nbsp; &nbsp; &nbsp;Hive has a beautiful functionality for doing so, =
Dynamic Partition Insert.</span></div><div style=3D"font-family: verdana, h=
elvetica, sans-serif; font-size: 10pt; "><span>More details:</span></div><d=
iv><span><font size=3D"2">https://cwiki.apache.org/Hive/dynamicpartitions.h=
tml</font><br></span></div><div><span><font size=3D"2"><br></font></span></=
div><div><span><font size=3D"2">Regards</font></span></div><div><span><font=
 size=3D"2">Bejoy KS</font></span></div><div style=3D"font-family: verdana,=
 helvetica, sans-serif; font-size: 10pt; "><br></div>  <div style=3D"font-s=
ize: 10pt; font-family: verdana, helvetica, sans-serif; "> <div style=3D"fo=
nt-size: 12pt;
 font-family: 'times new roman', 'new york', times, serif; "> <div dir=3D"l=
tr"> <font size=3D"2" face=3D"Arial"> <hr size=3D"1">  <b><span style=3D"fo=
nt-weight:bold;">From:</span></b> Jagat &lt;jagatsingh@gmail.com&gt;<br> <b=
><span style=3D"font-weight: bold;">To:</span></b> user@hive.apache.org <br=
> <b><span style=3D"font-weight: bold;">Sent:</span></b> Friday, April 20, =
2012 8:38 PM<br> <b><span style=3D"font-weight: bold;">Subject:</span></b> =
How you manage inserts into dynamic partitions<br> </font> </div> <br>=0A<m=
eta http-equiv=3D"x-dns-prefetch-control" content=3D"off"><div id=3D"yiv132=
388306">Hello Everyone ,<br><br>We have a pig based ETL process and output =
of those are processed csv files.<br><br>Now just want to learn about best =
practices on how you guys insert the data in dynamically generated partitio=
ns , do you use some shell script ? or some other utility to do the inserti=
on ?<br>=0A<br>How you handle situations like a csv having data which shoul=
d go to two separate partitions in hive ? Do you use Pig spilt to do this k=
ind of division or outside pig.<br><br>Just curious to know best practices =
to handle insertion into dynamic partitions , when data has been partitione=
d on time factor ( e,g Month , Week , Day etc)<br>=0A<br>Have a great weeke=
nd ahead,<br><br>Thanks and Regards,<br><br>Jagat Singh<br>=0A</div><meta h=
ttp-equiv=3D"x-dns-prefetch-control" content=3D"on"><br><br> </div> </div> =
 </div></body></html>
--1087320363-811728659-1334934771=:46854--