Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (athena.apache.org: domain of nagarjuna.viss@gmail.com
 designates 209.85.220.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALckxSO2-Jj-nfHAsewv8uv7otfR5mnYFX4iR0BJfmAXdffwGQ@mail.gmail.com>
References: 
 <CALckxSO2-Jj-nfHAsewv8uv7otfR5mnYFX4iR0BJfmAXdffwGQ@mail.gmail.com>
Date: Tue, 2 Dec 2014 07:41:45 +0530
Message-ID: 
 <CAHwWqxiceSi6h2NjbsGuVw_=u9eXFoyyaymvvAf8FkjR0mrkHQ@mail.gmail.com>
Subject: Re: dynamic partitioning issues in hive 0.13.0
From: Nagarjuna Vissarapu <nagarjuna.viss@gmail.com>
To: user@hive.apache.org
Content-Type: multipart/alternative; boundary=20cf302ef9f8bad4590509323f84

--20cf302ef9f8bad4590509323f84
Content-Type: text/plain; charset=ISO-8859-1

Can you please check you mysql service which stores metada
On Dec 2, 2014 4:18 AM, "Viral Bajaria" <viral.bajaria@gmail.com> wrote:

> Hi,
>
> I have been running into 2 issues with dynamic partitioning queries.
>
> The query runs fine and I get errors like:
>
> *Failed with exception
> MetaException(message:javax.jdo.JDODataStoreException: Insert of object
> "org.apache.hadoop.hive.metastore.model.MPartition@5bbd373e" using
> statement "INSERT INTO `PARTITIONS`
> (`PART_ID`,`LAST_ACCESS_TIME`,`TBL_ID`,`SD_ID`,`CREATE_TIME`,`PART_NAME`)
> VALUES (?,?,?,?,?,?)" failed : Deadlock found when trying to get lock; try
> restarting transaction*
>
> Detailed exception: https://gist.github.com/vbajaria/aead8eb4597f31df4807
>
> Why would there be a deadlock on adding a new partition info to the
> metastore ? It seems weird that would even happen given that the partition
> did not even exist prior to this query run.
>
> I am thinking it could be an issue because I have 100s of such queries
> running and the INDEX on that table might be causing the issue ?
>
>
> The 2nd issue is more painful. After the 1st error mentioned above, I have
> a process which figures out what failed and then re-runs the data for that
> month. After the query finishes successfully, it ends up adding only 1
> partition instead of partition for each day in that month. If I run the
> query manually and look at the data returned then it returns data for all
> partitions, yet for some reason dynamic partition does not ad all. The
> query is an "INSERT OVERWRITE" query.
>
> In the end I have to drop all partitions for that month before re-running
> the query and then everything works fine. Without that the partitions that
> were missed on first attempt don't show up.
>
> The missing partitions are in itself a mystery.
>
> Any points on how to debug this ?
>
> Thanks,
> Viral
>
>
>

--20cf302ef9f8bad4590509323f84
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">Can you please check you mysql service which stores metada</=
p>
<div class=3D"gmail_quote">On Dec 2, 2014 4:18 AM, &quot;Viral Bajaria&quot=
; &lt;<a href=3D"mailto:viral.bajaria@gmail.com">viral.bajaria@gmail.com</a=
>&gt; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quote" styl=
e=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div di=
r=3D"ltr">Hi,<div><br></div><div>I have been running into 2 issues with dyn=
amic partitioning queries.</div><div><br></div><div>The query runs fine and=
 I get errors like:</div><div><br></div><div><div><i>Failed with exception =
MetaException(message:javax.jdo.JDODataStoreException: Insert of object &qu=
ot;org.apache.hadoop.hive.metastore.model.MPartition@5bbd373e&quot; using s=
tatement &quot;INSERT INTO `PARTITIONS` (`PART_ID`,`LAST_ACCESS_TIME`,`TBL_=
ID`,`SD_ID`,`CREATE_TIME`,`PART_NAME`) VALUES (?,?,?,?,?,?)&quot; failed : =
Deadlock found when trying to get lock; try restarting transaction</i></div=
><div><br></div></div><div>Detailed exception:=A0<a href=3D"https://gist.gi=
thub.com/vbajaria/aead8eb4597f31df4807" target=3D"_blank">https://gist.gith=
ub.com/vbajaria/aead8eb4597f31df4807</a></div><div><br></div><div>Why would=
 there be a deadlock on adding a new partition info to the metastore ? It s=
eems weird that would even happen given that the partition did not even exi=
st prior to this query run.</div><div><br></div><div>I am thinking it could=
 be an issue because I have 100s of such queries running and the INDEX on t=
hat table might be causing the issue ?</div><div><br></div><div><br></div><=
div>The 2nd issue is more painful. After the 1st error mentioned above, I h=
ave a process which figures out what failed and then re-runs the data for t=
hat month. After the query finishes successfully, it ends up adding only 1 =
partition instead of partition for each day in that month. If I run the que=
ry manually and look at the data returned then it returns data for all part=
itions, yet for some reason dynamic partition does not ad all. The query is=
 an &quot;INSERT OVERWRITE&quot; query.</div><div><br></div><div>In the end=
 I have to drop all partitions for that month before re-running the query a=
nd then everything works fine. Without that the partitions that were missed=
 on first attempt don&#39;t show up.</div><div><br></div><div>The missing p=
artitions are in itself a mystery.</div><div><br></div><div>Any points on h=
ow to debug this ?</div><div><br></div><div>Thanks,</div><div>Viral</div><d=
iv><br></div><div><br></div></div>
</blockquote></div>

--20cf302ef9f8bad4590509323f84--