Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of maghamravikiran@gmail.com
 designates 74.125.82.44 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <CE468A1D.B0A0%sanjay.subramanian@wizecommerce.com>
References: 
 <CAC06LGZGynvxNgnMxuOVYoeooPjY2GA1Ufe=2bqxoo2i2SX6gw@mail.gmail.com>
	<CE468A1D.B0A0%sanjay.subramanian@wizecommerce.com>
Date: Sat, 31 Aug 2013 11:23:55 +0530
Message-ID: 
 <CAOqmzj9NvG6QJq7arefwd93hFAfvPG5-XEfD2eA=wU6ekCVFLQ@mail.gmail.com>
Subject: Re: Hive Statistics information
From: Ravi Kiran <maghamravikiran@gmail.com>
To: user@hive.apache.org
Content-Type: multipart/alternative; boundary=f46d043892b1ed76c304e537f658

--f46d043892b1ed76c304e537f658
Content-Type: text/plain; charset=ISO-8859-1

Hi Sanjay,

   What do the logs say when you fire the ANALYZE TABLE...   statement on a
table ?
   One minor correction to the db connectionstring would be to use &amp;
for the query parameters.
hive.stats.dbconnectionstring=jdbc:mysql://
v-so1.nextagqa.com/hive_vso1_tempstatsstore?user=hive_user_vso1&amp;password=hive_user_vso1<http://v-so1.nextagqa.com/hive_vso1_tempstatsstore?&user=hive_user_vso1&password=hive_user_vso1>

I hope the database
hive_vso1_tempstatsstore<http://v-so1.nextagqa.com/hive_vso1_tempstatsstore?&user=hive_user_vso1&password=hive_user_vso1>exists
in your MySQL?

Regards
Ravi Magham


On Sat, Aug 31, 2013 at 6:15 AM, Sanjay Subramanian <
Sanjay.Subramanian@wizecommerce.com> wrote:

>  Hi guys
>
>  I have configured Hive to use MySQL for all statistics
>
>  hive.stats.atomic=false
> hive.stats.autogather=true
> hive.stats.collect.rawdatasize=true
> hive.stats.dbclass=jdbc:mysql
> hive.stats.dbconnectionstring=jdbc:mysql://
> v-so1.nextagqa.com/hive_vso1_tempstatsstore?&user=hive_user_vso1&password=hive_user_vso1
> hive.stats.jdbc.timeout=30
> hive.stats.jdbcdriver=com.mysql.jdbc.Driver
> hive.stats.retries.max=0
> hive.stats.retries.wait=3000
>
>  However in the MYSQL hive statistics tables , they don't seem to have
> any data ?
>
>  Where does Hive store the statistics information ?
>
>  sanjay
>
> CONFIDENTIALITY NOTICE
> ======================
> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
>

--f46d043892b1ed76c304e537f658
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div>Hi Sanjay,<br><br></div>=A0=A0 What do the =
logs say when you fire the ANALYZE TABLE... =A0 statement on a table ?<br>=
=A0=A0 One minor correction to the db connectionstring would be to use &amp=
;amp; for the query parameters.<br>
hive.stats.dbconnectionstring=3Djdbc:mysql://<a href=3D"http://v-so1.nextag=
qa.com/hive_vso1_tempstatsstore?&amp;user=3Dhive_user_vso1&amp;password=3Dh=
ive_user_vso1" target=3D"_blank">v-so1.nextagqa.com/hive_vso1_tempstatsstor=
e?user=3Dhive_user_vso1&amp;amp;password=3Dhive_user_vso1</a><br>
<br></div>I hope the database <a href=3D"http://v-so1.nextagqa.com/hive_vso=
1_tempstatsstore?&amp;user=3Dhive_user_vso1&amp;password=3Dhive_user_vso1" =
target=3D"_blank">hive_vso1_tempstatsstore</a> exists in your MySQL?<br><br=
></div>
Regards<br>Ravi Magham<br></div><div class=3D"gmail_extra"><br><br><div cla=
ss=3D"gmail_quote">On Sat, Aug 31, 2013 at 6:15 AM, Sanjay Subramanian <spa=
n dir=3D"ltr">&lt;<a href=3D"mailto:Sanjay.Subramanian@wizecommerce.com" ta=
rget=3D"_blank">Sanjay.Subramanian@wizecommerce.com</a>&gt;</span> wrote:<b=
r>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">


<div style=3D"font-size:14px;font-family:Calibri,sans-serif;word-wrap:break=
-word">
<div>Hi guys=A0</div>
<div><br>
</div>
<div>I have configured Hive to use MySQL for all statistics=A0</div>
<div><br>
</div>
<div>
<div>hive.stats.atomic=3Dfalse</div>
<div>hive.stats.autogather=3Dtrue</div>
<div>hive.stats.collect.rawdatasize=3Dtrue</div>
<div>hive.stats.dbclass=3Djdbc:mysql</div>
<div>hive.stats.dbconnectionstring=3Djdbc:mysql://<a href=3D"http://v-so1.n=
extagqa.com/hive_vso1_tempstatsstore?&amp;user=3Dhive_user_vso1&amp;passwor=
d=3Dhive_user_vso1" target=3D"_blank">v-so1.nextagqa.com/hive_vso1_tempstat=
sstore?&amp;user=3Dhive_user_vso1&amp;password=3Dhive_user_vso1</a></div>

<div>hive.stats.jdbc.timeout=3D30</div>
<div>hive.stats.jdbcdriver=3Dcom.mysql.jdbc.Driver</div>
<div>hive.stats.retries.max=3D0</div>
<div>hive.stats.retries.wait=3D3000</div>
</div>
<div><br>
</div>
<div>However in the MYSQL hive statistics tables , they don&#39;t seem to h=
ave any data ?</div>
<div><br>
</div>
<div>Where does Hive store the statistics information ?</div>
<div><br>
</div>
<div>sanjay=A0</div>
<br>
<div style=3D"font-size:7.5pt;font-family:&#39;arial&#39;,sans-serif;line-h=
eight:10pt">CONFIDENTIALITY NOTICE<br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
This email message and any attachments are for the exclusive use of the int=
ended recipient(s) and may contain confidential and privileged information.=
 Any unauthorized review, use, disclosure or distribution is prohibited. If=
 you are not the intended recipient,
 please contact the sender by reply email and destroy all copies of the ori=
ginal message along with any attachments, from your computer system. If you=
 are the intended recipient, please be advised that the content of this mes=
sage is subject to access, review
 and disclosure by the sender&#39;s Email System Administrator.<br>
</div>
</div>

</blockquote></div><br></div>

--f46d043892b1ed76c304e537f658--