Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of edlinuxguru@gmail.com
 designates 209.85.161.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :cc:content-type:content-transfer-encoding;
        b=EwbeuuDBkDy6A98pSvwtSSXn2/7TBaMrfkaZTSYmCdXCuqOE0M8W8AFRBspWxoddfk
         PQbXIszUQONVJ08qao/WJPI6o9YEomjRAaw2Oe9cTFg0ssL62igk+IVt1JBvTLLrRIlx
         khUAtjn4wjnd9punFvhR49oVku+1ffoVDPmTA=
MIME-Version: 1.0
In-Reply-To: <AANLkTimHXD7VfnYJUp9hNVwRKS8MgECR0ePePR0U9JAD@mail.gmail.com>
References: <AANLkTinXnpKU8V2MV+SRckyU1Qse1uWeVqfksL69f9H1@mail.gmail.com>
	<AANLkTimBb9jgPMd0s3QswnkutYTrxgX9A1Rc5cx+H_we@mail.gmail.com>
	<CAEF211396679945B969BFA0E71B43D9153020C7@sc-mbx04.TheFacebook.com>
	<AANLkTi=ag8KFw4S=c3L=fBUgdX_wpRXBKDYF+cSc8QCN@mail.gmail.com>
	<AANLkTimHXD7VfnYJUp9hNVwRKS8MgECR0ePePR0U9JAD@mail.gmail.com>
Date: Mon, 7 Feb 2011 19:30:25 -0500
Message-ID: <AANLkTi=fRxp40-sKXYuy8o_KKnGzc9ZONHnH_g7D67ox@mail.gmail.com>
Subject: Re: Safe to upgrade to Hive 0.7.0?
From: Edward Capriolo <edlinuxguru@gmail.com>
To: user@hive.apache.org
Cc: "<hive-user@hadoop.apache.org>" <hive-user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Mon, Feb 7, 2011 at 7:27 PM, Gokul Pillai <gokooltech@gmail.com> wrote:
> I have a Hadoop 0.20 cluster with Hive 0.6.
> I want to try out the ngrams functions in 0.7 (trunk) and so want to
> upgrade.
> What would you recommend. Can I have a Hive 0.7 install in a different
> location (for trial) and point it to the same cluster.
> If not, is there an upgrade utility?
> I am not concerned about existing tables. I just want to make sure I can =
run
> Hive 0.6 and Hive 0.7 side by side.
> Regards
> Gokul
>
> On Wed, Dec 8, 2010 at 9:26 AM, Edward Capriolo <edlinuxguru@gmail.com>
> wrote:
>>
>> On Wed, Dec 8, 2010 at 12:06 PM, Ning Zhang <nzhang@fb.com> wrote:
>> > These are datanucleus paramesters found in
>> > hive-default.xml/hive-site.xml. If you change them to the following th=
e
>> > metastore schema won't be changed automatically (may be good for preve=
nting
>> > accidents).
>> >
>> >
>> > <property>
>> > =A0<name>datanucleus.autoCreateSchema</name>
>> > =A0<value>false</value>
>> > </property>
>> >
>> > <property>
>> > =A0<name>datanucleus.fixedDatastore</name>
>> > =A0<value>true</value>
>> > </property>
>> >
>> >
>> > ________________________________________
>> > From: Edward Capriolo [edlinuxguru@gmail.com]
>> > Sent: Wednesday, December 08, 2010 7:19 AM
>> > To: user@hive.apache.org
>> > Cc: <hive-user@hadoop.apache.org>
>> > Subject: Re: Safe to upgrade to Hive 0.7.0?
>> >
>> > On Wed, Dec 8, 2010 at 9:55 AM, Ryan LeCompte <lecompte@gmail.com>
>> > wrote:
>> >> Hey guys,
>> >> We would like to experiment with some of the features in the current
>> >> trunk
>> >> (0.7) release. Do you think at this point it's nearing
>> >> "production-ready" ?
>> >> Are there any metastore migration scripts or anything like that befor=
e
>> >> upgrading to 0.7 from 0.6?
>> >> Thanks,
>> >> Ryan
>> >>
>> >
>> > Ryan,
>> >
>> > This is hard to say. There are many changes going in around indexing
>> > and authorization. IMHO everyone is taking a lot of care in the design
>> > however, it is still subject to change.
>> >
>> > If i were compelled to update I would spin up a new instance into a
>> > new meta-store back end. Then compare the schema of current with 0.6.X
>> > like a diff of 'show create tables'.
>> >
>> > Just an FYI. I applied two different hive trunks between 0.5 and 0.6.
>> > and I never needed the update scripts because hive happily updated the
>> > schema for me. After my final upgrade to 0.7.0 I re-ran everything in
>> > the upgrade script just to be safe. Nothing noticeably bad happened to
>> > me during the duration.
>> >
>> > I suspect many people will not need to run the update scripts since in
>> > the stock configuration hive seems to auto-update anyway. (Someone
>> > correct me if I am wrong here.) Does anyone know how to specifically
>> > which variable controls this?
>> >
>> > Edward
>> >
>>
>> https://issues.apache.org/jira/browse/HIVE-1841 -- please comment
>
>

I would not do it. The new version will attempt to update the
meta-store. I would just attempt to build n grams udf into a separate
JAR and load it up with create temporary function.