Mailing-List: contact dev-help@falcon.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@falcon.incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of sriksun@hotmail.com designates
 65.55.116.80 as permitted sender)
Message-ID: <BLU179-W8B78D817D354A3693A6CFA4500@phx.gbl>
Content-Type: multipart/alternative;
	boundary="_e8913fbc-d1dd-4589-905d-3cc8a3b2471e_"
From: Srikanth Sundarrajan <sriksun@hotmail.com>
To: "dev@falcon.incubator.apache.org" <dev@falcon.incubator.apache.org>
Subject: RE: Hive Tables as Falcon Feed Input Error
Date: Tue, 15 Apr 2014 18:04:43 +0530
Importance: Normal
In-Reply-To: <ab0c5eeb796c41f1b42b6f09c6ddfd32@MBX1.impetus.co.in>
References: 
 <34d3ca1efb094318a8f4305c1fb3b802@MBX1.impetus.co.in>,<b6fcf9d4c7b446728885c24ee4ae3511@MBX1.impetus.co.in>,<BLU179-W112C1F93B3B74B12045AC0A4500@phx.gbl>,<ab0c5eeb796c41f1b42b6f09c6ddfd32@MBX1.impetus.co.in>
MIME-Version: 1.0

--_e8913fbc-d1dd-4589-905d-3cc8a3b2471e_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

I would suspect that Oozie has issues connecting to the hive metastore whil=
e determining availability of instance. Some logs might help nail down the =
issue.
RegardsSrikanth Sundarrajan

> From: suniln.kumar@impetus.co.in
> To: dev@falcon.incubator.apache.org
> Subject: RE: Hive Tables as Falcon Feed Input Error
> Date: Tue=2C 15 Apr 2014 12:29:29 +0000
>=20
> Hi Srikanth=2C
> It is still in waiting state at oozie.
>=20
>=20
> Thanks and Regard.
> Sunil Kumar
>=20
>=20
> -----Original Message-----
> From: Srikanth Sundarrajan [mailto:sriksun@hotmail.com]
> Sent: Tuesday=2C April 15=2C 2014 5:53 PM
> To: dev@falcon.incubator.apache.org
> Subject: RE: Hive Tables as Falcon Feed Input Error
>=20
> Hi Sunil=2C    Can you confirm if the process has kicked off in hadoop or=
 is it still in PREP / WAITING state in oozie ?
> RegardsSrikanth Sundarrajan
>=20
> > From: suniln.kumar@impetus.co.in
> > To: dev@falcon.incubator.apache.org
> > Subject: RE: Hive Tables as Falcon Feed Input Error
> > Date: Tue=2C 15 Apr 2014 06:37:01 +0000
> >
> > Hi=2C
> > I am able to resolve Feed definition issue for the Hive tables. It is m=
andatory to have Hive partition for you hive tables and it also needs to bu=
ild Oozie with the Hive and Hcatalog jars. Please refer to below blog for b=
uilding oozie with Hive Dependencies:
> > http://blog.nanthrax.net/2014/03/hadoop-cdc-and-processes-notification
> > -with-apache-falcon-apache-activemq-and-apache-camel/
> >
> >
> > But now I am facing issue with the Process execution of falcon for the =
Hive tables. It remain running state from last 18 hours . Not sure what is =
the issue . can somebody help me to resolve this.
> >
> >  Following is the process definition of the Hive process I have created=
 :
> > <?xml version=3D"1.0" encoding=3D"UTF-8"?> <process name=3D"hiveprocess=
2"
> > xmlns=3D"uri:falcon:process:0.1">
> >     <clusters>
> >         <cluster name=3D"demoClsHive1">
> >             <validity end=3D"2014-04-22T00:00Z" start=3D"2014-04-01T00:=
00Z"/>
> >         </cluster>
> >     </clusters>
> >
> >     <parallel>1</parallel>
> >     <order>FIFO</order>
> >     <frequency>days(1)</frequency>
> >     <timezone>UTC</timezone>
> >
> >     <inputs>
> >         <input end=3D"today(0=2C0)" start=3D"today(0=2C0)" feed=3D"rese=
rvation2" name=3D"input"/>
> >     </inputs>
> >
> >     <outputs>
> >         <output instance=3D"now(0=2C0)" feed=3D"reservationmale2" name=
=3D"output"/>
> >     </outputs>
> >
> >     <properties>
> >         <property name=3D"queueName" value=3D"default"/>
> >     </properties>
> >
> >     <workflow engine=3D"hive" path=3D"/falcon/hive_run/script.hql"/>
> >
> >     <retry policy=3D"periodic" delay=3D"minutes(10)" attempts=3D"3"/>
> >
> >     <late-process policy=3D"exp-backoff" delay=3D"hours(2)">
> >         <late-input input=3D"input" workflow-path=3D"/falcon/hive_run/"=
/>
> >     </late-process>
> > </process>
> >
> >
> >
> >
> > -----Original Message-----
> > From: Sunil N Kumar
> > Sent: Monday=2C April 14=2C 2014 12:58 PM
> > To: dev@falcon.incubator.apache.org
> > Subject: Hive Tables as Falcon Feed Input Error
> >
> > Hi=2C
> >
> > I am trying to build sample around executing Hive Script as part of Fal=
con Oozie Process. I have created two tables in the Hive and want to join d=
ata from these tables and put data into third Hive table using falcon Proce=
ss. But I am not able to submit Input feed into Falcon Server. I am using F=
alcon 0.4 release.
> >
> >
> >
> > Input Feed XML:
> >
> > <?xml version=3D"1.0" encoding=3D"UTF-8"?>
> >
> > <feed description=3D"clicks log table " name=3D"input-table"
> > xmlns=3D"uri:falcon:feed:0.1">
> >
> >     <frequency>hours(1)</frequency>
> >
> >     <timezone>UTC</timezone>
> >
> >     <late-arrival cut-off=3D"hours(3)"/>
> >
> >
> >
> >     <clusters>
> >
> >         <cluster name=3D"demoClsHive">
> >
> >             <validity start=3D"2010-01-01T00:00Z"
> > end=3D"2012-04-21T00:00Z"/>
> >
> >             <retention limit=3D"hours(24)" action=3D"delete"/>
> >
> >         </cluster>
> >
> >     </clusters>
> >
> >
> >
> >     <table uri=3D"catalog:default:reservationnew:gender=3D'Male'" />
> >
> >
> >
> >     <ACL owner=3D"cloud" group=3D"cloud" permission=3D"0x755"/>
> >
> >     <schema location=3D"hcat" provider=3D"hcat"/>
> >
> > </feed>
> >
> >
> >
> > Error:
> >
> > [cloud@Impetus-942 falcon-distributed-0.4-incubating]$ bin/falcon
> > entity -submit -type feed -file examples/entity/in-feed.xml
> >
> > Error: java.net.URISyntaxException: URI path is not in expected format:=
 database:table: catalog:default:reservationnew:gender=3D'Male'
> >
> > ________________________________
> >
> >
> >
> >
> >
> >
> > NOTE: This message may contain information that is confidential=2C prop=
rietary=2C privileged or otherwise protected by law. The message is intende=
d solely for the named addressee. If received in error=2C please destroy an=
d notify the sender. Any use of this email is prohibited when received in e=
rror. Impetus does not represent=2C warrant and/or guarantee=2C that the in=
tegrity of this communication has been maintained nor that the communicatio=
n is free of errors=2C virus=2C interception or interference.
> >
> > ________________________________
> >
> >
> >
> >
> >
> >
> > NOTE: This message may contain information that is confidential=2C prop=
rietary=2C privileged or otherwise protected by law. The message is intende=
d solely for the named addressee. If received in error=2C please destroy an=
d notify the sender. Any use of this email is prohibited when received in e=
rror. Impetus does not represent=2C warrant and/or guarantee=2C that the in=
tegrity of this communication has been maintained nor that the communicatio=
n is free of errors=2C virus=2C interception or interference.
>=20
>=20
> ________________________________
>=20
>=20
>=20
>=20
>=20
>=20
> NOTE: This message may contain information that is confidential=2C propri=
etary=2C privileged or otherwise protected by law. The message is intended =
solely for the named addressee. If received in error=2C please destroy and =
notify the sender. Any use of this email is prohibited when received in err=
or. Impetus does not represent=2C warrant and/or guarantee=2C that the inte=
grity of this communication has been maintained nor that the communication =
is free of errors=2C virus=2C interception or interference.
 		 	   		  =

--_e8913fbc-d1dd-4589-905d-3cc8a3b2471e_--