falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1503) cluster mirroring
Date Thu, 01 Oct 2015 16:59:26 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940067#comment-14940067

Peeyush Bishnoi commented on FALCON-1503:

[~mpopa@nextpathway.com] From the doc link, I am seeing that HiveServer2 port is 10000 and
thrift server (hive.metastore.uri) port is 	9083 on BigInsights . Can you try to use this

Before running Hive DR, please read the attached README file. It is required to have Hive-1.2.0
and Oozie-4.2.0 and also update hive-site.xml appropriately on source and target HiveServer
with changes mentioned in the attached file.

So it looks have to go the manual way, export the hive tables, distcp them to hortonworks
and re-import them.
Yes, this is also one of the way to copy the Hive data and metadata from source to target.

> cluster mirroring 
> ------------------
>                 Key: FALCON-1503
>                 URL: https://issues.apache.org/jira/browse/FALCON-1503
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.6.1
>         Environment: Hortonworks 2.3 sandbox 
> BigInsights 3.0.2 sandbox
>            Reporter: mpopa
>         Attachments: README
> Hi,
> I've been trying to setup mirroring between two clusters.
> One runs BigInsights 3.0.2, the other Hortonworks 2.3.
> I'm running Falcon on the Hortonworks cluster (which is actually just a sandbox).
> I have no trouble defining the target cluster (on the localhost), but cannot define the
> cluster (on the remote BigInsights install).
> The problem is with the "execute" interface; I've tried a series of ports starting with
> which is the default namenode, 9001, 50030.
> <interface type='execute' endpoint='bivm.ibm.com:50030' version='2.2.0'/>
> (I do have a DNS entry for bivm.ibm.com)
> The error that I get is:
> org.apache.falcon.entity.parser.ValidationException: Invalid Execute server or port:
> It seems like this version of BIgInsights does not come with Yarn, and from what I see,
the execute interface tries to connect to yarn's port.
> Any insight (pun intended) is greatly appreciated.
> thank you in advance
> mihai popa

This message was sent by Atlassian JIRA

View raw message