falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1503) cluster mirroring
Date Thu, 01 Oct 2015 16:59:26 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940067#comment-14940067
] 

Peeyush Bishnoi commented on FALCON-1503:
-----------------------------------------

[~mpopa@nextpathway.com] From the doc link, I am seeing that HiveServer2 port is 10000 and
thrift server (hive.metastore.uri) port is 	9083 on BigInsights . Can you try to use this
port. 

Before running Hive DR, please read the attached README file. It is required to have Hive-1.2.0
and Oozie-4.2.0 and also update hive-site.xml appropriately on source and target HiveServer
with changes mentioned in the attached file.

{quote}
So it looks have to go the manual way, export the hive tables, distcp them to hortonworks
and re-import them.
{quote}
Yes, this is also one of the way to copy the Hive data and metadata from source to target.

> cluster mirroring 
> ------------------
>
>                 Key: FALCON-1503
>                 URL: https://issues.apache.org/jira/browse/FALCON-1503
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.6.1
>         Environment: Hortonworks 2.3 sandbox 
> BigInsights 3.0.2 sandbox
>            Reporter: mpopa
>         Attachments: README
>
>
> Hi,
> I've been trying to setup mirroring between two clusters.
> One runs BigInsights 3.0.2, the other Hortonworks 2.3.
> I'm running Falcon on the Hortonworks cluster (which is actually just a sandbox).
> I have no trouble defining the target cluster (on the localhost), but cannot define the
source
> cluster (on the remote BigInsights install).
> The problem is with the "execute" interface; I've tried a series of ports starting with
9000
> which is the default namenode, 9001, 50030.
> <interface type='execute' endpoint='bivm.ibm.com:50030' version='2.2.0'/>
> (I do have a DNS entry for bivm.ibm.com)
> The error that I get is:
> org.apache.falcon.entity.parser.ValidationException: Invalid Execute server or port:
bivm.ibm.com:50030
> It seems like this version of BIgInsights does not come with Yarn, and from what I see,
the execute interface tries to connect to yarn's port.
> Any insight (pun intended) is greatly appreciated.
> thank you in advance
> mihai popa



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message