falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Pathak (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-2011) Document for creating cluster entity using
Date Mon, 06 Jun 2016 12:26:21 GMT

     [ https://issues.apache.org/jira/browse/FALCON-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rahul Pathak updated FALCON-2011:
---------------------------------
    Description: 
I have tried below cluster entity definitions without any success:

For source cluster one at a time:
interface type="execute" endpoint="src-resourceManager1:8050"
interface type="execute" endpoint="src-resourceManager2:8050"
interface type="execute" endpoint="src-resourceManager1:8032"
interface type="execute" endpoint="src-resourceManager2:8032"

On target cluster one at a time:
interface type="execute" endpoint="tgt-resourceManager1:8050"
interface type="execute" endpoint="tgt-resourceManager2:8050"
interface type="execute" endpoint="tgt-resourceManager1:8032"
interface type="execute" endpoint="tgt-resourceManager2:8032"

With different combination of below on target oozie server
{code}
 <name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
      <value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8050=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8050=/etc/src_hadoop/conf</value>

      <description> 

{code}

*And*

{code}
<name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
      <value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8032=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8032=/etc/src_hadoop/conf</value>

      <description> 
{code}

I get below oozie exception while running table-export 

{code}
JA009: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name
and the correspond server addresses
{code}

However it has worked fine before enabling HA on both the clusters.

  was:
I have tried below settings without any success:

On source cluster one at a time:
interface type="execute" endpoint="src-resourceManager1:8050"
interface type="execute" endpoint="src-resourceManager2:8050"
interface type="execute" endpoint="src-resourceManager1:8032"
interface type="execute" endpoint="src-resourceManager2:8032"

On target cluster one at a time:
interface type="execute" endpoint="tgt-resourceManager1:8050"
interface type="execute" endpoint="tgt-resourceManager2:8050"
interface type="execute" endpoint="tgt-resourceManager1:8032"
interface type="execute" endpoint="tgt-resourceManager2:8032"

With different combination of below on target oozie server
{code}
 <name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
      <value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8050=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8050=/etc/src_hadoop/conf</value>

      <description> 

{code}

*And*

{code}
<name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
      <value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8032=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8032=/etc/src_hadoop/conf</value>

      <description> 


{code}


> Document for creating cluster entity using 
> -------------------------------------------
>
>                 Key: FALCON-2011
>                 URL: https://issues.apache.org/jira/browse/FALCON-2011
>             Project: Falcon
>          Issue Type: Task
>          Components: client, docs
>    Affects Versions: 0.6.1
>         Environment: Hortonworks 2.3.4 as source and target cluster(2 different clusters).

> HA enabled for both RM and NN in both the clusters.
> Trying to implement https://falcon.apache.org/HiveIntegration.html
>            Reporter: Rahul Pathak
>            Priority: Blocker
>              Labels: documentation
>
> I have tried below cluster entity definitions without any success:
> For source cluster one at a time:
> interface type="execute" endpoint="src-resourceManager1:8050"
> interface type="execute" endpoint="src-resourceManager2:8050"
> interface type="execute" endpoint="src-resourceManager1:8032"
> interface type="execute" endpoint="src-resourceManager2:8032"
> On target cluster one at a time:
> interface type="execute" endpoint="tgt-resourceManager1:8050"
> interface type="execute" endpoint="tgt-resourceManager2:8050"
> interface type="execute" endpoint="tgt-resourceManager1:8032"
> interface type="execute" endpoint="tgt-resourceManager2:8032"
> With different combination of below on target oozie server
> {code}
>  <name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
>       <value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8050=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8050=/etc/src_hadoop/conf</value>

>       <description> 
> {code}
> *And*
> {code}
> <name>oozie.service.HadoopAccessorService.hadoop.configurations</name> 
>       <value>*=/etc/hadoop/conf,src-namenode1:8020=/etc/src_hadoop/conf,src-resourceManager1:8032=/etc/src_hadoop/conf,src-namenode2:8020=/etc/src_hadoop/conf,src-resourceManager2:8032=/etc/src_hadoop/conf</value>

>       <description> 
> {code}
> I get below oozie exception while running table-export 
> {code}
> JA009: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name
and the correspond server addresses
> {code}
> However it has worked fine before enabling HA on both the clusters.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message