Return-Path: X-Original-To: apmail-camel-users-archive@www.apache.org Delivered-To: apmail-camel-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 966E417689 for ; Thu, 7 May 2015 15:34:09 +0000 (UTC) Received: (qmail 91296 invoked by uid 500); 7 May 2015 15:34:09 -0000 Delivered-To: apmail-camel-users-archive@camel.apache.org Received: (qmail 91252 invoked by uid 500); 7 May 2015 15:34:09 -0000 Mailing-List: contact users-help@camel.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@camel.apache.org Delivered-To: mailing list users@camel.apache.org Received: (qmail 91231 invoked by uid 99); 7 May 2015 15:34:08 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 May 2015 15:34:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 6E3ABC009B for ; Thu, 7 May 2015 15:34:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.98 X-Spam-Level: ** X-Spam-Status: No, score=2.98 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id AtXjxht6Oxfa for ; Thu, 7 May 2015 15:34:01 +0000 (UTC) Received: from mail-la0-f46.google.com (mail-la0-f46.google.com [209.85.215.46]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id AB326215CA for ; Thu, 7 May 2015 15:34:00 +0000 (UTC) Received: by lagv1 with SMTP id v1so33462830lag.3 for ; Thu, 07 May 2015 08:34:00 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=B89nT/qv2z4XDutdtmLVPo5XsY0PMUu8t6QkOSyZHAI=; b=Rf2t8jLwYQNdOzzsj/SwRai3qZ5BPYlE2qFNJvkfv7yG36G89nNUHp62eFiMFJzYHc mVjJscRxQpX+4DNVzDBP3gC71DVenEV5ySz0qHN06B4BrafM5jAOjCgiV6hZUj3g79HG AoVmVQSLiKCNQwlTVKtW7de5tI5FjZpgq8vziW1iQpd40dv692tAQS6oIc076pyxwx8T RdoAm5SErNO1J903ANRD8BUicR6AXP4iS1RY2eMCFFj0TBRhfoNW9ZdkyDoLpl/w8SN6 cked8f2j9ILpwEXddOvpH0L92aezTATb2kYr/tPAA6JMn55xllKZTij6+UDYfGviaqVo fvYg== X-Gm-Message-State: ALoCoQlMrzMVZtmnXkLnC7ysCdgAzD8mY/L47Zq/3epBggS2vTILKavs64hhVctp1qa8CUbAnYOf MIME-Version: 1.0 X-Received: by 10.112.225.43 with SMTP id rh11mr3550017lbc.90.1431012840130; Thu, 07 May 2015 08:34:00 -0700 (PDT) Received: by 10.112.37.138 with HTTP; Thu, 7 May 2015 08:34:00 -0700 (PDT) In-Reply-To: References: Date: Thu, 7 May 2015 18:34:00 +0300 Message-ID: Subject: Re: Use hdfs2 component in Hadoop HA mode From: "Karpov, Ilya" To: users@camel.apache.org Content-Type: multipart/alternative; boundary=001a113482c0015e5b05157fa4e7 --001a113482c0015e5b05157fa4e7 Content-Type: text/plain; charset=UTF-8 Finally I figured out what was wrong: my hdfs-site.xml config was :) In case anybody will meet this problem and find this email, minimal conf is as follows: 1. use hdfs2://mycluster:8020/dir?opts 2. put hdfs-site.xml in classpath 3. minimal hdfs-site.xml content for HA: dfs.nameservices mycluster dfs.ha.namenodes.mycluster nn1,nn2 dfs.namenode.rpc-address.mycluster.nn1 nn1-host1:8020 dfs.namenode.rpc-address.mycluster.nn2 nn1-host2:8020 dfs.client.failover.proxy.provider.mycluster org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider 2015-05-07 17:16 GMT+03:00 Grzegorz Grzybek : > > please create JIRA issue, I'll investigate it then. > > regards > Grzegorz Grzybek > > 2015-05-07 14:55 GMT+02:00 Karpov, Ilya : > > > Hi guys, > > I can't find a way to use camel-hdfs2 component for Hadoop in HA mode. > > I set my ha configuration in core-site.xml and hdfs-site.xml and put them > > in classpath, set nameservice name instead of host in hdfs2 endpoint uri, > > finally - no luck. > > > > Is this feature supported in any way? > > -- > > *Ilya Karpov* > > Developer > > > > CleverDATA > > make your data clever > > -- Ilya Karpov Developer CleverDATA make your data clever --001a113482c0015e5b05157fa4e7--