Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E22BF18F6A for ; Thu, 28 May 2015 08:51:25 +0000 (UTC) Received: (qmail 41431 invoked by uid 500); 28 May 2015 08:51:25 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 41357 invoked by uid 500); 28 May 2015 08:51:25 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 41346 invoked by uid 99); 28 May 2015 08:51:25 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 May 2015 08:51:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 4E8CAC0B79 for ; Thu, 28 May 2015 08:51:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 4S7hLRo5rCCO for ; Thu, 28 May 2015 08:51:14 +0000 (UTC) Received: from mail-ig0-f171.google.com (mail-ig0-f171.google.com [209.85.213.171]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id BA68A24CDF for ; Thu, 28 May 2015 08:51:13 +0000 (UTC) Received: by igbyr2 with SMTP id yr2so106639575igb.0 for ; Thu, 28 May 2015 01:51:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=l5RR/YtkNSfLVD+WNg+SDp8Eio1ywjNJKhtSUKqj6Fk=; b=hvkcuzqmsp+4ORRLKF/Iov+V3iKFVwQ1z0h2fV+gjdXxk06alJDkKND7DFcYsGHK0G Fk1POz4T72yYKCgauXMuprbpLAFSWeCjFMBamJQOQga+5kMFQeswSKhagLmik9dPnu0l ou9L+vGucVr9wLnpOSEV4NdFnJDeYh0Ci57Mk3iKa2HcnZNQfTTpyWm4hBoVglosn9vo 0rVcJqjTtaZTDIxd8sDnlq8NAjnwfaNnJV2TrrtT1UcdoKV9M6JaP8s+xYD8R0ZwwlnX 4orlv8AB+Fg98fU0Z9xcWtRpOGQL/SKpdYe2WPxvf0UFolfZWI6R8q8eU1x0oHWjYBuJ whTg== MIME-Version: 1.0 X-Received: by 10.42.154.201 with SMTP id r9mr8398455icw.77.1432803073076; Thu, 28 May 2015 01:51:13 -0700 (PDT) Sender: ewenstephan@gmail.com Received: by 10.64.241.230 with HTTP; Thu, 28 May 2015 01:51:13 -0700 (PDT) In-Reply-To: <5566CE69.5070706@neofonie.de> References: <5566CE69.5070706@neofonie.de> Date: Thu, 28 May 2015 10:51:13 +0200 X-Google-Sender-Auth: PjzzbmY5AaVVcnr4aym8V_GiyjM Message-ID: Subject: Re: Read HBase release-0.8.1 From: Stephan Ewen To: user@flink.apache.org Content-Type: multipart/alternative; boundary=90e6ba6e82da348005051720768c --90e6ba6e82da348005051720768c Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I am not an HBase expert. How does HBase find the hbase-site.xml? Does it simply search through the classpath? If it uses the classpath, can you see what hbase-site.xml is used? - In your user code, you can do a getClass().getClassloader().gerResource("hbase-site.xml") and see where it is? - Can you do the same with ClassLoader.getSystemClassLoader().getResource("hbase-site.xml") and see if that returns something different? Thanks, Stephan On Thu, May 28, 2015 at 10:14 AM, Hilmi Yildirim wrote: > Hi, > I used release-0.8.1for Hadoop 2 to read from HBase. For that I placed my > hbase-site.xml with the correct configurations into the resource folder. > When I start the job locally then the job uses the config inside the > hbase-site.xml and it works great. When I want to run the job on a cluste= r > then the job uses the default hbase config instead of the config defined = in > the hbase-site.xml. The hbase-site.xml is included in the fat jar. To sta= rt > the job I use the web interace. > > Best Regards, > > -- > -- > Hilmi Yildirim > Software Developer R&D > > T: +49 30 24627-281 > Hilmi.Yildirim@neofonie.de > > http://www.neofonie.de > > Besuchen Sie den Neo Tech Blog f=C3=BCr Anwender: > http://blog.neofonie.de/ > > Folgen Sie uns: > https://plus.google.com/+neofonie > http://www.linkedin.com/company/neofonie-gmbh > https://www.xing.com/companies/neofoniegmbh > > Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin > Handelsregister Berlin-Charlottenburg: HRB 67460 > Gesch=C3=A4ftsf=C3=BChrung: Thomas Kitlitschko > > --90e6ba6e82da348005051720768c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I am not an HBase expert. How does HBase find the hbase-si= te.xml? Does it simply search through the classpath?=C2=A0

If it uses the classpath, can you see what hbase-site.xml is used?
=
=C2=A0 - In your user code, you can do a getClass().getClassloader().g= erResource("hbase-site.xml") and see where it is?
=C2= =A0 - Can you do the same with ClassLoader.getSystemClassLoader().getResour= ce("hbase-site.xml") and see if that returns something different?=


Thanks,
Stephan


On Thu, May 28, 2015 at 10:14 AM, Hilmi Yildirim <hilmi.yildirim= @neofonie.de> wrote:
Hi, I used release-0.8.1for Hadoop 2 to read from HBase. For that I placed my h= base-site.xml with the correct configurations into the resource folder. Whe= n I start the job locally then the job uses the config inside the hbase-sit= e.xml and it works great. When I want to run the job on a cluster then the = job uses the default hbase config instead of the config defined in the hbas= e-site.xml. The hbase-site.xml is included in the fat jar. To start the job= I use the web interace.

Best Regards,

--
--
Hilmi Yildirim
Software Developer R&D

T: +49 30 24627-281
Hilmi.Yildi= rim@neofonie.de

http://www.neofonie.de=

Besuchen Sie den Neo Tech Blog f=C3=BCr Anwender:
http://blog.neofonie= .de/

Folgen Sie uns:
https://plu= s.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
h= ttps://www.xing.com/companies/neofoniegmbh

Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Gesch=C3=A4ftsf=C3=BChrung: Thomas Kitlitschko


--90e6ba6e82da348005051720768c--