Return-Path: X-Original-To: apmail-drill-dev-archive@www.apache.org Delivered-To: apmail-drill-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F0FCE180BB for ; Sun, 15 Nov 2015 20:51:01 +0000 (UTC) Received: (qmail 86663 invoked by uid 500); 15 Nov 2015 20:50:56 -0000 Delivered-To: apmail-drill-dev-archive@drill.apache.org Received: (qmail 86608 invoked by uid 500); 15 Nov 2015 20:50:56 -0000 Mailing-List: contact dev-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list dev@drill.apache.org Received: (qmail 86596 invoked by uid 99); 15 Nov 2015 20:50:56 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 15 Nov 2015 20:50:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id EC7071A07AD for ; Sun, 15 Nov 2015 20:50:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.019 X-Spam-Level: X-Spam-Status: No, score=-0.019 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=dremio_com.20150623.gappssmtp.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 3nrwvJ-GSJ_8 for ; Sun, 15 Nov 2015 20:50:50 +0000 (UTC) Received: from mail-wm0-f51.google.com (mail-wm0-f51.google.com [74.125.82.51]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 248FB20271 for ; Sun, 15 Nov 2015 20:50:50 +0000 (UTC) Received: by wmdw130 with SMTP id w130so87606247wmd.0 for ; Sun, 15 Nov 2015 12:50:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dremio_com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=1cfx67NAzwSNyGjiKpNia3nDSeU58ClesJmcHthDFo8=; b=xzNRqGxUletkNXwq5NRqatbDzRU7jnS9p24FskHTiQUjcIT8qKHB3Qb6IKlVIq9Ci1 WVuHlHpJQF7Yk4aQIhPSS/9gu5sGDLMRDrWlGe3CYLFWbPj/ev1eRCo3g0nGnGuIGyRt RZX76Y002xbD+KFia6i3aXGxBDD8nKFPR5o3Yhf0kNqHuU+IMYJtcQp5qWlJOalorFiV 1M+5drz8BNjYhTFjH97I5xHMUe8H4rSh6o9mSa9noTmkYdmv288rzHUAQsEGwfoCS5pd gZlVG20IkSgieU4QIN5LdrM7awZc5NVua+v593nEyT85MlifB1lbOJ0bGx05OgDM1gd4 UHZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=1cfx67NAzwSNyGjiKpNia3nDSeU58ClesJmcHthDFo8=; b=lnyURWMLRxJJtaxBG8K6HwvmSbi0wBtYKBHwBXB+U+W3VcxbzY3Ri92IFOOwQ3JkCy l57txKkPM9OeT9Z/IZUYFj1AvAj4rduzQL+1YwCHh4baZvgYApyC43/z1ZCOq+vWQW8/ Htt+h/Vsr+CO3VUPrJCPvZDNGwzYGXpgalw5JWu7AdUMShxzgdlG4OxYgAnCTf0giobk 8d4llZ020E3klbOxkgRZrV8gs1vceNvDiXXJ1sVIGgqax5YDaN5RKzs/Ip6qtuzbvo9T ZyH/3tdWs8UKyrdVxD1qA0Pfdkljkm2qQn7vuL6KdaHnerssrQKLnMMfoZ8/z4EIxk+E 7lcQ== X-Gm-Message-State: ALoCoQkdCBuD+kjSajTsRAQw28urDnpOWxuS0GWAyFldQr/EkVftqMkAiCUwW/7y6ZvMbD8fc7sJ MIME-Version: 1.0 X-Received: by 10.194.184.164 with SMTP id ev4mr32387014wjc.19.1447620649697; Sun, 15 Nov 2015 12:50:49 -0800 (PST) Received: by 10.28.24.195 with HTTP; Sun, 15 Nov 2015 12:50:49 -0800 (PST) In-Reply-To: References: Date: Sun, 15 Nov 2015 12:50:49 -0800 Message-ID: Subject: Re: No s3 access without jars from hadoop From: Nathan Griffith To: dev@drill.apache.org Content-Type: text/plain; charset=UTF-8 For old-style s3n support you didn't need jar files from a Hadoop binary tarball --- just jets3t. So essentially someone wanting to use s3 in Drill 1.3 would need to pull down and unpack a 200 MB file just to grab a couple dependencies from it. On Sat, Nov 14, 2015 at 10:39 PM, Tomer Shiran wrote: > When you say "problem" - it seems like more work was required previously > (with s3n). Or am I misunderstanding? > > > > On Fri, Nov 13, 2015 at 9:55 AM, Nathan Griffith > wrote: > >> Hi all, >> >> Currently if you want to use s3a in Drill 1.3.0 you need to copy a >> couple files from the Hadoop binary distribution into jars/3rdparty. >> For s3n you need those *and* the old jets3t dependency. >> >> Just wanted to highlight this problem since it seems like an important >> but easy fix. The JIRA I filed about it is here: >> https://issues.apache.org/jira/browse/DRILL-4063 >> >> Best, >> Nathan >> > > > > -- > Tomer Shiran > CEO and Co-Founder, Dremio