Return-Path: Delivered-To: apmail-hadoop-hive-user-archive@minotaur.apache.org Received: (qmail 14816 invoked from network); 13 Feb 2010 00:58:56 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 13 Feb 2010 00:58:56 -0000 Received: (qmail 79975 invoked by uid 500); 13 Feb 2010 00:58:56 -0000 Delivered-To: apmail-hadoop-hive-user-archive@hadoop.apache.org Received: (qmail 79947 invoked by uid 500); 13 Feb 2010 00:58:56 -0000 Mailing-List: contact hive-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-user@hadoop.apache.org Delivered-To: mailing list hive-user@hadoop.apache.org Received: (qmail 79938 invoked by uid 99); 13 Feb 2010 00:58:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Feb 2010 00:58:56 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of adam@immunet.com designates 209.85.220.225 as permitted sender) Received: from [209.85.220.225] (HELO mail-fx0-f225.google.com) (209.85.220.225) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Feb 2010 00:58:49 +0000 Received: by fxm25 with SMTP id 25so1103787fxm.32 for ; Fri, 12 Feb 2010 16:58:27 -0800 (PST) MIME-Version: 1.0 Received: by 10.223.143.21 with SMTP id s21mr2440000fau.51.1266022707169; Fri, 12 Feb 2010 16:58:27 -0800 (PST) In-Reply-To: References: <34fd060d1002112230o1085c26eo66cd6b9273afde47@mail.gmail.com> Date: Fri, 12 Feb 2010 16:58:27 -0800 Message-ID: Subject: Re: Distributing additional files for reduce scripts From: "Adam O'Donnell" To: hive-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable So when I use the add file command in amazon's hive distribution, it appears that the files get rewritten to have the s3:// url as part of the file name, so that: add file s3://bucket/module becomes s3_bucket_module. Is there any way to get the add command to refer to the file as its name without the extensions? On Fri, Feb 12, 2010 at 1:06 PM, Adam O'Donnell wrote: > I see, said the blind man. =A0Thanks! > > On Thu, Feb 11, 2010 at 10:30 PM, Zheng Shao wrote: >> add file myfile.txt; >> >> You can find some examples in *.q files in the distribution. >> >> Zheng >> >> On Thu, Feb 11, 2010 at 10:23 PM, Adam O'Donnell wrot= e: >>> Guys: >>> >>> How do you go about distributing additional files that may be needed >>> by your reduce scripts? =A0For example, I need to distribute a GeoIP >>> database with my reduce script to do some lookups. >>> >>> Thanks! >>> >>> Adam >>> >>> -- >>> Adam J. O'Donnell, Ph.D. >>> Immunet Corporation >>> Cell: +1 (267) 251-0070 >>> >> >> >> >> -- >> Yours, >> Zheng >> > > > > -- > Adam J. O'Donnell, Ph.D. > Immunet Corporation > Cell: +1 (267) 251-0070 > --=20 Adam J. O'Donnell, Ph.D. Immunet Corporation Cell: +1 (267) 251-0070