Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E342F1036B for ; Tue, 3 Dec 2013 21:09:36 +0000 (UTC) Received: (qmail 65696 invoked by uid 500); 3 Dec 2013 21:09:36 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 65667 invoked by uid 500); 3 Dec 2013 21:09:36 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 65658 invoked by uid 99); 3 Dec 2013 21:09:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Dec 2013 21:09:36 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of david.medinets@gmail.com designates 74.125.82.41 as permitted sender) Received: from [74.125.82.41] (HELO mail-wg0-f41.google.com) (74.125.82.41) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Dec 2013 21:09:31 +0000 Received: by mail-wg0-f41.google.com with SMTP id y10so6159043wgg.4 for ; Tue, 03 Dec 2013 13:09:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=LBjHoyb3nYjyAIwbxyDsURn293bPY1Gqqz/jQY46tm0=; b=fYFriqgoqldsPr12epaLyqv20Gh6Pgky2P4/tRKzufHUyjHVCYDxcJhwmZRuJ+EGhZ LJjF8RSUzQaO1ruKdDEBirWHIywRF1Kfs03lmEfIaAvlC4wQMm2RHa6x7rSxybnk6QwZ l/+F98j/nTISQmwBxlPjZ4I38nJjD53xLHdK4aNhlBAyauAt3lEmKHlvRBhNmmijHq28 7dgCy19JJmCjr/92gPUJ14v5ONO9qkOPgz0dCp5mXMpfA06T3yYfx/LpGp9j33fNokoA 3IujMrNHqDVBlWZSJYAisLMlAiwUQZH0y8+USq8YJO13QHk1+yXiAsDuOMB8A4vVOQMn zL9Q== MIME-Version: 1.0 X-Received: by 10.194.174.36 with SMTP id bp4mr59405500wjc.7.1386104950863; Tue, 03 Dec 2013 13:09:10 -0800 (PST) Received: by 10.194.83.137 with HTTP; Tue, 3 Dec 2013 13:09:10 -0800 (PST) In-Reply-To: References: Date: Tue, 3 Dec 2013 16:09:10 -0500 Message-ID: Subject: Re: clone, offline usage in map-reduce job - error in getSplits method. From: David Medinets To: accumulo-user Content-Type: multipart/alternative; boundary=089e0141a0ae37bf1f04eca7b5b4 X-Virus-Checked: Checked by ClamAV on apache.org --089e0141a0ae37bf1f04eca7b5b4 Content-Type: text/plain; charset=ISO-8859-1 Using AccumuloInputFormat.setScanOffline worked. Thanks! On Tue, Dec 3, 2013 at 1:43 PM, Keith Turner wrote: > During job setup is AccumuloInputFormat.setScanOffline called? > > > On Tue, Dec 3, 2013 at 1:34 PM, David Medinets wrote: > >> A few weeks ago there was a message or two about cloning a table then >> taking it offline before running a map-reduce job using >> AccumuloInputFormat. I'm trying to do this but have run into an issue. Here >> is the gist of my code: >> >> String table = "AA"; >> String tableClone = "AA_clone"; >> >> getTableOperations().clone(table, tableClone, true, new HashMap> String>(), new TreeSet()); >> getTableOperations().offline(tableClone); >> >> ### the rest is normal Hadoop Job setup using tableClone has the input >> table. >> >> When I run the job, I get this message: >> >> ...AA_clone is offline >> ...at ... InputFormatBase.getSplits(InputFormatBase.java:1366) >> ... >> >> Did I missing something in my job setup? >> > > --089e0141a0ae37bf1f04eca7b5b4 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Using AccumuloInputFormat.setScanOffline worked. Thanks!


On Tu= e, Dec 3, 2013 at 1:43 PM, Keith Turner <keith@deenlo.com> wr= ote:
During job setup is Accumul= oInputFormat.setScanOffline called?


On Tue, Dec 3= , 2013 at 1:34 PM, David Medinets <david.medinets@gmail.com>= wrote:
A few weeks ago there was a message or two about clo= ning a table then taking it offline before running a map-reduce job using A= ccumuloInputFormat. I'm trying to do this but have run into an issue. H= ere is the gist of my code:

String table =3D "AA";
String tableClone =3D &= quot;AA_clone";

getTableOperations().clone(table, tableCl= one, true, new HashMap<String, String>(), new TreeSet<String>()= );
getTableOperations().offline(tableClone);

### the rest i= s normal Hadoop Job setup using tableClone has the input table.

When I run the job, I get this message:

...AA_clone is offli= ne
...at ... InputFormatBase.getSplits(InputFormatBase.java:1366)
...<normal java stack>

Did I missing something in my = job setup?


--089e0141a0ae37bf1f04eca7b5b4--