Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6BD4A11F5D for ; Sat, 23 Aug 2014 04:09:38 +0000 (UTC) Received: (qmail 65913 invoked by uid 500); 23 Aug 2014 04:09:38 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 65864 invoked by uid 500); 23 Aug 2014 04:09:38 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 65854 invoked by uid 99); 23 Aug 2014 04:09:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 23 Aug 2014 04:09:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of cjnolet@gmail.com designates 209.85.223.178 as permitted sender) Received: from [209.85.223.178] (HELO mail-ie0-f178.google.com) (209.85.223.178) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 23 Aug 2014 04:09:32 +0000 Received: by mail-ie0-f178.google.com with SMTP id rd18so7524000iec.37 for ; Fri, 22 Aug 2014 21:09:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=cR6o7pCWxwG/FhwKx+YfhdJFdFBwZHBBz3V/BPqTwO8=; b=DE94Y8Gu81ZZUwfww3W+b2Ei8g93865tBP66sokkJm13F5oiIuMwueIihAVeYWBgeQ PSz587OGBDIXunpETNOhbhzSKdXdI8ja/FfStDZlaL2KaOE3Z2SNoDg/NMmzgvaFHmz5 qtFgd/ccOK8h+Lu8fyPZSlRGDIqP0n5efOg5VVALZ2CFIs4mTuWP4idKmcpU+JfGRiXW RCtNc4hxkdnxsacqSYqwWNvryHuoR81++tXiMpL0bt812RjA0UWhcTRGjTebbKmaH5SV gfWCCMMt0Kr2jScY1v83kBtb1SllwYz2O5/2MEfzMP2m/QR+iZ9gA5O2KNk24y7BQAOM wJMA== MIME-Version: 1.0 X-Received: by 10.42.231.147 with SMTP id jq19mr12769102icb.30.1408766951981; Fri, 22 Aug 2014 21:09:11 -0700 (PDT) Received: by 10.64.167.229 with HTTP; Fri, 22 Aug 2014 21:09:11 -0700 (PDT) In-Reply-To: References: Date: Sat, 23 Aug 2014 00:09:11 -0400 Message-ID: Subject: Re: AccumuloMultiTableInputFormat IllegalStatementException From: Corey Nolet To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=047d7bacbac2be87150501441dd5 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bacbac2be87150501441dd5 Content-Type: text/plain; charset=UTF-8 Hey John, Could you give an example of one of the ranges you are using which causes this to happen? On Fri, Aug 22, 2014 at 11:02 PM, John Yost wrote: > Hey Everyone, > > The AccumuloMultiTableInputFormat is an awesome addition to the Accumulo > API and I am really excited to start using it. > > My first attempt with the 1.6.0 release resulted in this > IllegalStateException: > > java.lang.IllegalStateException: The table query configurations could not > be deserialized from the given configuration > > at > org.apache.accumulo.core.client.mapreduce.lib.impl.InputConfigurator.getInputTableConfigs(InputConfigurator.java:566) > > at > org.apache.accumulo.core.client.mapreduce.lib.impl.InputConfigurator.validateOptions(InputConfigurator.java:628) > > at > org.apache.accumulo.core.client.mapreduce.AbstractInputFormat.validateOptions(AbstractInputFormat.java:342) > > at > org.apache.accumulo.core.client.mapreduce.AbstractInputFormat.getSplits(AbstractInputFormat.java:537) > > at > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508) > > at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392) > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268) > > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) > > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265) > > at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286) > > at > com.johnyostanalytics.mapreduce.client.TwitterJoin.run(TwitterJoin.java:104) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > > when I attempt to initialize the AccumuloMultiTableInputFormat: > > InputTableConfig baseConfig = new InputTableConfig(); > baseConfig.setRanges(ranges); > > InputTableConfig edgeConfig = new InputTableConfig(); > edgeConfig.setRanges(ranges); > configs.put("base", baseConfig); > configs.put("edges",edgeConfig); > > AccumuloMultiTableInputFormat.setInputTableConfigs(job, configs); > > Any ideas as to what may be going on? I know that the table names are > valid and that the Range objects are valid because I tested all of that > independently via Accumulo scans. > > Any guidance is greatly appreciated because, again, > AcumuloMultiTableInputFormat is really cool and I am really looking forward > to using it. > > Thanks > > --John > > > > > > > > > > > > > > > > > --047d7bacbac2be87150501441dd5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hey John,

Could you give an example of = one of the ranges you are using which causes this to happen?


On Fri, Aug 22, = 2014 at 11:02 PM, John Yost <soozandjohnyost@gmail.com> wrote:
Hey Everyone,
=
The AccumuloMultiTableInputFormat is an awesome addition to= the Accumulo API and I am really excited to start using it.

My first attempt with the 1.6.0 release resulted in = this IllegalStateException:

java.lang.IllegalStateException: The = table query configurations could not be deserialized from the given configu= ration

= =C2=A0=C2=A0=C2=A0 at org.apache.accumulo.core.client.mapreduce.lib.impl.= InputConfigurator.getInputTableConfigs(InputConfigurator.java:566)

= =C2=A0=C2=A0=C2=A0 at org.apache.accumulo.core.client.mapreduce.lib.impl.= InputConfigurator.validateOptions(InputConfigurator.java:628)=

= =C2=A0=C2=A0=C2=A0 at org.apache.accumulo.core.client.mapreduce.AbstractI= nputFormat.validateOptions(AbstractInputFormat.java:342)

= =C2=A0=C2=A0=C2=A0 at org.apache.accumulo.core.client.mapreduce.AbstractI= nputFormat.getSplits(AbstractInputFormat.java:537)

=C2= =A0 =C2=A0 at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmi= tter.java:508)

at org.apache.hadoop.mapreduce.JobS= ubmitter.submitJobInternal(JobSubmitter.java:392)

at org.apache.hadoop.mapreduce.Job$= 10.run(Job.java:1268)

at org.apache.hadoop.mapreduce.Job$= 10.run(Job.java:1265)

at java.security.AccessController.d= oPrivileged(Native Method)

at javax.security.auth.Subject.doAs= (Subject.java:415)

at org.apache.hadoop.security.UserG= roupInformation.doAs(UserGroupInformation.java:1491)

at org.apache.hadoop.mapreduce.Job.= submit(Job.java:1265)

at org.apache.hadoop.mapreduce.Job.= waitForCompletion(Job.java:1286)

at com.johnyostanalytics.mapreduce.= client.TwitterJoin.run(TwitterJoin.java:104)

at org.apache.hadoop.util.ToolRunne= r.run(ToolRunner.java:70)

at org.apache.hado= op.util.ToolRunner.run(ToolRunner.java:84)


=20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20 =20
when I attempt to= initialize the AccumuloMultiTableInputFormat:

=C2=A0=C2=A0=C2=A0 = =C2=A0=C2=A0=C2=A0 InputTableConfig baseConfig =3D new InputTableConfig();<= br>=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 baseConfig.setRanges(ranges);
=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 InputTableConfig edgeConfig =3D new InputTableConfig();
=C2=A0= =C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 edgeConfig.setRanges(ranges);
=C2=A0=C2= =A0=C2=A0 =C2=A0=C2=A0=C2=A0 configs.put("base", baseConfig);
= =C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 configs.put("edges",edgeCon= fig);

=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 AccumuloMultiTableInputFormat.set= InputTableConfigs(job, configs);
=C2=A0=C2=A0=C2=A0 =C2=A0=C2=A0=C2=A0 <= br>
Any ideas as to what may be going on?=C2=A0 I know that the table names= are valid and that the Range objects are valid because I tested all of tha= t independently via Accumulo scans.=C2=A0

Any guidance is greatly appreciated because, again, AcumuloMultiTableIn= putFormat is really cool and I am really looking forward to using it.
Thanks

--John

















--047d7bacbac2be87150501441dd5--