Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 04410110DE for ; Wed, 17 Sep 2014 22:50:41 +0000 (UTC) Received: (qmail 97724 invoked by uid 500); 17 Sep 2014 22:50:40 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 97671 invoked by uid 500); 17 Sep 2014 22:50:40 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 97661 invoked by uid 99); 17 Sep 2014 22:50:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Sep 2014 22:50:40 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.212.176] (HELO mail-wi0-f176.google.com) (209.85.212.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Sep 2014 22:50:14 +0000 Received: by mail-wi0-f176.google.com with SMTP id ex7so2105069wid.3 for ; Wed, 17 Sep 2014 15:50:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=q15JBo2tAOSifGV5mLR7lYcZaOJrhnNhFBCeQcQ/YEY=; b=QAQ3EBMmmgRYdJI8lAYcnVqHkWvUn1dGK6fj65+9S1cPous+OlnBWnxgUFje3+4KHM 8sqBiW7uN1YDbinMkBjzFo5i0rnRoTRV2VBi8gg9xiEcyEgMwWCSd9JWGhG8FTzd/U5A 5kfWBST5I9/wGWzoOkLNI/AcQ6EZTu09WFhou6K2WAbg5cxM7ApkWGXhc8cziZ9LPW1y wxHY/LOAz8X1wzGFTnDdXHiK/k31Q2TCpZZ15MCw5L1xYvakUXmnhDJWMbM+/w+INmds dt9WdUqMRNAeo0E7iFCJlvTW+0R5VibNDTOVO2Kd5qNqb/zLPP/+oedChuxnoZlHUqaC Gh9w== X-Gm-Message-State: ALoCoQlPA7wbtFQoK+NOmtm3oY0xQlsTba31h19m+TqjbPPNiMrg3xy3pPxCdlkLPxgX79DmQPrs X-Received: by 10.194.142.209 with SMTP id ry17mr315003wjb.57.1410994213375; Wed, 17 Sep 2014 15:50:13 -0700 (PDT) MIME-Version: 1.0 Received: by 10.217.109.74 with HTTP; Wed, 17 Sep 2014 15:49:53 -0700 (PDT) In-Reply-To: <541A00DF.40007@gmail.com> References: <541A00DF.40007@gmail.com> From: Tim Israel Date: Wed, 17 Sep 2014 18:49:53 -0400 Message-ID: Subject: Re: Import/Export problems from 1.5.1 -> 1.6.0? To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=089e0122ecb8de64bd05034ab0f9 X-Virus-Checked: Checked by ClamAV on apache.org --089e0122ecb8de64bd05034ab0f9 Content-Type: text/plain; charset=UTF-8 Josh, I've sent an email directly to you with the zip -- I'm not sure what the mailing list behavior is regarding attachments. For the benefit of the mailing list, the files (and their contents) are as follows: distcp.txt ------------ hdfs://cluster/user/accumulo/.slider/cluster/slideraccumulo/database/data/tables/2/default_tablet/F000009g.rf hdfs://cluster/user/accumulo/.slider/cluster/slideraccumulo/database/data/tables/2/default_tablet/F000009n.rf hdfs://cluster/tmp/table1_export/exportMetadata.zip exportMetadata.zip/accumulo_export_info.txt ------------------------------------------------------------- exportVersion:1 srcInstanceName:instancename srcInstanceID:b458b1bb-f613-4c3c-a399-d3f275a634da srcZookeepers:CensoredZK1,CensoredZK2,CensoredZK3 srcTableName:table1_exp srcTableID:3 srcDataVersion:6 srcCodeVersion:1.6.0 exportMetadata.zip/table_config.txt ----------------------------------------------- table.constraint.1=org.apache.accumulo.core.constraints.DefaultKeySizeConstraint table.iterator.majc.vers=20,org.apache.accumulo.core.iterators.user.VersioningIterator table.iterator.majc.vers.opt.maxVersions=1 table.iterator.minc.vers=20,org.apache.accumulo.core.iterators.user.VersioningIterator table.iterator.minc.vers.opt.maxVersions=1 table.iterator.scan.vers=20,org.apache.accumulo.core.iterators.user.VersioningIterator table.iterator.scan.vers.opt.maxVersions=1 table.split.threshold=100M exportMetadata.zip/metadata.bin ----------------------------------------------- Thanks, Tim On Wed, Sep 17, 2014 at 5:45 PM, Josh Elser wrote: > Hi Tim, > > Any possibility that you can provide the exportMetadata.zip and the > distcp.txt? > > Fair warning - the data from that table won't be included, but some split > points might be included in metadata.bin (inside exportMetadata.zip) which > *might* contain something sensitive. Make sure you dbl check that. > > I'll see if I can reproduce what you saw. It definitely seems strange. > > - Josh > > On 9/17/14, 5:10 PM, Tim Israel wrote: > >> Upon further investigation, it looks like I can't even follow the steps >> outlined on the import/export documentation in 1.6.0 >> http://accumulo.apache.org/1.6/examples/export.html. I get the same >> error outlined in my first post >> >> [shell.Shell] ERROR: java.lang.RuntimeException: >> org.apache.accumulo.core.client.impl.AccumuloServerException: Error on >> server :58444 <-- port chosen by slider >> >> Accumulo Recent Logs >> ---- >> Failed to open file >> hdfs://cluster/accumulo/tables/1/b-000005c/I000005d.rf File does not >> exist: /accumulo/tables/1/b-000005c/I000005d.rf >> >> >> I tried the export/import procedure on my Accumulo 1.5.1 cluster and get >> the expected result (i.e. the table is imported and can be scanned >> without error) >> >> >> Tim >> >> On Wed, Sep 17, 2014 at 3:57 PM, Tim Israel > > wrote: >> >> Hi all, >> >> I posted something similar on the slider mailing list and was >> directed here. After debugging further, it doesn't seem like this >> is a slider issue. >> >> I have some tables that were exported from another cluster running >> Accumulo 1.5.1 on hoya and I'm trying to import them in Accumulo >> 1.6.0 on Slider 0.50.2. This target cluster is Kerberized but >> Accumulo is running in simple authentication mode. >> >> The exported table was distcp'd to a cluster configured with slider. >> >> The table was imported via accumulo shell successfully. The files >> get moved to >> /user/accumulo/.slider/cluster/slideraccumulo/database/data/tables/1 >> >> However, if I scan the imported table, accumulo complains with the >> following exception: >> Failed to open file >> hdfs://cluster/accumulo/tables/1/b-000005c/I000005d.rf File does not >> exist: /accumulo/tables/1/b-000005c/I000005d.rf >> >> I can scan the table if I move the files from >> /user/accumulo/.slider/cluster/slideraccumulo/database/data/tables/1 >> to /accumulo/tables/1 >> >> I pulled accumulo-site from the slider publisher and saw that >> instance.volumes is set as follows: >> hdfs://cluster/user/accumulo/.slider/cluster/slideraccumulo/ >> database/data >> >> Any suggestions would be greatly appreciated. >> >> Thanks, >> >> Tim >> >> >> --089e0122ecb8de64bd05034ab0f9 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Josh,
I've sent an email directly to you with the = zip -- I'm not sure what the mailing list behavior is regarding attachm= ents.

For the benefit of the mailing list, the fil= es (and their contents) are as follows:

distcp.txt=
------------
hdfs://cluster/user/accumulo/.slider= /cluster/slideraccumulo/database/data/tables/2/default_tablet/F000009g.rf
hdfs://cluster/user/accumulo/.slider/cluster/slideraccumulo/databa= se/data/tables/2/default_tablet/F000009n.rf
hdfs://cluster/tmp/ta= ble1_export/exportMetadata.zip

exportMetadat= a.zip/accumulo_export_info.txt
----------------------------------= ---------------------------
exportVersion:1
srcIns= tanceName:instancename
srcInstanceID:b458b1bb-f613-4c3c-a399-d3f2= 75a634da
srcZookeepers:CensoredZK1,CensoredZK2,CensoredZK3
<= div>srcTableName:table1_exp
srcTableID:3
srcDataVersion= :6
srcCodeVersion:1.6.0

exportMeta= data.zip/table_config.txt
---------------------------------------= --------
table.constraint.1=3Dorg.apache.accumulo.core.const= raints.DefaultKeySizeConstraint
table.iterator.majc.vers=3D20,org= .apache.accumulo.core.iterators.user.VersioningIterator
table.ite= rator.majc.vers.opt.maxVersions=3D1
table.iterator.minc.vers=3D20= ,org.apache.accumulo.core.iterators.user.VersioningIterator
table= .iterator.minc.vers.opt.maxVersions=3D1
table.iterator.scan.vers= =3D20,org.apache.accumulo.core.iterators.user.VersioningIterator
= table.iterator.scan.vers.opt.maxVersions=3D1
table.split.threshol= d=3D100M

exportMetadata.zip/metadata.bi= n
-----------------------------------------------
<binary file containing more metadata>

Than= ks,

Tim

On Wed, Sep 17, 2014 at 5:45 PM, Josh Elser = <josh.elser@gmail.com> wrote:
Hi Tim,

Any possibility that you can provide the exportMetadata.zip and the distcp.= txt?

Fair warning - the data from that table won't be included, but some spl= it points might be included in metadata.bin (inside exportMetadata.zip) whi= ch *might* contain something sensitive. Make sure you dbl check that.

I'll see if I can reproduce what you saw. It definitely seems strange.<= span class=3D"HOEnZb">

- Josh

On 9/17/14, 5:10 PM, Tim Israel wrote:
Upon further investigation, it looks like I can't even follow the steps=
outlined on the import/export documentation in 1.6.0
http://accumulo.apache.org/1.6/examples/export.html.=C2= =A0 I get the same
error outlined in my first post

[shell.Shell] ERROR: java.lang.RuntimeException:
org.apache.accumulo.core.client.impl.AccumuloServerException:= Error on
server <SERVER_NAME>:58444 <-- port chosen by slider

Accumulo Recent Logs
----
Failed to open file
hdfs://cluster/accumulo/tables/1/b-000005c/I000005d.rf File does not=
exist: /accumulo/tables/1/b-000005c/I000005d.rf


I tried the export/import procedure on my Accumulo 1.5.1 cluster and get the expected result (i.e. the table is imported and can be scanned
without error)


Tim

On Wed, Sep 17, 2014 at 3:57 PM, Tim Israel <tim@timisrael.com
<mailto:tim@timis= rael.com>> wrote:

=C2=A0 =C2=A0 Hi all,

=C2=A0 =C2=A0 I posted something similar on the slider mailing list and was=
=C2=A0 =C2=A0 directed here.=C2=A0 After debugging further, it doesn't = seem like this
=C2=A0 =C2=A0 is a slider issue.

=C2=A0 =C2=A0 I have some tables that were exported from another cluster ru= nning
=C2=A0 =C2=A0 Accumulo 1.5.1 on hoya and I'm trying to import them in A= ccumulo
=C2=A0 =C2=A0 1.6.0 on Slider 0.50.2.=C2=A0 This target cluster is Kerberiz= ed but
=C2=A0 =C2=A0 Accumulo is running in simple authentication mode.

=C2=A0 =C2=A0 The exported table was distcp'd to a cluster configured w= ith slider.

=C2=A0 =C2=A0 The table was imported via accumulo shell successfully.=C2=A0= The files
=C2=A0 =C2=A0 get moved to
=C2=A0 =C2=A0 /user/accumulo/.slider/cluster/slideraccumulo/d= atabase/data/tables/1

=C2=A0 =C2=A0 However, if I scan the imported table, accumulo complains wit= h the
=C2=A0 =C2=A0 following exception:
=C2=A0 =C2=A0 Failed to open file
=C2=A0 =C2=A0 hdfs://cluster/accumulo/tables/1/b-000005c/I000005d.rf= File does not
=C2=A0 =C2=A0 exist: /accumulo/tables/1/b-000005c/I000005d.rf

=C2=A0 =C2=A0 I can scan the table if I move the files from
=C2=A0 =C2=A0 /user/accumulo/.slider/cluster/slideraccumulo/d= atabase/data/tables/1
=C2=A0 =C2=A0 to /accumulo/tables/1

=C2=A0 =C2=A0 I pulled accumulo-site from the slider publisher and saw that=
=C2=A0 =C2=A0 instance.volumes is set as follows:
=C2=A0 =C2=A0 hdfs://cluster/user/accumulo/.slider/cluster/slideracc= umulo/database/data

=C2=A0 =C2=A0 Any suggestions would be greatly appreciated.

=C2=A0 =C2=A0 Thanks,

=C2=A0 =C2=A0 Tim



--089e0122ecb8de64bd05034ab0f9--