accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Turner <ke...@deenlo.com>
Subject Re: Import/Export problems from 1.5.1 -> 1.6.0?
Date Thu, 18 Sep 2014 17:22:41 GMT
I am thinking of dusting off the patch in ACCUMULO-2145 and trying to add
an upgrade test case using that patch.   I also need to get that patch
pushed.

On Thu, Sep 18, 2014 at 10:17 AM, Billie Rinaldi <billie.rinaldi@gmail.com>
wrote:

> It looks like the import table operation is creating file entries using
> relative paths in the metadata table, and their names are being resolved
> using the deprecated instance.dfs.dir and instance.dfs.uri properties.
> This seems like a bug.  I think a workaround for the problem would be to
> set those deprecated properties to match your instance.volumes property.  I
> know slider is setting instance.volumes for you, but if you want to verify
> this fixes the problem, it would probably be enough to set instance.dfs.dir
> to /user/accumulo/.slider/cluster/slideraccumulo/database/data in your app
> config (maybe /user/${USER}/.slider/cluster/${CLUSTER_NAME}/database/data
> would work if you're using the develop branch).
>
>
> On Wed, Sep 17, 2014 at 12:57 PM, Tim Israel <tim@timisrael.com> wrote:
>
>> Hi all,
>>
>> I posted something similar on the slider mailing list and was directed
>> here.  After debugging further, it doesn't seem like this is a slider issue.
>>
>> I have some tables that were exported from another cluster running
>> Accumulo 1.5.1 on hoya and I'm trying to import them in Accumulo 1.6.0 on
>> Slider 0.50.2.  This target cluster is Kerberized but Accumulo is running
>> in simple authentication mode.
>>
>> The exported table was distcp'd to a cluster configured with slider.
>>
>> The table was imported via accumulo shell successfully.  The files get
>> moved to
>> /user/accumulo/.slider/cluster/slideraccumulo/database/data/tables/1
>>
>> However, if I scan the imported table, accumulo complains with the
>> following exception:
>> Failed to open file hdfs://cluster/accumulo/tables/1/b-000005c/I000005d.rf
>> File does not exist: /accumulo/tables/1/b-000005c/I000005d.rf
>>
>> I can scan the table if I move the files from
>> /user/accumulo/.slider/cluster/slideraccumulo/database/data/tables/1 to
>> /accumulo/tables/1
>>
>> I pulled accumulo-site from the slider publisher and saw that
>> instance.volumes is set as follows:
>> hdfs://cluster/user/accumulo/.slider/cluster/slideraccumulo/database/data
>>
>> Any suggestions would be greatly appreciated.
>>
>> Thanks,
>>
>> Tim
>>
>
>

Mime
View raw message