hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Palen <bro...@mlds-networks.com>
Subject Re: hadoop interaction with AFS
Date Wed, 17 Jun 2009 15:41:22 GMT


> Hey Brock,
>
> I've seen a similar problem at another site.  They were able to  
> solve this by upgrading their version of OpenAFS.  Is that an  
> option for you?

It might be, I see we are running 1.4.8 and they have 1.5 out,  not  
sure what our cell is running and compatibility,  good to know.

>
> Brian
>
> On Jun 17, 2009, at 8:35 AM, Brock Palen wrote:
>
>> Ran into an issue with running hadoop on a cluster that also has  
>> AFS installed.  When a user ssh's in they get an 'extra'  group  
>> id, I think it is called a 'pag',
>>
>> Problem is when you try to start hadoop from a shell that has a  
>> pag, one of the checks in newer versions stops because there is no  
>> group name to go with the gid,
>>
>> as an example from the 'groups'  command:
>>
>> [brockp@nyx-login1 ~]$ groups
>> cacstaff vasp stata charmm amber8 siesta eecs587f06 nolimit gti  
>> hyades adina chemkinpro coe molpro aces2 helios mcnp5 matlab id:  
>> cannot find name for group ID 1093742985
>> 1093742985
>>
>>
>> If you ssh to the machine its self using ssh keys, the pag is not  
>> created, which our current work around, but is kinda kludgy,
>>
>> If you need more information let me know.
>>
>>
>> Brock Palen
>> brockp@mlds-networks.com
>> www.mlds-networks.com
>> MLDS Owner Senior Tech.
>>
>


Mime
View raw message