Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates
 209.85.223.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALab=pBwBm2Hnqumz8Ayp+PxxFAKYhvyxeLiPR6BG31GORgYdw@mail.gmail.com>
References: 
 <CALab=pB2P4DXebz0UO6G2i4qMde4tCgmNmi7BHa203rMJXkaLw@mail.gmail.com>
 <841531D0-736B-47C2-85C2-455DFA8A27CE@hortonworks.com>
 <BD42F346AE90F544A731516A805D1B8AD85DE0@SMAIL1.prd.mpac.ca>
 <CALab=pA3PJq5kY0gZ=tfbEDjPtSytTHNjou24yFM9g-O0L+_fQ@mail.gmail.com>
 <CAOcnVr1ca-RoDKrD2K1NjOgLC-LnGn+h5Xyy+yGr_3Us=yuxQg@mail.gmail.com>
 <CALab=pBwBm2Hnqumz8Ayp+PxxFAKYhvyxeLiPR6BG31GORgYdw@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Sat, 10 Nov 2012 01:11:52 +0530
Message-ID: 
 <CAOcnVr2xCd6eB1Aqs+YLuTxUT7Nh1BG6wtzkZQxbKUwJtCsvpA@mail.gmail.com>
Subject: Re: Sticky Bit Problem (CDH4.1)
To: user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Thanks for following up Brian. I'll try to reproduce this out with
some more version hints from your post just in case we aren't missing
anything bad.

Also, in future, if your problem feels CDH-specific, please do mail
the cdh-user@cloudera.org lists instead of the Apache ones (Groups:
https://groups.google.com/a/cloudera.org/forum/?fromgroups=3D#!forum/cdh-us=
er).

On Fri, Nov 9, 2012 at 10:57 PM, Brian Derickson <bderickson88@gmail.com> w=
rote:
> Very possible it's a mixed version thing, though I'm not sure where in th=
e
> mess we created it would be. :)
>
> As far as I can tell, we were never using Java version 7.
>
> Most of these complications arose when we attempted to upgrade to CDH 4.1
> via Puppet. Somewhere along the line things were installed on hosts where
> they shouldn't have been. It's also possible there was a mix of versions
> installed. (CDH4.0 and CDH4.1)
>
> We also had some problems with Avro around the same time... Since version
> 1.7.1 is supposed to be used with CDH4, I was trying to remove the 1.5.4 =
jar
> that comes with the distribution and put 1.7.1 jars in place instead. Thi=
s
> particular task wasn't a priority until I forgot to specify a 1.7.1 jar w=
hen
> running a job and it started using the 1.5.4 jar.
>
> I discovered during this work that putting the avro-tools jar in
> /usr/lib/hadoop/lib causes the jobtracker to stop working. It fails
> immediately after launch with this error: "java.lang.NoSuchMethodError:
> org.apache.hadoop.ipc.RPC.getServer". I can reproduce this and provide a
> more detailed stack trace or whatever if needed. There may have been some
> other fallout from this that I'm not aware of.
>
> I think that's it. Like I said, it was a bit of a mess for awhile but all
> seems well now. :)
>
>
>
>
>
> On Thu, Nov 8, 2012 at 11:26 PM, Harsh J <harsh@cloudera.com> wrote:
>>
>> Glad to know it is resolved for you. Highly odd error - I haven't been
>> able to reproduce with JDK 7u3 either, so am unsure of what caused the
>> parser to fail. Probably mixed versions of jars by any chance?
>>
>> On Thu, Nov 8, 2012 at 10:45 PM, Brian Derickson <bderickson88@gmail.com=
>
>> wrote:
>> > This is resolved, now. We were having some problems yesterday with the
>> > Puppet infrastructure we use to manage our cluster that resulted in
>> > daemons
>> > being installed on hosts they shouldn't be on (datanode/tasktracker
>> > running
>> > on master nodes, for example) that I wasn't aware of when I made my
>> > original
>> > post. Once we figured that out, this sticky bit problem went away.
>> >
>> > I wish I could be more specific just so anyone that finds this thread =
in
>> > the
>> > archives could have something useful...
>> >
>> > Thanks for your time!
>> >
>> >
>> >
>> > On Wed, Nov 7, 2012 at 2:44 PM, Kartashov, Andy <Andy.Kartashov@mpac.c=
a>
>> > wrote:
>> >>
>> >> Have you tried hadoop fs -chmod a+rwx /tmp
>> >>
>> >>
>> >>
>> >>
>> >>
>> >> From: Arun C Murthy [mailto:acm@hortonworks.com]
>> >> Sent: Wednesday, November 07, 2012 3:11 PM
>> >> To: user@hadoop.apache.org
>> >> Subject: Re: Sticky Bit Problem (CDH4.1)
>> >>
>> >>
>> >>
>> >> Pls ask Cloudera lists...
>> >>
>> >>
>> >>
>> >> On Nov 7, 2012, at 9:57 AM, Brian Derickson wrote:
>> >>
>> >>
>> >>
>> >> Hey all,
>> >>
>> >> When setting up the namenode, some of the commands that we run are:
>> >> hadoop fs -mkdir /tmp
>> >> hadoop fs -chmod -R 1777 /tmp
>> >>
>> >> This has worked for previous CDH releases of Hadoop.
>> >>
>> >> We recently upgraded our test cluster to CDH 4.1 and the chmod no
>> >> longer
>> >> works.
>> >>
>> >> sudo -u hdfs hadoop fs -chmod -R 1777 /tmp
>> >> chmod: chmod : mode '1777' does not match the expected pattern.
>> >>
>> >> sudo -u hdfs hadoop fs -chmod -R +t /tmp
>> >> chmod: chmod : mode '+t' does not match the expected pattern.
>> >>
>> >> This disagrees with the docs here:
>> >>
>> >> https://ccp.cloudera.com/display/CDH4DOC/Deploying+MapReduce+v1+%28MR=
v1%29+on+a+Cluster#DeployingMapReducev1%28MRv1%29onaCluster-Step7
>> >>
>> >> Has anyone else encountered this? Let me know if you need more
>> >> information, and thanks for your time.
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> Arun C. Murthy
>> >>
>> >> Hortonworks Inc.
>> >> http://hortonworks.com/
>> >>
>> >>
>> >>
>> >> NOTICE: This e-mail message and any attachments are confidential,
>> >> subject
>> >> to copyright and may be privileged. Any unauthorized use, copying or
>> >> disclosure is prohibited. If you are not the intended recipient, plea=
se
>> >> delete and contact the sender immediately. Please consider the
>> >> environment
>> >> before printing this e-mail. AVIS : le pr=E9sent courriel et toute pi=
=E8ce
>> >> jointe qui l'accompagne sont confidentiels, prot=E9g=E9s par le droit
>> >> d'auteur
>> >> et peuvent =EAtre couverts par le secret professionnel. Toute
>> >> utilisation,
>> >> copie ou divulgation non autoris=E9e est interdite. Si vous n'=EAtes =
pas le
>> >> destinataire pr=E9vu de ce courriel, supprimez-le et contactez
>> >> imm=E9diatement
>> >> l'exp=E9diteur. Veuillez penser =E0 l'environnement avant d'imprimer =
le
>> >> pr=E9sent
>> >> courriel
>> >
>> >
>>
>>
>>
>> --
>> Harsh J
>
>


--=20
Harsh J