accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Date Sun, 04 Aug 2013 02:55:41 GMT
Cool. Thanks again for pointing this out. I've created 
https://issues.apache.org/jira/browse/ACCUMULO-1637 to track this and 
try to come up with a fix that will work with older and newer versions 
of Hadoop.

On 08/03/2013 10:49 PM, Carlos Mundi wrote:
> Josh,
>
> You are exactly correct.  It needed 'true'.  I'm i the accumulo shell 
> now!
>
> Yeah! Thanks!
> Carlos
>
>
> On Sat, Aug 3, 2013 at 7:31 PM, Josh Elser <josh.elser@gmail.com 
> <mailto:josh.elser@gmail.com>> wrote:
>
>     Yes, I believe the value used to be "true".
>
>
>     On 08/03/2013 10:27 PM, Carlos Mundi wrote:
>
>         Hi Josh,
>
>         Thanks for your reply!  I set dfs.durable.sync to 1 in my
>         hdfs-site.xml like this:
>
>         <property>
>           <name>dfs.durable.sync</name>
>           <value>1</value>
>         </property>
>
>
>         And then I stopped and restarted the whole chain: hadoop,
>         zookeeper, accumulo.
>
>         Same results!  So I'm not sure what's going on.  Maybe hadoop
>         needs 'true' instead of '1'.
>
>         I'm tinkering with it and will report any new info.
>
>         Cheers!
>         Carlos
>
>
>
>
>         On Sat, Aug 3, 2013 at 7:21 PM, Josh Elser
>         <josh.elser@gmail.com <mailto:josh.elser@gmail.com>
>         <mailto:josh.elser@gmail.com <mailto:josh.elser@gmail.com>>>
>         wrote:
>
>             Hi Carlos,
>
>             I pulled down the Apache Hadoop 1.2.0 source release and
>         took a
>             look at src/hdfs/hdfs-default.xml. Reading the description
>         on the
>             dfs.support.append property, dfs.support.append isn't
>         supported
>             and dfs.durable.sync is enabled by default. Looks like we
>         need to
>             change that check in the TabletServer code.
>
>             In the mean time, you can likely set that property in your
>             hdfs-site.xml to be true to fake out the tablet server and
>         make it
>             think that it's set.
>
>             Thanks for letting us know!
>
>             - Josh
>
>
>             On 08/03/2013 10:01 PM, Carlos Mundi wrote:
>
>                 Hi.
>
>                 This is my first time setting up accumulo.  So I'm
>         starting
>                 with a single node "cluster" on Ubuntu 13.04.  My
>         setup is...
>
>                 hadoop      1.2.0 (prebuilt tarball from Apache) -- The
>                 version will turn out to be important!
>                 zookeeper   3.4.5 (prebuilt tarball from Apache)
>                 accumulo    1.5.0 (custom build, to target hadoop 1.2)
>
>                 As I understand, because I am running hadoop 1.2, I
>         need to do
>                 a custom build.  So I did, following the README for
>         Accumulo.
>
>                 So I fire up hadoop, then zookeeper and then accumulo.
>         Looks
>                 good so far:
>
>                 $ jps
>                 21231 SecondaryNameNode
>                 20733 NameNode
>                 24274 Jps
>                 22556 Main
>                 21994 Main
>                 20978 DataNode
>                 22306 Main
>                 21764 QuorumPeerMain
>                 21570 TaskTracker
>                 22409 Main
>                 21322 JobTracker
>
>                 Then I try to fire up an accumulo shell (still
>         following the
>                 README) and I am told that there are no tablet
>         servers!  Here
>                 is what I get in
>         /usr/local/accumulo/logs/tracer_mybox.log:
>
>                 2013-08-03 18:32:44,918 [impl.ServerClient] WARN :
>         There are
>                 no tablet servers: check that zookeeper and accumulo
>         are running.
>
>                 I check jps, and everything is still running.  And here is
>                 what I have in /usr/local/accumulo/logs/tserver_mybox.log:
>
>                 2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL:
>                 Must set dfs.durable.sync OR dfs.support.append to true.
>                  Which one needs to be set depends on your version of
>         HDFS.
>                  See ACCUMULO-623.
>                   HADOOP RELEASE          VERSION SYNC NAME DEFAULT
>                   Apache Hadoop           0.20.205  dfs.support.append
>         false
>                   Apache Hadoop            0.23.x dfs.support.append true
>                   Apache Hadoop             1.0.x dfs.support.append false
>                   Apache Hadoop             1.1.x dfs.durable.sync true
>                   Apache Hadoop          2.0.0-2.0.2
>          dfs.support.append true
>                   Cloudera CDH             3u0-3u3 ????              
>              true
>                   Cloudera CDH               3u4  dfs.support.append  
>          true
>                   Hortonworks HDP           `1.0  dfs.support.append  
>          false
>                   Hortonworks HDP           `1.1  dfs.support.append  
>          false
>
>                 And, yes, I remember seeing that in the README.  But
>         now you
>                 see my problem.  Hadoop 1.2 is not on the list!
>
>                 At least, I assume that's my only problem.  :)
>
>                 Can someone please tell me which of the two dfs
>         options I need?
>
>                 Thanks very much!
>
>                 Carlos
>
>
>
>
>
>


Mime
View raw message