hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HBASE-2009) [EC2] support mapreduce subsystem
Date Wed, 25 Nov 2009 02:26:39 GMT

     [ https://issues.apache.org/jira/browse/HBASE-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Andrew Purtell resolved HBASE-2009.

    Resolution: Fixed

Committed to trunk and 0.20 branch. Changes:

* Add master and region server opts independently to hbase-env.sh
** Modify GC flags to Ryan's recommendations
** Enable GC logging

* Split Hadoop config into core, hdfs, and mapred-site.xml

* Configure mapreduce and start jobtracker and tasktrackers

* Silence sysctl warning

* Add hbase jars and conf dir to Hadoop classpath

* Use port 8020 for HDFS and 8021 for jobtracker

> [EC2] support mapreduce subsystem
> ---------------------------------
>                 Key: HBASE-2009
>                 URL: https://issues.apache.org/jira/browse/HBASE-2009
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>             Fix For: 0.20.3, 0.21.0
>         Attachments: HBASE-2009.patch
> Feedback up on hbase-user@ from Naresh Rapolu:
> {quote}
>     Your scripts are working fine. We restarted everything and tested, and they are working
fine. A few issues though :
>         * While starting, launch-hbase-cluster gives the following error.
>           error: "fs.epoll.max_user_instance" is an unknown key. It occurs during starting
zookeeper instances.
>         * We needed MapReduce along with HBase. The note on the JIRA page that you only
need to add only two lines in hbase-ec2-env.sh is insufficient.
>           The following changes need to be made.
>           1. hbase-ec2-env.sh should write mapred.job.tracker property into hadoop-site.xml
( Also shouldnt you be having core-site.xml and hdfs-site.xml as it is hadoop-0.20.1 ??? Infact
because of this , there are warning messages all over the place when you are using hdfs through
command line ).
>           2. HADOOP_CLASSPATH in hadoop/conf/hadoop-env.sh needs to be changed in the
underlying AMI, to include hbase, zookeeper jars and conf directory. Probably you can modify
the public AMI, and recreate the bundle as the paths to these are known apriori. 3. For other
users, the following three lines should be added in hbase-ec2-env.sh
>           For master:
>           "$HADOOP_HOME"/bin/hadoop-daemon.sh start jobtracker
>           "$HADOOP_HOME"/bin/hadoop-daemon.sh start tasktracker
>           For slave:
>           "$HADOOP_HOME"/bin/hadoop-daemon.sh start tasktracker.
> {quote}

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message