Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of buttler1@llnl.gov designates
 128.115.41.81 as permitted sender)
From: "Buttler, David" <buttler1@llnl.gov>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Date: Fri, 25 Mar 2011 11:56:22 -0700
Subject: RE: Observer/Observable MapReduce
Thread-Topic: Observer/Observable MapReduce
Thread-Index: AcvrGWXCNTXtThBUT5idX9Tx03jYwAABNGyg
Message-ID: 
 <2D6136772A13B84E95DF6DA79E85A9F0013AD7FB8EC7@NSPEXMBX-A.the-lab.llnl.gov>
References: <AANLkTi=0ugFfrYWnPuhdPRc+McSMq33giqbqjYLFgm+0@mail.gmail.com>
In-Reply-To: <AANLkTi=0ugFfrYWnPuhdPRc+McSMq33giqbqjYLFgm+0@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

What about just storing some metadata in a special table?
Then on you second job startup you can read that meta data and set your sca=
n /input splits appropriately?
Dave

-----Original Message-----
From: Vishal Kapoor [mailto:vishal.kapoor.in@gmail.com]=20
Sent: Friday, March 25, 2011 11:21 AM
To: user@hbase.apache.org
Subject: Observer/Observable MapReduce

Can someone give me a direction on how to start a map reduce based on
an outcome of another map reduce? ( nothing common between them apart
from the first decides about the scope of the second.

I might also want to set the scope of my second map reduce
(from/after) my first map reduce(scope as in scan(start,stop)

typically data comes in a few tables for us and we start crunching it
and then adding some more data to man tables like info etc to get rid
of table joins.

a light weight framework will do better than a typical workflow management =
tool.

thanks,
Vishal Kapoor