Mailing-List: contact user-help@bigtop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@bigtop.apache.org
Received-SPF: error (athena.apache.org: local policy)
Date: Thu, 6 Jun 2013 23:20:04 -0700
From: Konstantin Boudnik <cos@apache.org>
To: user@bigtop.apache.org
Subject: Re: Bigtop for Goraci
Message-ID: <20130607062004.GA6436@tpx>
Mail-Followup-To: user@bigtop.apache.org
References: 
 <CAGaRif2xxhzwwEXZZe53Q5y=T=a5sQn0Ox4F2bOGTGBRJ08xRQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
	protocol="application/pgp-signature"; boundary="opJtzjQTFsWo+cga"
Content-Disposition: inline
In-Reply-To: 
 <CAGaRif2xxhzwwEXZZe53Q5y=T=a5sQn0Ox4F2bOGTGBRJ08xRQ@mail.gmail.com>
User-Agent: Mutt/1.5.21 (2010-09-15)


--opJtzjQTFsWo+cga
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Hi Lewis.

very interesting stuff, indeed. I am a little bit confused though: when you
are saying "does anyone have an idea about how we can get this working in
tandem" what parts needs to be coupled here? The suite and DB implementatio=
ns?

Or is it something else? Appreciate more info.

Regards,
  Cos

On Thu, Jun 06, 2013 at 11:08PM, Lewis John Mcgibbney wrote:
> Hi Bigtopers,
>=20
> I am over here asking questions as I am a bit lost right now.
> Over in Gora we have a real nice test suite called Goraci [0]. Basically
> the test runs many ingest clients that continually create linked lists
> containing 25 million nodes. At some point the clients are stopped and a
> map reduce job is run to ensure no linked list has a hole. A hole indicat=
es
> data was lost. Gennerally speaking the more nodes in the cluster, the
> better a chance there is of us finding that data is lost.
>=20
> Now for part two... in Gora we currently have datastore implementations f=
or
> Accumulo, Avro, Cassandra, HBase and Amazon Dynamodb... what we don not
> have, is a mechanism to run the ingestion test against each datastore as a
> controlled job meaning that we can subsequently gather metrics and infer
> behaviour across Gora datastores.
>=20
> I have not gone to our friends @Infra yet as I would rather do my homework
> first and exhaust the avenues where I could contribute to getting this off
> of the ground.
>=20
> My questions are therefore very very simple... does anyone have an idea
> about how we can get this working in tandem? Is this prime territory for
> Bigtop?
>=20
> Thanks very much in advance.
> Best
> Lewis
>=20
> [0] https://github.com/keith-turner/goraci
>=20
> --=20
> *Lewis*

--opJtzjQTFsWo+cga
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: Digital signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iF4EAREIAAYFAlGxe5MACgkQenyFlstYjhJLbwEAqrr99oZs4ZlV+mnEEYz2ZPTz
e87yZQwyn2deyYWeQOUA/RO099eXA4B37NzopmeXsMH0o5Q0GOIRTVfAI+SBhjZn
=QkPe
-----END PGP SIGNATURE-----

--opJtzjQTFsWo+cga--