Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
From: "Boudreau, Carl" <carl_boudreau@optum.com>
To: "general@hadoop.apache.org" <general@hadoop.apache.org>
Subject: How do I limit queries made to my Hadoop Cluster
Thread-Topic: How do I limit queries made to my Hadoop Cluster
Thread-Index: AdJM4vSeoPh9MyeLQ/qlLMdAyGKndwAALCUw
Date: Fri, 2 Dec 2016 21:34:33 +0000
Message-ID: <CD06D96EB5A22F4899649F7CB34B43AEF1E6BC@APSWP0832.ms.ds.uhc.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_CD06D96EB5A22F4899649F7CB34B43AEF1E6BCAPSWP0832msdsuhcc_"
MIME-Version: 1.0
archived-at: Fri, 02 Dec 2016 21:34:53 -0000

--_000_CD06D96EB5A22F4899649F7CB34B43AEF1E6BCAPSWP0832msdsuhcc_
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable

Dear Hadoop Expert,

This is my first post to this group, and I am new to Hadoop, so if this is =
not the correct list please excuse me.  If you have a better group please l=
et me know by replying directly to me.

I have a challenge before me.  In my Hadoop system I have data from three c=
ompanies called ABC, XYZ, and 123.  And because of my Business Need; all th=
e records from these three companies are in the same data store.  The recor=
ds are randomly mixed so one record could be a record from ABC and the next=
 could be from XYX or 123. When I query my Hadoop system, for all records t=
hat have the last name of Boudreau for data analytical work; I get all 3000=
 records that have the last name Boudreau.

However, I also have a contract with ABC, that says I cannot aggregate thei=
r records.  So I need a way to apply these contract rules when the data is =
queried.  Please note: I have given 20 other developers access to my Hadoop=
 system, but I am responsible to mirage the contractual obligations for my =
customers

What is the best way about going about this?

Can or do I write a Plug-in or modify YARN to have it check my contract rul=
es prior to returning a dataset?  Can or do I write a plug in for each and =
every Gateway Application such as Pig, Elastic Search, MapR, etc (about 10 =
applications that have access to my Hadoop system)

What are other options?

I have installed, configured and running Hadoop onto my local machine.  I h=
ave the source code also downloaded onto my machine, and I am able to dig i=
nto it and compile it.

Regards Carl

This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.

--_000_CD06D96EB5A22F4899649F7CB34B43AEF1E6BCAPSWP0832msdsuhcc_--