hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shi Yu <sh...@uchicago.edu>
Subject Re: SQL analysis
Date Thu, 10 May 2012 15:13:17 GMT
If the analysis you mention is to create "view" of multiple tables. Once 
your data is sorted by the keys in HDFS. You could try Map Side join or 
Reducer Side join in Hadoop to generate the "view" of your data (same 
keys of multiple data sets are combined). There are many code samples 
web, play it around might help.

If you want further analysis like Business Intelligence, then you need 
to train various models.

On 5/10/2012 8:30 AM, karanveer.singh@barclays.com wrote:
> I am more worried about the analysis assuming this data is in HDFS.
> -----Original Message-----
> From: Shi Yu [mailto:shiyu@uchicago.edu]
> Sent: 10 May 2012 18:58
> To: common-user@hadoop.apache.org
> Subject: RE: SQL analysis
> Flume might be suitable for your case.
> https://cwiki.apache.org/FLUME/
> Shi
> This e-mail and any attachments are confidential and intended
> solely for the addressee and may also be privileged or exempt from
> disclosure under applicable law. If you are not the addressee, or
> have received this e-mail in error, please notify the sender
> immediately, delete it from your system and do not copy, disclose
> or otherwise act upon any part of this e-mail or its attachments.
> Internet communications are not guaranteed to be secure or
> virus-free.
> The Barclays Group does not accept responsibility for any loss
> arising from unauthorised access to, or interference with, any
> Internet communications by any third party, or from the
> transmission of any viruses. Replies to this e-mail may be
> monitored by the Barclays Group for operational or business
> reasons.
> Any opinion or other information in this e-mail or its attachments
> that does not relate to the business of the Barclays Group is
> personal to the sender and is not given or endorsed by the Barclays
> Group.
> Barclays Bank PLC. Registered in England and Wales (registered no.
> 1026167).
> Registered Office: 1 Churchill Place, London, E14 5HP, United
> Kingdom.
> Barclays Bank PLC is authorised and regulated by the Financial
> Services Authority.

View raw message