Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B20BC1037F for ; Tue, 1 Apr 2014 08:05:50 +0000 (UTC) Received: (qmail 15434 invoked by uid 500); 1 Apr 2014 08:05:48 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 14541 invoked by uid 500); 1 Apr 2014 08:05:46 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 14525 invoked by uid 99); 1 Apr 2014 08:05:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Apr 2014 08:05:45 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of swagatikat856@gmail.com designates 209.85.220.169 as permitted sender) Received: from [209.85.220.169] (HELO mail-vc0-f169.google.com) (209.85.220.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Apr 2014 08:05:40 +0000 Received: by mail-vc0-f169.google.com with SMTP id ik5so9627425vcb.28 for ; Tue, 01 Apr 2014 01:05:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=fjmse9n7lINsMstotO95NotKPGtk3hhyGygHAK1kHOY=; b=Z+cbzfxnmNTsEJn1VorNAO0amFCZcsZuhr7UgmUlneiVsZq1PeoMo/fnZnF2/TZMh5 TmuA7Itk4DjiwgGKMz3q9mf0xnBQg3r2rTN1woMRlpScMXQX4UJVv5MN0Q8xN7stlBjk 4bgOmKWbw+hSJUA4CBuvtBk8KGOEp2aqgc8l+4AUY1AZ53NGd2hQSYb5lEvbGbIojAeM 7SuLBynyvlgEo8vDVU09Ti0+K09tf9ryXslIM0r735Jax8kBSXdnak9KKTzXA9vgVnc+ fGCKrsdcqu6f/tpK1YpnulCeAhZfpmGjFg09TizhMt3mYHOiswmKijyI3ftnKo082bKm 8XlA== MIME-Version: 1.0 X-Received: by 10.220.147.16 with SMTP id j16mr27710776vcv.14.1396339518445; Tue, 01 Apr 2014 01:05:18 -0700 (PDT) Received: by 10.221.9.199 with HTTP; Tue, 1 Apr 2014 01:05:18 -0700 (PDT) Received: by 10.221.9.199 with HTTP; Tue, 1 Apr 2014 01:05:18 -0700 (PDT) In-Reply-To: References: Date: Tue, 1 Apr 2014 13:35:18 +0530 Message-ID: Subject: Re: READING FILE FROM MONGO DB From: Swagatika Tripathy To: user@hive.apache.org Content-Type: multipart/alternative; boundary=047d7b3436d2fba03704f5f6a046 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b3436d2fba03704f5f6a046 Content-Type: text/plain; charset=UTF-8 Do we hv a for loop concept in hive to iterate through the array elements n display them. We need an alternative for explode method Well you cN use Json serde for this Sent from my iPhone On Mar 26, 2014, at 8:40 PM, "Swagatika Tripathy" wrote: Hi , The use case is we have some unstructured data fetched from Mongo DB and stored in a particular location. Our task is to load those data into our staging and core hive tables in form of rows and columns.eg if the data is in key value pair like: { Id: bigint(12346), Name:string(ABC), Subjects: {Subject enrolled: Subjects: [eng ,math] } {Game enrolled: [Football,cricket] } This is just a very simple eg fr reference but we have a complex Json format with huge amount of data. So, in this case how can we load it into hive tables and hdfs? On Mar 26, 2014 10:59 PM, wrote: > Are you swagatika mohanty? > > > > > > > Thanks, > Shouvanik > > > -----Original Message----- > From: Siddharth Tiwari [mailto:siddharth.tiwari@live.com] > Sent: Wednesday, March 26, 2014 10:03 AM > To: user@hive.apache.org > Subject: Re: READING FILE FROM MONGO DB > > Hi Swagatika > You can create external tables to Mongo and can process it using hive. New > mongo connectors have added support for hive. Did you try that? > > Sent from my iPhone > > > On Mar 26, 2014, at 9:59 AM, "Swagatika Tripathy" < > swagatikat856@gmail.com> wrote: > > > > Hi, > > We have some files stored in MongoDB , mostly in key value format. We > need to parse those files and store it into Hive tables. > > > > Any inputs on this will be appreciated. > > > > Thanks, > > Swagatika > > > > > ________________________________ > > This message is for the designated recipient only and may contain > privileged, proprietary, or otherwise confidential information. If you have > received it in error, please notify the sender immediately and delete the > original. Any other use of the e-mail by you is prohibited. Where allowed > by local law, electronic communications with Accenture and its affiliates, > including e-mail and instant messaging (including content), may be scanned > by our systems for the purposes of information security and assessment of > internal compliance with Accenture policy. > > ______________________________________________________________________________________ > > www.accenture.com > > --047d7b3436d2fba03704f5f6a046 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Do we hv a for loop concept in hive to iterate through the array element= s n display them. We need an alternative for explode method

Well y= ou cN use Json serde for this

Sent from my iPhone

On M= ar 26, 2014, at 8:40 PM, "Swagatika Tripathy" <swagatikat856@gmail.com&g= t; wrote:

Hi ,
The use case is we have some unstructured data fetched from Mongo DB and st= ored in a particular location. Our task is to load those data into our stag= ing and core hive tables in form of rows and columns.eg if the data is in key value pair like:
{
Id: bigint(12346),
Name:string(ABC),
Subjects:
{Subject enrolled:
Subjects:
[eng ,math]
}
{Game enrolled:
[Football,cricket]
}
This is just a very simple eg fr reference but we have a complex Json forma= t with huge amount of data.

So, in this case how can we load it into hive tables and hdfs?

On Mar 26, 2014 10:59 PM, <shouvanik.haldar@accentu= re.com> wrote:
siddharth.tiwari@live.com]
Sent: Wednesday, March 26, 2014 10:03 AM
To: user@hive.apa= che.org
Subject: Re: READING FILE FROM MONGO DB

Hi Swagatika
You can create external tables to Mongo and can process it using hive. New = mongo connectors have added support for hive. Did you try that?

Sent from my iPhone

> On Mar 26, 2014, at 9:59 AM, "Swagatika Tripathy" <swagatikat856@gmail.= com> wrote:
>
> Hi,
> We have some files stored in MongoDB , mostly in key value format. We = need to parse those files and store it into Hive tables.
>
> Any inputs on this will be appreciated.
>
> Thanks,
> Swagatika
>


________________________________

This message is for the designated recipient only and may contain privilege= d, proprietary, or otherwise confidential information. If you have received= it in error, please notify the sender immediately and delete the original.= Any other use of the e-mail by you is prohibited. Where allowed by local l= aw, electronic communications with Accenture and its affiliates, including = e-mail and instant messaging (including content), may be scanned by our sys= tems for the purposes of information security and assessment of internal co= mpliance with Accenture policy.
___________________________________________________________________________= ___________

www.accenture.com

--047d7b3436d2fba03704f5f6a046--