From user-return-1524-apmail-hadoop-user-archive=hadoop.apache.org@hadoop.apache.org Tue Sep 18 05:04:43 2012 Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 06C7BDE90 for ; Tue, 18 Sep 2012 05:04:42 +0000 (UTC) Received: (qmail 42197 invoked by uid 500); 18 Sep 2012 05:04:37 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 41906 invoked by uid 500); 18 Sep 2012 05:04:37 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 41877 invoked by uid 99); 18 Sep 2012 05:04:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Sep 2012 05:04:36 +0000 X-ASF-Spam-Status: No, hits=2.4 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dw.90@live.com designates 65.55.90.86 as permitted sender) Received: from [65.55.90.86] (HELO snt0-omc2-s11.snt0.hotmail.com) (65.55.90.86) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Sep 2012 05:04:26 +0000 Received: from SNT145-W104 ([65.55.90.72]) by snt0-omc2-s11.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Mon, 17 Sep 2012 22:04:05 -0700 Message-ID: Content-Type: multipart/alternative; boundary="_24940c3e-b92d-455d-baa5-8768cbe4e08a_" X-Originating-IP: [59.95.13.69] From: A Geek To: Subject: Hadoop HDFS and Mapreducer question Date: Tue, 18 Sep 2012 05:04:05 +0000 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 18 Sep 2012 05:04:05.0326 (UTC) FILETIME=[06DC0EE0:01CD955B] --_24940c3e-b92d-455d-baa5-8768cbe4e08a_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hello All=2C I'm learning hadoop=2C hdfs etc and currently tying to solve o= ne issue. Can someone help me how to start attacking the following problem: I'm trying to come up with some sample code to store the files \YEAR\Mont= h\Date\account structure using Hadoop technique s.=20 =20 Example: The file will submit to the program as below Test_20120917_ACC1.csv and Test_20120916_ACC2.csv =20 HDFS has to create structure as below =20 HDFS_HOME\2012\09\17\ACC1\Test_20120917_ACC1.csv=20 HDFS_HOME\2012\09\16\ACC1\Test_20120916_ACC2.csv=20 Can someone give me pointers on how to start on this. Highly Appreciated. T= hanks for reading the question.=20 Thanks=2CDW = --_24940c3e-b92d-455d-baa5-8768cbe4e08a_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hello All=2C =3B
I'm learning hadoop=2C hdfs etc and currently tyin= g to solve one issue. Can someone help me how to start attacking the follow= ing problem:

I'm trying to come up with some sampl= e code =3B =3Bto store the files =3B =3B\YEAR\Month\Date\ac= count structure using Hadoop technique s.

Example: The file will = submit to the program as below
Test_20120917_ACC1.csv and Test_20120916= _ACC2.csv

HDFS has to create structure as below

HDFS_HOME= \2012\09\17\ACC1\Test_20120917_ACC1.csv
HDFS_HOME\2012\09\16\ACC1= \Test_20120916_ACC2.csv =3B

Can someo= ne give me pointers on how to start on this. Highly Appreciated. Thanks for= reading the question. =3B

Thanks=2C
DW
= --_24940c3e-b92d-455d-baa5-8768cbe4e08a_--