Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5668E10F76 for ; Tue, 8 Oct 2013 15:47:46 +0000 (UTC) Received: (qmail 8699 invoked by uid 500); 8 Oct 2013 15:47:36 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 8392 invoked by uid 500); 8 Oct 2013 15:47:30 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 8379 invoked by uid 99); 8 Oct 2013 15:47:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Oct 2013 15:47:28 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jeetuyadav200890@gmail.com designates 209.85.217.177 as permitted sender) Received: from [209.85.217.177] (HELO mail-lb0-f177.google.com) (209.85.217.177) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Oct 2013 15:47:23 +0000 Received: by mail-lb0-f177.google.com with SMTP id w7so6990622lbi.36 for ; Tue, 08 Oct 2013 08:47:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=vWo4qv0m4AeZ/y6CE4izb5yYDbWRSbZKaY6bAqzV6Dw=; b=q9zyq3KK2/nvLeSUhKg7kZ+S144HBdRPS1bxxqQUAV1zHtqPenAAylai08ErnmALPn Sur+Rf7xVcbrSVqpQf/yAU1VBbv6cwB+nAsyUUblHKTyAw9OtTRIF4PUusojcYhO+vzb 4ElCVZTpiLl1T+98VeHsA3m3/2xRQiISxGXa44jlOJeAtPjRTOdi7YVpTYnmGe6KHNgN negmSr5zzVbUEYe9DWm9yDs/AlgSz2wEawb8C2qlT53usuDImgE7ij+gRMMwqvy+sc9u KifnPSxYe9nqJDFjts8P2yn5mqQpJhPxdOkfFK5BVz7LzErBQtZVA8QzPy5bm92APM3f lEFg== MIME-Version: 1.0 X-Received: by 10.152.116.109 with SMTP id jv13mr1902921lab.30.1381247222151; Tue, 08 Oct 2013 08:47:02 -0700 (PDT) Received: by 10.112.180.70 with HTTP; Tue, 8 Oct 2013 08:47:01 -0700 (PDT) Date: Tue, 8 Oct 2013 21:17:01 +0530 Message-ID: Subject: Migrating from Legacy to Hadoop. From: Jitendra Yadav To: user Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Hi All, We are planning to consolidate our 3 existing warehouse databases to Hadoop cluster, In our testing phase we have designed the target environment and transferred the data from source to target (not in sync but almost completed ). These legacy systems were using traditional ETL/replication mechanism like Golden gate, Loaders, PL/SQL language etc., FYI we are using 80% PL/SQL code and SQL server packages in current environment, however we have re-writing some of ETL jobs through java and python MR but looking for some more and easy alternatives. What is best approach we should follow to complete this process? while suggesting please take effort and timing in consideration( if possible). Please guide. Regards Jitendra