Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-dev@hadoop.apache.org
Message-ID: <760530828.1245451327534.JavaMail.jira@brutus>
Date: Fri, 19 Jun 2009 15:42:07 -0700 (PDT)
From: "Terence Kwan (JIRA)" <jira@apache.org>
To: chukwa-dev@hadoop.apache.org
Subject: [jira] Commented: (CHUKWA-316) jobconf Error in mr_job_* table
In-Reply-To: <602997248.1245436207755.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CHUKWA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722073#action_12722073 ] 

Terence Kwan commented on CHUKWA-316:
-------------------------------------

look good. +1

> jobconf Error in mr_job_* table
> -------------------------------
>
>                 Key: CHUKWA-316
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-316
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: Data Processors
>    Affects Versions: 0.2.0
>         Environment: Redhat EL 5,1, Java 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>         Attachments: CHUKWA-316.patch
>
>
> The current mr_job table, jobconf columns contains the content of jobconf for some rows, and other rows contains the
> path of the jobconf.
> In the sequence file, jobconf is the field for location of the jobconf path.  The content of the jobconf is
> JOBCONF-JSON.  In database table, jobconf is the content of the jobconf.  Unfortunately, the new automatic mapping will
> detect sequence file "jobconf" field is a match with "jobconf" column in the database.  Hence the
> last update wins.
> To work around this problem, we need ability to undefine sequence file field to match to database column.
> Personally, I think indirect data translation mapping is the wrong thing to do.  The mapping should be as straight forward as possible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.