chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kirk True (JIRA)" <j...@apache.org>
Subject [jira] Created: (CHUKWA-490) Allow mdl.xml to be split into multiple files for ease of maintenance
Date Thu, 17 Jun 2010 22:17:24 GMT
Allow mdl.xml to be split into multiple files for ease of maintenance
---------------------------------------------------------------------

                 Key: CHUKWA-490
                 URL: https://issues.apache.org/jira/browse/CHUKWA-490
             Project: Hadoop Chukwa
          Issue Type: Improvement
    Affects Versions: 0.4.0
            Reporter: Kirk True
         Attachments: DatabaseConfig.diff

We have nearly two dozen different demux implementations that generate data that is eventually
saved into MySQL. On top of this, each different data type has about twenty or more columns
in its resulting table. Specifying all of these in a single mdl.xml file has caused us some
headaches, so we looked into how we could split mdl.xml into smaller, more manageable chunks.
The patch (forthcoming) simply iterates over the files in $CHUKWA_CONF_DIR and if the file
name ends with "mdl.xml", it will be added as a resource to the Configuration object used
(mdl.xml is loaded first and the others are loaded subsequently, ensuring that mdl.xml is
not then loaded again).

One likely concern is that this doesn't follow the default/site method of specifying overrides.
Also, the ordering of the configuration files' inclusionis based on the JVM and/or platform
implementation of java.io.File.listFiles.

Regardless, this made it very simple to isolate the files needed by each data type and update
them as needed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message