hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-7036) spellcheck for configuration
Date Mon, 15 Nov 2010 22:22:15 GMT
spellcheck for configuration

                 Key: HADOOP-7036
                 URL: https://issues.apache.org/jira/browse/HADOOP-7036
             Project: Hadoop Common
          Issue Type: New Feature
          Components: conf
            Reporter: Ari Rabkin
            Assignee: Ari Rabkin

Hadoop does fairly limited correctness checks of its configuration. I propose a "configuration
spellcheck" that can automatically catch errors, and particularly can catch cases where users
mis-type the name of an option.

The system works as follows:

- Use program analysis to extract the set of options supported by each Hadoop version, annotated
when possible with their types into a 'dictionary file'.
- Distribute these extracted sets, per version.
- A script that reads a dictionary file, reads the Hadoop config from a specified directory,
and reports deviations. In particular, the system can report when an option is set that Hadoop
will never read or when an invalid value is specified.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message