hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11483) hdfs-bin files not selected in tags
Date Thu, 02 Mar 2017 01:48:45 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891446#comment-15891446
] 

Allen Wittenauer commented on HDFS-11483:
-----------------------------------------


I'm not sure I follow.

release-3.0.0-alpha2-RC0 s the tag for Apache Hadoop 3.0.0 alpha2.  Looking at https://github.com/apache/hadoop/blob/release-3.0.0-alpha2-RC0/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh,
it's clearly had changes since May 2015, including several of my own patches.  If we grab
the 3.x source and binary distros from the ASF website, it matches.

Looking at the release-2.7.3-RC2 tag and comparing it to branch-2, branch-2.7, and other (relatively)
recent Apache Hadoop 2.x tag and branches, the code for start-dfs.sh all match.  

So this all looks normal, given:

* Apache Hadoop 3.x alpha releases have the newer, incompatible-with-2.x bits.

* There have been no changes made to start-dfs.sh in the branch-2 stream in a very long time,
thus code from May 2015 is correct.

> hdfs-bin files not selected in tags
> -----------------------------------
>
>                 Key: HDFS-11483
>                 URL: https://issues.apache.org/jira/browse/HDFS-11483
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs
>            Reporter: Ninad Chaudhari
>
> **Changes after 1fbefe5  on May 8, 2015
> have not been added to Release tags.**
> -Will explain by Specifically talking about 
> "hadoop-hdfs/src/main/bin/start-dfs.sh"
> https://github.com/apache/hadoop/blob/0eb4b513b76bc944c31b15cd6558901ae44bf931/hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
> - If we switch to Tag 2.7.3 or anything stable or even 3.0
> this file has not been changed. 
> It has been commited ... but commits have not been tagged.
> -Result causes a file that is 5 years old to be included in Final release.
> -Affects many versions..
> To reproduce: 
> Download the latest build from any apache hadoop mirrors and compare the file with the
newer version avaliable on git.
> by the years, many corrections have been made for this file. 
> Again , look at "SECONDARY_NAMENODE" staring configuration.
> On git its : 
> "
> # secondary namenodes (if any)
> SECONDARY_NAMENODES=$("${HADOOP_HDFS_HOME}/bin/hdfs" getconf -secondarynamenodes 2>/dev/null)
> if [[ "${SECONDARY_NAMENODES}" == "0.0.0.0" ]]; then
>   SECONDARY_NAMENODES=$(hostname)
> fi
> if [[ -n "${SECONDARY_NAMENODES}" ]]; then
>   echo "Starting secondary namenodes [${SECONDARY_NAMENODES}]"
>   
>   "${bin}/hadoop-daemons.sh" \
>   --config "${HADOOP_CONF_DIR}" \
>   --hostnames "${SECONDARY_NAMENODES}" \
>   start secondarynamenode
> fi
> "
> But on tag 2.7+ Its still : 
> "
> SECONDARY_NAMENODES=$($HADOOP_PREFIX/bin/hdfs getconf -secondarynamenodes 2>/dev/null)
> if [ -n "$SECONDARY_NAMENODES" ]; then
>   echo "Starting secondary namenodes [$SECONDARY_NAMENODES]"
>   "$HADOOP_PREFIX/sbin/hadoop-daemons.sh" \
>       --config "$HADOOP_CONF_DIR" \
>       --hostnames "$SECONDARY_NAMENODES" \
>       --script "$bin/hdfs" start secondarynamenode
> fi
> "
> Commits after May2015 have not been merged !!!



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message