Hadoop shutdown scripts failing

[Susheel Kumar Gadalay]

How to redirect the storing of the following files from /tmp to some
other location.
hadoop-<os user>-namenode.pid
hadoop-<os user>-datanode.pid
yarn-<os user>-resourcemanager.pid
yarn-<os user>-nodemanager.pid

In /tmp, these files are cleared by OS sometime back and I am unable
to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh

In core-site.xml I have given property hadoop.tmp.dir but still these
pid files are present in /tmp only,

[Aitor Cedres]

Hi Susheel,

You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:

- HADOOP_PID_DIR
- YARN_PID_DIR

To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)

Hope it helps,
Aitor

Post by Susheel Kumar Gadalay
How to redirect the storing of the following files from /tmp to some
other location.
hadoop-<os user>-namenode.pid
hadoop-<os user>-datanode.pid
yarn-<os user>-resourcemanager.pid
yarn-<os user>-nodemanager.pid
In /tmp, these files are cleared by OS sometime back and I am unable
to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
In core-site.xml I have given property hadoop.tmp.dir but still these
pid files are present in /tmp only,

[Susheel Kumar Gadalay]

Thanks Aitor.

There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
but not in yarn-env.sh.

Post by Aitor Cedres
Hi Susheel,
- HADOOP_PID_DIR
- YARN_PID_DIR
To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)
Hope it helps,
Aitor

Post by Susheel Kumar Gadalay
How to redirect the storing of the following files from /tmp to some
other location.
hadoop-<os user>-namenode.pid
hadoop-<os user>-datanode.pid
yarn-<os user>-resourcemanager.pid
yarn-<os user>-nodemanager.pid
In /tmp, these files are cleared by OS sometime back and I am unable
to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
In core-site.xml I have given property hadoop.tmp.dir but still these
pid files are present in /tmp only,

[Aitor Cedres]

Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
YARN_PID_DIR. If it's not set. it will default to /tmp.

Post by Susheel Kumar Gadalay
Thanks Aitor.
There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
but not in yarn-env.sh.

Post by Aitor Cedres
Hi Susheel,
- HADOOP_PID_DIR
- YARN_PID_DIR
To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)
Hope it helps,
Aitor

Post by Susheel Kumar Gadalay
How to redirect the storing of the following files from /tmp to some
other location.
hadoop-<os user>-namenode.pid
hadoop-<os user>-datanode.pid
yarn-<os user>-resourcemanager.pid
yarn-<os user>-nodemanager.pid
In /tmp, these files are cleared by OS sometime back and I am unable
to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
In core-site.xml I have given property hadoop.tmp.dir but still these
pid files are present in /tmp only,