How do you change the host name in Hadoop?
To change the hostname of Hadoop, you can follow these steps:
- Open all nodes in the Hadoop cluster. Make sure you have administrative privileges.
- Edit the /etc/hosts file on each node. In this file, replace the old hostname with the new hostname. You can use a text editor such as vi or nano to open the file for editing. Make sure that the /etc/hosts file on all nodes is modified.
- Edit the core-site.xml file in $HADOOP_HOME/etc/hadoop directory. Locate the fs.defaultFS property in the file and change its value to hdfs://newHostName:9000. The new host name should be the one you want to modify. Save and close the file.
- Edit the $HADOOP_HOME/etc/hadoop/yarn-site.xml file for Hadoop. Locate the yarn.resourcemanager.hostname property and change its value to the new hostname. Save and close the file.
- Edit the $HADOOP_HOME/etc/hadoop/mapred-site.xml file for Hadoop. Locate the mapreduce.jobtracker.hostname property and change its value to the new hostname. Save and close the file.
- Edit the $HADOOP_HOME/etc/hadoop/slaves file on all nodes. This file lists all the data nodes and task nodes. Replace the hostname of each node with the new hostname. Save and close the file.
- Restart the Hadoop cluster in order for the host name changes to take effect. You can use the following command to restart the cluster:
- Execute the stop-all.sh script located in the sbin directory of the Hadoop home directory. Execute the start-all.sh script located in the sbin directory of the Hadoop home directory.
- This will halt all Hadoop services and restart them.
After completing the above steps, the hostname of your Hadoop cluster should have been successfully changed.