Get leader NN http address automatically from hdfs_le_descriptors

Description

This Jira depends on https://hopshadoop.atlassian.net/browse/HOPS-1329.

We should use hdfs_le_descriptors table to get the http address of the leader namenode UI automatically without having to update variables table. Also there are several templating issues in hops-hadoop-chef which this Jira resolves:

  1. dfs.locationDomainId not templated correctly in hdfs-site when hops::default is run after hops::nn

  2. dfs.client.retry.policy.enabled never templated due to naming missmatch with attributes.

  3. dfs.namenode.http-address not templated correctly due to same reason as 1.

  4. Templating of hdfs-site and core-site will only be done in default.rb to avoid rewrites that removes configuration which caused 1. and 3.

  5. Removed a lot of unused hops-hadoop-chef code

 

Assignee

Robin

Reporter

Robin

Labels

None

Fix versions

Priority

High
Configure