如何通过CM API优雅的获取元数据库密码

Fayson

修改于 2018-04-01 19:12:05

3.2K0

修改于 2018-04-01 19:12:05

文章被收录于专栏：Hadoop实操

温馨提示：要看高清无码套图，请使用手机打开并单击图片放大查看。

1.问题描述

人啊，上了年纪了，总容易忘记一些事情，比如你一不小心就忘记了CDH集群Hive，Hue和Sentry服务的元数据库密码，对于数据库（MySQL/Oracle/PostgreSQL）管理员来说，可能有自己独特的一些奇技淫巧来找回密码。但对于咱普通人，其实Cloudera Manger提供了一种很优雅的方式让你找回元数据库密码，那就是神奇的Cloudera Manager API。

2.解决方法

2.1通过HTTP方式

1.获取Cloudera Manager所有集群信息

在浏览器输入如下地址，将<cmserver>替换为CM的IP地址

http://<cmserver>:7180/api/v10/clusters/

输入CM的账号密码

获取集群信息：

{
  "items" : [ {
    "name" : "cluster",
    "displayName" : "Cluster 1",
    "version" : "CDH5",
    "fullVersion" : "5.11.2",
    "maintenanceMode" : false,
    "maintenanceOwners" : [ ],
    "clusterUrl" : "http://ip-172-31-22-86.ap-southeast-1.compute.internal:7180/cmf/clusterRedirect/cluster"
  } ]
}

2.通过上一步获取的集群信息，获取指定集群的Services

在浏览器输入如下地址，将<cmserver>替换成CM的IP地址，<cluster_name>替换为上一步中获取到的集群名称

http://<cmserver>:7180/api/v10/clusters/<cluster_name>/services/

{
  "items" : [ …{
    "name" : "hue",
    "type" : "HUE",
    "clusterRef" : {
      "clusterName" : "cluster"
    },
    "serviceUrl" : "http://ip-172-31-22-86.ap-southeast-1.compute.internal:7180/cmf/serviceRedirect/hue",
    "serviceState" : "STARTED",
    "healthSummary" : "GOOD",
    "healthChecks" : [ {
      "name" : "HUE_HUE_SERVERS_HEALTHY",
      "summary" : "GOOD"
    } ],
    "configStalenessStatus" : "FRESH",
    "clientConfigStalenessStatus" : "FRESH",
    "maintenanceMode" : false,
    "maintenanceOwners" : [ ],
    "displayName" : "Hue"
  } …]
}

以上为获取到的json数据片段，标红部分为Services名称。

3.通过服务名称获取，该服务的配置信息

在浏览器输入如下地址，将<cmserver>替换成CM的IP地址，<cluster_name>替换为集群名称，将<service_name>替换为指定服务的名称

http://<cmserver>:7180/api/v10/clusters/<cluster_name>/services/<service_name>/config

{
  "items" : [ {
    "name" : "database_host",
    "value" : "ip-172-31-22-86.ap-southeast-1.compute.internal"
  }, {
    "name" : "database_password",
    "value" : "password"
  }, {
    "name" : "database_type",
    "value" : "mysql"
  }... ]
}

这样就获取到了相应服务的配置信息，标红部分即为该服务的数据库密码。

2.2命令行方式

1.获取集群信息

将<cm_admin_user>替换为CM的用户名，<cm_admin_pass>替换为CM对应用户密码，<cmserver>替换为CM的IP地址

curl -v -k -X GET -u <cm_admin_user>:<cm_admin_pass> http://<cmserver>:7180/api/v10/clusters/

命令行执行

[ec2-user@ip-172-31-22-86 ~]$ curl -v -k -X GET -u admin:admin http://ip-172-31-22-86:7180/api/v10/clusters/
...
{
  "items" : [ {
    "name" : "cluster",
    "displayName" : "Cluster 1",
    "version" : "CDH5",
    "fullVersion" : "5.11.2",
    "maintenanceMode" : false,
    "maintenanceOwners" : [ ],
    "clusterUrl" : "http://ip-172-31-22-86.ap-southeast-1.compute.internal:7180/cmf/clusterRedirect/cluster"
  } ]
* Connection #0 to host ip-172-31-22-86 left intact
}
[ec2-user@ip-172-31-22-86 ~]$

标注部分为获取到的集群名称。

2.获取指定集群的Services

将如下命令中相应参数替换，<cloudera_name>替换为上一步获取到的集群名称

curl -v -k -X GET -u <cm_admin_user>:<cm_admin_pass> http://<cmserver>:7180/api/v10/clusters/<cluster_name>/services/

命令行执行：

[ec2-user@ip-172-31-22-86 ~]$ curl -v -k -X GET -u admin:admin http://ip-172-31-22-86:7180/api/v10/clusters/cluster/services/
...
{
  "items" : [ {
    "name" : "hive",
    "type" : "HIVE",
    "clusterRef" : {
      "clusterName" : "cluster"
    },
    "serviceUrl" : "http://ip-172-31-22-86.ap-southeast-1.compute.internal:7180/cmf/serviceRedirect/hive",
    "serviceState" : "STARTED",
    "healthSummary" : "GOOD",
    "healthChecks" : [ {
      "name" : "HIVE_HIVEMETASTORES_HEALTHY",
      "summary" : "GOOD"
    }, {
      "name" : "HIVE_HIVESERVER2S_HEALTHY",
      "summary" : "GOOD"
    } ],
    "configStalenessStatus" : "FRESH",
    "clientConfigStalenessStatus" : "FRESH",
    "maintenanceMode" : false,
    "maintenanceOwners" : [ ],
    "displayName" : "Hive"
  } ...]
}
[ec2-user@ip-172-31-22-86 ~]$

标注部分为服务名称。

3.根据获取到的Service名称，获取该服务的配置

将一下命令中参数替换为自己环境信息，<service_name>替换为上一步获取到的服务名称。

curl -v -k -X GET -u <cm_admin_user>: <cm_admin_pass>http://<cmserver>:7180/api/v10/clusters/<cluster_name>/services/<service_name>/config

命令行执行：

[ec2-user@ip-172-31-22-86 ~]$ curl -v -k -X GET -u admin:admin http://ip-172-31-22-86:7180/api/v10/clusters/cluster/services/hive/config
...
{
  "items" : [ {
    "name" : "hive_metastore_database_host",
    "value" : "ip-172-31-22-86.ap-southeast-1.compute.internal"
  }, {
    "name" : "hive_metastore_database_password",
    "value" : "password"
  }, {
    "name" : "mapreduce_yarn_service",
    "value" : "yarn"
  }, {
    "name" : "zookeeper_service",
    "value" : "zookeeper"
  } ]
* Connection #0 to host ip-172-31-22-86 left intact
}
[ec2-user@ip-172-31-22-86 ~]$