文档建议反馈控制台
首页
学习
活动
专区
工具
TVP
最新优惠活动
文章/答案/技术大牛
发布
精选内容/技术社群/优惠产品,尽在小程序
立即前往
您找到你想要的搜索结果了吗？
是的
没有找到

Hadoop、HBase配置Ganglia指南（metrics1）

Server端： yum install rrdtool ganglia ganglia-gmetad ganglia-gmond ganglia-web httpd php Client端： yum install ganglia-gmond 创建RRD目录 mkdir -p /var/lib/ganglia/rrds  chown ganglia:ganglia /var/lib/ganglia/rrds 编辑/etc/ganglia/gmond.conf cluster {   name = "DFS"   owner = "unspecified"   latlong = "unspecified"   url = "unspecified" } udp_send_channel {   #bind_hostname = yes # Highly recommended, soon to be default.                       # This option tells gmond to use a source address                       # that resolves to the machine's hostname. Without                       # this, the metrics may appear to come from any                       # interface and the DNS names associated with                       # those IPs will be used to create the RRDs.   mcast_join = master.hadoop.test   port = 8649   ttl = 1 }

02

Hadoop运维–HA抛出journalnode can not write

journalnode提示不能写入，后端抛异常 1.6.232:50854: error: org.apache.hadoop.hdfs.qjournal.protocol.JournalNotFormattedException: Journal Storage Directory /data/hadoop/journalnode/journaldata/jn/mycluster not formatted org.apache.hadoop.hdfs.qjournal.protocol.JournalNotFormattedException: Journal Storage Directory /data/hadoop/journalnode/journaldata/jn/mycluster not formatted         at org.apache.hadoop.hdfs.qjournal.server.Journal.checkFormatted(Journal.java:451)         at org.apache.hadoop.hdfs.qjournal.server.Journal.getEditLogManifest(Journal.java:634)         at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.getEditLogManifest(JournalNodeRpcServer.java:177)         at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.getEditLogManifest(QJournalProtocolServerSideTranslatorPB.java:196)         at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:14028)         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1701)         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1697)         at java.security.AccessController.doPrivileged(Native Method)         at javax.security.auth.Subject.doAs(Subject.java:415)         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1695)

02

Ganglia监控Hadoop相关配置及监控指标说明

修改配置文件：$HADOOP_HOME/etc/hadoop/hadoop-metrics.properties 添加如下内容： *.sink.ganglia.class=org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31 *.sink.ganglia.period=10 # default for supportsparse is false *.sink.ganglia.supportsparse=true *.sink.ganglia.slope=jvm.metrics.gcCount=zero,jvm.metrics.memHeapUsedM=both *.sink.ganglia.dmax=jvm.metrics.threadsBlocked=70,jvm.metrics.memHeapUsedM=40 #192.168.0.100组播地址 8801是接受和发送数据端口 namenode.sink.ganglia.servers=239.2.11.71:8801 datanode.sink.ganglia.servers=239.2.11.71:8801 jobtracker.sink.ganglia.servers=239.2.11.71:8801 tasktracker.sink.ganglia.servers=239.2.11.71:8801 maptask.sink.ganglia.servers=239.2.11.71:8801 reducetask.sink.ganglia.servers=239.2.11.71:8801

01

扫码

添加站长 进交流群

领取专属 10元无门槛券

手把手带您无忧上云

扫码加入开发者社群

相关资讯

热门标签

更多标签

活动推荐

    运营活动

    活动名称
    广告关闭

    腾讯云开发者

    扫码关注腾讯云开发者

    扫码关注腾讯云开发者

    领取腾讯云代金券

    热门产品

    热门推荐

    更多推荐

    Copyright © 2013 - 2024 Tencent Cloud. All Rights Reserved. 腾讯云 版权所有

    深圳市腾讯计算机系统有限公司 ICP备案/许可证号：粤B2-20090059 深公网安备号 44030502008569

    腾讯云计算（北京）有限责任公司 京ICP证150476号 | 京ICP备11018762号 | 京公网安备号11010802020287

    领券