blocks|key|3199477|text|以下是向Hadoop和HBase添加节点的文档。查看文档，不需要重新启动群集。可以动态添加节点。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|3199478|entityMap|0|LINK|mutability|MUTABLE|url|http://wiki.apache.org/hadoop/FAQ#I_have_a_new_node_I_want_to_add_to_a_running_Hadoop_cluster.3B_how_do_I_start_services_on_just_one_node.3F|1|http://wiki.apache.org/hadoop/Hbase/FAQ_Operations#A8^0|4|6|0|B|5|1|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]|$A|R|B|S|1|T]]|C|$]]|$1|D|3|-4|5|6|7|U|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]|L|$5|G|H|I|C|$J|M]]]]

Here is the documentation for adding a node to <a href="http://wiki.apache.org/hadoop/FAQ#I_have_a_new_node_I_want_to_add_to_a_running_Hadoop_cluster.3B_how_do_I_start_services_on_just_one_node.3F">Hadoop</a> and for <a href="http://wiki.apache.org/hadoop/Hbase/FAQ_Operations#A8">HBase</a>. Looking at the documentation, there is no need to restart the cluster. A node can be added dynamically.

blocks|key|3199516|text|如果我理解正确的话，你可以自己协调连接到HBase以保存数据的工作人员。您可以根据需要拥有任意多个此类应用程序，并且它们可以在添加它们时连接到Hbase+(只要它们可以看到zookeeper定额)。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3199517|如果您正在谈论增加Hadoop集群。由于您已经在使用Cloudera，因此可以通过cloudera+Manager+REST+API或Java+client+someone+implemented+for+it|offset|length|3199518|entityMap|0|LINK|mutability|MUTABLE|url|http://cloudera.github.com/cm_api/apidocs/v1/index.html|1|https://github.com/axemblr/cloudera-manager-api#readme^0|0|15|P|0|1V|12|1|0^^$0|@$1|2|3|4|5|6|7|P|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|Q|8|@]|9|@$D|R|E|S|1|T]|$D|U|E|V|1|W]]|A|$]]|$1|F|3|-4|5|6|7|X|8|@]|9|@]|A|$]]]|G|$H|$5|I|J|K|A|$L|M]]|N|$5|I|J|K|A|$L|O]]]]

If I understand you correctly you have workers you coordinate by yourself that connect to HBase to save their data. you can have as many of those as you need and they can connect to Hbase as they're added (as long as they can see the zookeeper quorum).

If you are talking about increasing the Hadoop cluster. Since you already use Cloudera you can do that via the <a href="http://cloudera.github.com/cm_api/apidocs/v1/index.html" rel="nofollow">cloudera Manager REST API</a> or the the <a href="https://github.com/axemblr/cloudera-manager-api#readme" rel="nofollow">Java client someone implemented for it</a>

blocks|key|3199538|text|以下步骤将帮助您将新节点启动到正在运行的集群中。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3199539|1>+Update+the+/etc/hadoop/conf/slaves+list+with+the+new+node-name
2>+Sync+the+full+configuration+/etc/hadoop/conf+to+the+new+datanode+from+the+Namenode.+If+the+file+system+isn't+shared.++
2>++Restart+all+the+hadoop+services+on+Namenode/Tasktracker+and+all+the+services+on+the+new+Datanode.+
3>++Verify+the+new+datanode+from+the+browser+http://namenode:50070
4>++Run+the+balancer+script+to+readjust+the+data+between+the+nodes.+|code-block|syntax|javascript|3199540|如果您不想在添加新节点时重启NN上的服务。我建议将前面的名称添加到slaves配置文件中。因此，在它们可用之前，它们会报告为退役/死节点。遵循上述仅限DataNode的步骤。同样，这也不是最佳实践。|3199541|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

Following steps should help you launch the new node into the running cluster. 

<pre><code>1&gt; Update the /etc/hadoop/conf/slaves list with the new node-name
2&gt; Sync the full configuration /etc/hadoop/conf to the new datanode from the Namenode. If the file system isn't shared. 
2&gt; Restart all the hadoop services on Namenode/Tasktracker and all the services on the new Datanode. 
3&gt; Verify the new datanode from the browser http://namenode:50070
4&gt; Run the balancer script to readjust the data between the nodes. 
</code></pre>

If you don't want to restart the services on the NN, when you add a new node. I would say add the names ahead to the slaves configuration file. So they report as decommission/dead nodes until they are available. Following the above DataNode only steps. Again this not the best practice.

blocks|key|3683144|text|无需重启hadoop集群即可完成此操作。根据此document，您可以在包含文件中添加节点，并在hdfs-site.xml和mapred-site.xml文件中进行一些更改，就可以实现这一点。this+document中提供了详细的说明|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|3683145|entityMap|0|LINK|mutability|MUTABLE|url|http://webthanga.blogspot.in/2016/01/add-new-datanode-in-existing-hadoop.html|1^0|N|8|0|2O|D|1|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@$A|N|B|O|1|P]|$A|Q|B|R|1|S]]|C|$]]|$1|D|3|-4|5|6|7|T|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]|L|$5|G|H|I|C|$J|K]]]]

It can be done without restarting the hadoop cluster. As per this <a href="http://webthanga.blogspot.in/2016/01/add-new-datanode-in-existing-hadoop.html" rel="nofollow">document</a>, You can add nodes in the includes file and and making some changes in the hdfs-site.xml and mapred-site.xml files, you can achieve this. Detailed instructions are given in the <a href="http://webthanga.blogspot.in/2016/01/add-new-datanode-in-existing-hadoop.html" rel="nofollow">this document</a>

blocks|key|3199598|text|使用CDH+5.8.5+(Hadoop+2.6)更新了Cloudera的答案-|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3199599|要向群集中添加新节点，请在ClouderaManager+UI上执行以下步骤：|3199600|3199601|单击您的群集名称。|ordered-list-item|3199602|转到Hosts列表。|3199603|在hosts页面上，单击'Add++Hosts+to+|3199604|3199605|+IP+|3199606|3199607|+Search‘。继续按照说明进行操作，然后继续下一步为新节点分配角色，例如，如果是数据节点，则仅分配与数据节点相关的角色，然后将您的新节点添加到您的集群中。continue.|3199608|Finally+|3199609|。单击Finish。|3199610|3199611|3199612|entityMap^0|0|0|0|0|0|1|1|1|1|1|1|1|0|0^^$0|@$1|2|3|4|5|6|7|Z|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|10|8|@]|9|@]|A|$]]|$1|D|3|-4|5|6|7|11|8|@]|9|@]|A|$]]|$1|E|3|F|5|G|7|12|8|@]|9|@]|A|$]]|$1|H|3|I|5|G|7|13|8|@]|9|@]|A|$]]|$1|J|3|K|5|G|7|14|8|@]|9|@]|A|$]]|$1|L|3|-4|5|G|7|15|8|@]|9|@]|A|$]]|$1|M|3|N|5|6|7|16|8|@]|9|@]|A|$]]|$1|O|3|-4|5|G|7|17|8|@]|9|@]|A|$]]|$1|P|3|Q|5|6|7|18|8|@]|9|@]|A|$]]|$1|R|3|S|5|G|7|19|8|@]|9|@]|A|$]]|$1|T|3|U|5|G|7|1A|8|@]|9|@]|A|$]]|$1|V|3|-4|5|6|7|1B|8|@]|9|@]|A|$]]|$1|W|3|-4|5|6|7|1C|8|@]|9|@]|A|$]]|$1|X|3|-4|5|6|7|1D|8|@]|9|@]|A|$]]]|Y|$]]

Updated Answer for Cloudera using CDH 5.8.5 (Hadoop 2.6)-

To add a new node to your cluster, follow these steps on ClouderaManager UI,

<ol>
<li>Click on your cluster name.</li>
<li>Go to Hosts List.</li>
<li>Once on the hosts page, click 'Add New Hosts to Cluster'.</li>
<li>Enter the IP of your host and Search. </li>
<li>Keep following the instructions and continue to next steps.</li>
<li>Finally assign roles to your new node, for example if it's a data-node,assign only datanode related roles and continue.</li>
<li>Finally your new node is added to your cluster. click Finish.</li>
</ol>

I have been playing with Cloudera and I define the number of clusters before I start my job then use the cloudera manager to make sure everything is running. 

I’m working on a new project that instead of using hadoop is using message queues to distribute the work but the results of the work are stored in HBase. I might launch 10 servers to process the job and store to Hbase but I’m wondering if I later decided to add a few more worker nodes can I easily (read: programmable) make them automatically connect to the running cluster so they can locally add to clusters HBase/HDFS?

Is this possible and what would I need to learn in order to do it?

Is there a way to add nodes to a running Hadoop cluster?

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

我一直在使用Cloudera，我在开始工作之前定义了集群的数量，然后使用cloudera管理器来确保一切都在运行。我正在做一个新项目，它使用消息队列来分发工作，而不是使用hadoop，但工作结果存储在HBase中。我可能会启动10台服务器来处理作业并存储到Hbase，但我想知道如果我后来决定再添加几个工作节点，我可以很...

问有没有办法将节点添加到正在运行的Hadoop集群？
EN

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问有没有办法将节点添加到正在运行的Hadoop集群？EN