前往小程序,Get更优阅读体验!
立即前往
首页
学习
活动
专区
工具
TVP
发布
社区首页 >专栏 >Flink安装

Flink安装

作者头像
shengjk1
发布2018-10-24 15:27:43
1.1K0
发布2018-10-24 15:27:43
举报
文章被收录于专栏:码字搬砖码字搬砖

前提:安装:已安好hadoop,环境已经配好 java 7.X 及其以上 scala有对应版本 单机: 下载、解压、 需要注意:flink与hadoop版本要对应 解压即安装 Check the JobManager’s web frontend at http://localhost:8081 and make sure everything is up and running. Instead of starting Flink with bin/start-local.sh you can also start Flink in an streaming optimized mode, using bin/start-local-streaming.sh.

ConsumerManager、JobManager

集群:passwordless SSH免登陆 1. Copy the unpacked flink directory from the downloaded archive to the same file system path on each node of your setup. 2. Choose a master node (JobManager) and set the jobmanager.rpc.address key in conf/flink-conf.yaml to its IP or hostname. Make sure that all nodes in your cluster have the same jobmanager.rpc.address configured. 3. Add the IPs or hostnames (one per line) of all worker nodes (TaskManager) to the slaves files in conf/slaves. 4. You can now start the cluster at your master node with bin/start-cluster.sh. If you are planning to run only streaming jobs with Flink, you can also an optimized streaming mode: start-cluster-streaming.sh.

the amount of available memory per TaskManager (taskmanager.heap.mb), the number of available CPUs per machine (taskmanager.numberOfTaskSlots), the total number of CPUs in the cluster (parallelism.default) and the temporary directories (taskmanager.tmp.dirs)

ConsumerManager、TaskManager(slaves)

on yarn

总体来说flink的安装相对于其他的hadoop组件简单很多,这也是软件的一个趋势:傻瓜式。 详情请参照官方文档https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/setup_quickstart.html

本文参与 腾讯云自媒体分享计划,分享自作者个人站点/博客。
原始发表:2016年05月11日,如有侵权请联系 cloudcommunity@tencent.com 删除

本文分享自 作者个人站点/博客 前往查看

如有侵权,请联系 cloudcommunity@tencent.com 删除。

本文参与 腾讯云自媒体分享计划  ,欢迎热爱写作的你一起参与!

评论
登录后参与评论
0 条评论
热度
最新
推荐阅读
领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档