学习
实践
活动
专区
工具
TVP
写文章

Docker:Spark on Yarn

Spark on Yarn within Docker Containers

The open source project "spark-on-yarn"

GitHub:

https://github.com/madaibaba/spark-on-yarn

Docker Hub:

https://hub.docker.com/r/madaibaba/spark-on-yarn

Bigmap of "hadoop-on-docker" archtect

How to use it:

1. Clone Github Repository

2. Pull Docker Image

3. Start Docker Container

3.1 Start Three Container for default (one master and two slaves)

3.2 Start six Container as below (one master and five slaves)

Another open source project "hadoop-on-docker" without spark install, as below:

GitHub:

https://github.com/madaibaba/hadoop-on-docker

Docker Hub:

https://hub.docker.com/r/madaibaba/haoop-on-docker

  • 发表于:
  • 原文链接http://kuaibao.qq.com/s/20180228G0KI1H00?refer=cp_1026
  • 腾讯「腾讯云开发者社区」是腾讯内容开放平台帐号(企鹅号)传播渠道之一,根据《腾讯内容开放平台服务协议》转载发布内容。
  • 如有侵权,请联系 cloudcommunity@tencent.com 删除。

关注

腾讯云开发者公众号
10元无门槛代金券
洞察腾讯核心技术
剖析业界实践案例
腾讯云开发者公众号二维码

扫码关注腾讯云开发者

领取腾讯云代金券