禁用IPv6 # echo "alias net-pf-10 off" >> /etc/modprobe.d/dist.conf # echo "alias ipv6 off" >> /etc/modprobe.d/dist.conf
关闭防火墙 $ sudo service iptables stop $ sudo chkconfig iptables off
禁用Selinux $ sudo vi /etc/sysconfig/selinux 修改:SELINUX=disabled
卸载自带JDK $ sudo rpm -qa|grep java $ sudo rpm -e --nodeps 'jdkname'
设置文件打开数量和用户最大进程数 文件打开数量 $ ulimit -a 用户最大进程数 $ ulimit -u 设置 $ sudo vi /etc/security/limits.conf 内容: * soft nofile 65535 * hard nofile 65535 * soft nproc 32000 * hard nproc 32000
集群时间同步:以本地集群的一台服务器为准 ·找一台机器作为【时间服务器】 ·客户端同步:定任务Linux Crontab
以 CDH5.3.6 为例
1.bin文件: http://archive.cloudera.com/cm5/installer/5.3.6/cloudera-manager-installer.bin 2.依赖rpm包 : http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/RPMS/x86_64/ 下所有的rpm包
$sudo service httpd status $sudo service httpd start $sudo chkconfig httpd on
2.搭建本地源: $sudo mkdir -p /var/www/html/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64,并将之前下载的rpm包放入该目录下
注释:apache服务器根目录对应本地服务器的/var/www/html/,搭建的目的是为了构建出一个本地可访问的:http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/RPMS/x86_64/
3.创建“repodata” $ cd /var/www/html/cm5/redhat/6/x86_64/cm/5 $ createrepo ./
注释:安装 createrepo 工具: 1.下载rpm包: https://pkgs.org/download/createrepo 2.下载依赖包:https://pkgs.org/download/deltarpm和https://pkgs.org/download/python-deltarpm; createrepo-0.9.9-26.el6.noarch.rpm deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm python-deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm 3.安装 :$rpm -ivh ./*.rpm
1.$rpm -qa|grep postgres $rpm -e xxx 2.前往:http://yum.postgresql.org/8.4/redhat/rhel-6-x86_64/repoview/ 上下载postgresql8.4的下面三个包 postgresql84-8.4.21-1PGDG.rhel6.x86_64.rpm postgresql84-libs-8.4.21-1PGDG.rhel6.x86_64.rpm postgresql84-server-8.4.21-1PGDG.rhel6.x86_64.rpm 3.安装postgresql-server $rpm -ivh ./*
5.配置yum 源 $vi /etc/yum.repos.d/cloudera-manager.repo 输入内容:
[cloudera-manager] name=Cloudera Manager baseurl=http://test1/cm5/redhat/6/x86_64/cm/5/ gpgcheck=0 enabled=1
6.通过之前下载的bin文件进行安装
到此为止,完成 cloudera server 的安装