平台安装--环境准备(1)
环境准备
Oracle_Linux_7.3_x86_64.iso
1-1）、节点说明
本例中安装一个六个节点的集群，一个控制节点，两个管理节点，两个数据节点。控制节点主要安装Ambari、Ambari Metrics等服务，用于集群各服务的控制，监控，任务提交等。管理节点主要安装各服务的Master组件，如Namenode、ResourceManager、Hive、Hbase、KDC、OpenLdap、Ranger、Ambari infra等。数据节点主要安装各服务的Slave组件，如Datanode、NodeManager、Regionserver等。
IP地址 | 主机名 | 节点类型 |
|---|---|---|
198.168.199.50 | rdsp-cn-01/rdsp-cn-01.cars.com | 控制节点 |
198.168.199.51 | rdsp-nn-01/rdsp-nn-01.cars.com | 管理节点 |
198.168.199.52 | rdsp-nn-02/rdsp-nn-02.cars.com | |
198.168.199.53 | rdsp-dn-01/rdsp-dn-01.cars.com | 数据节点 |
198.168.199.54 | rdsp-dn-02/rdsp-dn-02.cars.com |
1-2）、设置IP
# vi /etc/sysconfig/network-scripts/ifcfg-enp0s3
TYPE=Ethernet
BOOTPROTO=static
IPADDR=192.168.199.50
NETMASK=255.255.255.0
GATEWAY=192.168.199.1
DNS1=192.168.199.1
DNS2=8.8.8.8
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=enp0s3
UUID=0ddfc571-6d5d-4d1e-9442-f3ef337e7f12
DEVICE=enp0s3
ONBOOT=yes
1-3）、重启网络
# service network restart
1-4）、查看IP
# pifconfig
lo
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope: host
UP LOOPBACK RUNNING
enp0s3 HWaddr 08:00:27:25:cc:9c
inet addr:192.168.0.50 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::32a8:4a1a:3b8c:4cbd/64 Scope: link
UP BROADCAST RUNNING MULTICAST
1-5）、修改主机名字
# hostnamectl set-hostname rdsp-cn-01
# vi /etc/sysconfig/network
# Created by anaconda
HOSTNAME=rdsp-cn-01
1-6）、配置hosts
脚本下载：链接: https://pan.baidu.com/s/1c2OnGq 密码: gkqt
# vi iplist
export ap="192.168.0.50
192.168.0.51
192.168.0.52
192.168.0.53
192.168.0.54"
export op="192.168.0.51
192.168.0.52
192.168.0.53
192.168.0.54"
export dp="192.168.0.53
192.168.0.54"
export np="rdsp-cn-01.cars.com
rdsp-nn-01.cars.com
rdsp-nn-02.cars.com
rdsp-dn-01.cars.com
rdsp-dn-02.cars.com"
1-7）、关闭防火墙
# sh cmd.sh ap "systemctl stop firewalld"
# sh cmd.sh ap " systemctl disable firewalld"
# systemctl status firewalld
# systemctl stop firewalld
# systemctl disable firewalld
1-8）、安装httpd
# sh cmd.sh ap "yum install httpd -y"
1-9）、安装ntp
# sh cmd.sh ap "yum install ntp -y"
# systemctl status ntpd.service
# systemctl enable ntpd.service
1-10）、同步时ssh-copy.sh
# tzselect
*********
# sh sync.sh ap -r "/usr/share/zoneinfo/Asia/Shanghai /etc/localtime"
# sh cmd.sh ap "hwclock"
# sh cmd.sh ap "date"
1-11）、关闭Selinux
A）、临时关闭
# setenforce 0
B）、永久关闭
#vi /etc/selinux/config
修改为SELINUX=disabled
C）、分发文件
# sh sync.sh op -r "/etc/selinux/config /etc/selinux/config"
1-12）、关闭PackageKit
A）、修改
# vi /etc/yum/pluginconf.d/refresh-packagekit.conf
添加enabled=0
B）、分发
sh sync.sh op -r "/etc/yum/pluginconf.d/refresh-packagekit.conf /etc/yum/pluginconf.d/refresh-packagekit.conf"
1-13）、设置umask
A）、修改
# vi /etc/security/limits.conf
* soft noproc 10240
* hard noproc 10240
* soft nofile 10240
* hard nofile 10240
B）、分发
# sh sync.sh ap -r "/etc/security/limits.conf /etc/security/limits.conf"
1-14）、创建httpd目录
# mkdir -p /var/www/html/
# systemctl enable httpd
# systemctl status httpd
1-15）、安装mysql5.6
# service mysqld stop
# yum remove mysql mysql-*
# yum list installed | grep mysql
# rpm -e --nodeps `rpm -qa | grep mysql`
#rpm -Uvh http://repo.mysql.com/mysql-community-release-el6-5.noarch.rpm
#yum install mysql-community-server
#mysql -V
#service mysqld start
登录mysql密码为空，直接回车
# mysql -uroot -p
开启mysql的远程登录权限
mysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY '1234' WITH GRANT OPTION;
Query OK, 0 rows affected (0.00 sec)
刷新使之立刻生效
mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)
修改密码
# mysql -uroot -p
mysql> use mysql;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> update user set password=password("123456") where user='root';
Query OK, 5 rows affected (0.01 sec)
Rows matched: 5 Changed: 5 Warnings: 0
mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)
1-16）、下载安装包（地址）
Ambari: http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-installation/content/ambari_repositories.html
HDP: http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-installation/content/hdp_25_repositories.html
1-17）、nc安装
#sh cmd.sh np "yum install nc"
1-18）、JDK配置
A）、解压软件包
# tar -zxvf jdk-8u131-linux-x64.tar.gz
# mv jdk1.8.0_131 jdk1.8
B）、配置环境变量
# vi /etc/profile
export JAVA_HOME=/opt/jdk1.8
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$JAVA_HOME/bin:$PATH
C）、配置JAVA的JCE
下载地址，链接：https://pan.baidu.com/s/1fC2_v16oLbDipLeHUHdd-g 密码：sgnh
如果无法下载请联系作者
# cp local_policy.jar US_export_policy.jar /opt/jdk1.8/jre/lib/security
1-19）、安装netstart命令
# yum install net-tools