修改每台主机的hostname,如果需要的话
hostname <hostname>选择一台机器安装ansible,为了便于从一台机器上操作所有机器
安装zsh & oh-my-zsh,为了更方便的使用命令行(可选)
yum install -y zsh
yum install -y git
sh -c "$(curl -fsSL https://raw.githubusercontent.com/robbyrussell/oh-my-zsh/master/tools/install.sh)"
yum install -y ansible
解决错误 RequestsDependencyWarning: urllib3 (1.22) or chardet (2.2.1) doesn't match a supported version
pip uninstall -y urllib3
pip uninstall -y chardet
pip install requests
禁用command_warnings,在/etc/ansible/ansible.cfg里将command_warnings = False前面的#去掉
将所有机器的内网ip按照分组增加到/etc/ansible/hosts,如下:
[master]
172.20.102.[208:210]
[node]
172.20.102.[211:212]
用root账号通过ssh-keygen生成内网无需密码root登录其它服务器,使用默认选项
用ssh-copy-id将生成的id_rsa.pub传送到所有主机的authorized_hosts里,包括本机,如:
ssh-copy-id root@172.20.102.208
验证ansible是否可以登录所有服务器,如下:
[root@172 ~]# ansible all -m ping -u root
172.20.102.208 | SUCCESS => {
"changed": false,
"ping": "pong"
}
...
更新所有服务器
ansible all -u root -m shell -a "yum update -y"
所有服务器上安装docker
ansible all -u root -m shell -a "yum remove docker docker-client docker-client-latest docker-core docker-latest docker-latest-logrotate docker-logrotate docker-selinux docker-engine-selinux docker-engine"
ansible all -u root -m shell -a "yum install -y yum-utils"
ansible all -u root -m shell -a "yum install -y device-mapper-persistent-data"
ansible all -u root -m shell -a "yum install -y lvm2"
ansible all -u root -m shell -a "yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo"
ansible all -u root -m shell -a "yum install -y docker-ce"
ansible all -u root -m shell -a "systemctl enable docker"
ansible all -u root -m shell -a "systemctl start docker"
每台机器上添加阿里云的kubernetes repo
# cat k8srepo.yaml
cat <<EOF > /etc/yum.repos.d/kubernetes.repo
[kubernetes]
name=Kubernetes
baseurl=http://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64
enabled=1
gpgcheck=0
repo_gpgcheck=0
gpgkey=http://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg
http://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
EOF
# ansible-playbook k8srepo.yaml
安装kubelet, kubeadm, kubectl, ipvsadm
ansible all -u root -m shell -a "yum install -y kubelet kubeadm kubectl ipvsadm"
禁用所有服务器上的swap
ansible all -u root -m shell -a "swapoff -a"
允许所有服务器进行转发,因为k8s的NodePort需要在所有服务器之间进行转发
ansible all -u root -m shell -a "iptables -P FORWARD ACCEPT"
由于k8s.gcr.io不能访问,需要从本机科学上网docker pull如下几个image
k8s.gcr.io/kube-proxy-amd64:v1.11.1
k8s.gcr.io/kube-controller-manager-amd64:v1.11.1
k8s.gcr.io/kube-scheduler-amd64:v1.11.1
k8s.gcr.io/kube-apiserver-amd64:v1.11.1
k8s.gcr.io/coredns:1.1.3
k8s.gcr.io/etcd-amd64:3.2.18
k8s.gcr.io/pause:3.1
通过命令一次完成拉取
while IFS= read -r line; do docker pull $line; done
然后上传到一台服务器
while IFS= read -r line; do docker save <image> | pv | ssh <user>@<server ip> "docker load"; done
同步到所有k8s服务器,其中$i是为了匹配所有内网ip
while IFS= read -r line; do for ((i=208;i<213;i++)); do docker save $line | ssh root@172.20.102.$i "docker load"; done; done
在一台master服务器上初始化集群
kubeadm init --api-advertise-addresses <本机内网ip> --kubernetes-version=v1.11.1
注意最后的kubeadm join一行,用来在其它服务器加入集群(稍后用)
初始化配置,master上执行如下命令
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config
添加calico网络
kubectl apply -f https://docs.projectcalico.org/v3.1/getting-started/kubernetes/installation/hosted/kubeadm/1.7/calico.yaml
从所有其它服务器执行master上获得的kubeadm join那行命令,里面包含了加入的token
执行kubectl get nodes验证集群是否成功