<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>duiniwukenaihe</title>
    <description>blog &amp; blog theme🤘</description>
    <link>https://duiniwukenaihe.github.io/</link>
    <atom:link href="https://duiniwukenaihe.github.io/feed.xml" rel="self" type="application/rss+xml"/>
    <pubDate>Tue, 09 Aug 2022 11:20:59 +0000</pubDate>
    <lastBuildDate>Tue, 09 Aug 2022 11:20:59 +0000</lastBuildDate>
    <generator>Jekyll v3.9.2</generator>
    
      <item>
        <title>2022-08-09-Operator3-设计一个operator二-owns的使用</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#deployment-ingress-service关于owns的使用&quot; id=&quot;markdown-toc-deployment-ingress-service关于owns的使用&quot;&gt;Deployment Ingress Service关于Owns的使用&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#deployment&quot; id=&quot;markdown-toc-deployment&quot;&gt;Deployment&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#deployment-delete尝试&quot; id=&quot;markdown-toc-deployment-delete尝试&quot;&gt;Deployment delete尝试&lt;/a&gt;&lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#ingress-and-service资源&quot; id=&quot;markdown-toc-ingress-and-service资源&quot;&gt;Ingress and Service资源&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#简单添加一下owns&quot; id=&quot;markdown-toc-简单添加一下owns&quot;&gt;简单添加一下Owns？&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#拆分改造代码&quot; id=&quot;markdown-toc-拆分改造代码&quot;&gt;拆分改造代码&lt;/a&gt;&lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#最终代码&quot; id=&quot;markdown-toc-最终代码&quot;&gt;最终代码：&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#总结&quot; id=&quot;markdown-toc-总结&quot;&gt;总结&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;
上一节（&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/hg6ymd/cgvon5&quot;&gt;Operator3-设计一个operator&lt;/a&gt;）做完发现一个问题  我创建了jan 应用jan-sample，子资源包括deployment，service.ingress,pod(其中pod是deployment管理的) 
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1659528000127-15866844-c226-40bb-b0d3-fb8de36962f9.png#clientId=u8920b99d-e7b3-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=152&amp;amp;id=u1308682e&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=137&amp;amp;originWidth=987&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=28867&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uf1c5964c-59fd-486d-803d-4df55f0ca1e&amp;amp;title=&amp;amp;width=1096.6666957184127&quot; alt=&quot;image.png&quot; /&gt;
手动删除Pod.由于Deployment rc控制器。Pod资源可以自动重建。但是我删除deployment能不能自动重建呢？正常的deployment service ingress子资源的生命周期，我应该是靠jan应用去维系的，试一试：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng jan]$ kubectl delete deployment jan-sample
deployment.apps &quot;jan-sample&quot; deleted
[zhangpeng@zhangpeng jan]$ kubectl get deployment
No resources found in default namespace.

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1659528168440-3608a6d2-5623-4179-952e-64f49f46192e.png#clientId=u8920b99d-e7b3-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=210&amp;amp;id=u5af22a9d&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=189&amp;amp;originWidth=1222&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=42096&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u9cb304e4-3aee-4cb1-9a93-90ded5dd873&amp;amp;title=&amp;amp;width=1357.7778137466064&quot; alt=&quot;image.png&quot; /&gt;
到这里才发现没有考虑周全……删除deployment资源并不能重建，正常创建应用应该要考虑一下jan资源下面资源的重建.搜了一下别人写的operator貌似的可以加一下&lt;strong&gt;Owns&lt;/strong&gt;，尝试一下！
&lt;h1 id=&quot;deployment-ingress-service关于owns的使用&quot;&gt;Deployment Ingress Service关于Owns的使用&lt;/h1&gt;
&lt;h2 id=&quot;deployment&quot;&gt;Deployment&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;func (r *JanReconciler) SetupWithManager(mgr ctrl.Manager) error {
	return ctrl.NewControllerManagedBy(mgr).
		For(&amp;amp;janv1.Jan{}).
		Owns(&amp;amp;appsv1.Deployment{}).
		Complete(r)
}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;h3 id=&quot;deployment-delete尝试&quot;&gt;Deployment delete尝试&lt;/h3&gt;
make run develop-operator项目，并尝试delete deployment jan-sample查看是否重建：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng develop-operator]$ kubectl get Jan
[zhangpeng@zhangpeng develop-operator]$ kubectl get all
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1659530912074-8ceac1b7-0334-46b0-b0c1-ee8ef0d5ed2f.png#clientId=u8920b99d-e7b3-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=419&amp;amp;id=u221ec4da&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=377&amp;amp;originWidth=1021&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=66141&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uf1b61098-16a8-4e51-968f-4976d2a2e7f&amp;amp;title=&amp;amp;width=1134.4444744969599&quot; alt=&quot;image.png&quot; /&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng develop-operator]$ kubectl delete deployment jan-sample
[zhangpeng@zhangpeng develop-operator]$ kubectl get deployment
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1659530950179-e44d27bb-0a0d-44cb-b255-51350b2189d9.png#clientId=u8920b99d-e7b3-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=370&amp;amp;id=u612daa44&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=333&amp;amp;originWidth=1022&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=64143&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u4afa87f9-5c65-4753-bd78-01fa191b8be&amp;amp;title=&amp;amp;width=1135.5555856375054&quot; alt=&quot;image.png&quot; /&gt;
恩发现deployment应用可以自动重建了！

&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1659531464374-e00c465b-c5a7-4be9-bbaa-e3de24356a05.png#clientId=u8920b99d-e7b3-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=679&amp;amp;id=uab1469fa&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=611&amp;amp;originWidth=1316&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=127261&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uf8d552a0-16b8-4034-bfeb-fa7e02ccc46&amp;amp;title=&amp;amp;width=1462.2222609578837&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;ingress-and-service资源&quot;&gt;Ingress and Service资源&lt;/h2&gt;
&lt;h3 id=&quot;简单添加一下owns&quot;&gt;简单添加一下Owns？&lt;/h3&gt;
but其他资源是否可以呢？是不是也偷懒一下添加&lt;strong&gt;Owns&lt;/strong&gt;？
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;func (r *JanReconciler) SetupWithManager(mgr ctrl.Manager) error {
	return ctrl.NewControllerManagedBy(mgr).
		For(&amp;amp;janv1.Jan{}).
		Owns(&amp;amp;appsv1.Deployment{}).
		Owns(&amp;amp;corev1.Service{}).
		Owns(&amp;amp;v1.Ingress{}).
		Complete(r)
}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
尝试了一下不生效的，但是这种方式思路是对的至于为什么不生效呢？
deploy声明了&amp;amp;appv1.Deployment,但是service,ingress是没有创建变量声明的！
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1659953527109-e2868b4b-0611-4ccb-9791-e3d280a195f9.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=226&amp;amp;id=ue7d9e6bf&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=203&amp;amp;originWidth=646&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=32036&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ua8c9aae1-9c45-4268-9ee8-fbdb33d2da5&amp;amp;title=&amp;amp;width=717.7777967923959&quot; alt=&quot;image.png&quot; /&gt;
&lt;h3 id=&quot;拆分改造代码&quot;&gt;拆分改造代码&lt;/h3&gt;
继续改造Jan operator使其支持service ingress子资源的误删除创建：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660011155926-870d31ca-f0e5-4489-8450-614bf73545ca.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=598&amp;amp;id=u913bf42d&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=538&amp;amp;originWidth=699&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=86422&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u55ee35eb-1241-48f2-b6f9-54a4144effd&amp;amp;title=&amp;amp;width=776.6666872413075&quot; alt=&quot;image.png&quot; /&gt;
把这边拆分一下？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660035140956-da721743-fd26-48ec-8c32-b62b3362b579.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=560&amp;amp;id=ud2c3bfbf&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=504&amp;amp;originWidth=1092&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=84034&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u33c622c8-ba40-4700-925b-98dc018c140&amp;amp;title=&amp;amp;width=1213.3333654756907&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660035164638-5804a65e-df73-4154-bf98-d179e1adb969.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=549&amp;amp;id=uf154cae7&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=494&amp;amp;originWidth=1078&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=78945&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u689f6efe-fd8f-4af9-bc2d-bb712b4723f&amp;amp;title=&amp;amp;width=1197.7778095080537&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660035188517-b9b82d22-9e50-4ecf-a075-d2bed326d85e.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=557&amp;amp;id=u6da450ce&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=501&amp;amp;originWidth=1152&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=79337&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u08d562a7-81f9-4ff3-8915-3bef4e045ec&amp;amp;title=&amp;amp;width=1280.000033908421&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660035272984-cfaae0e3-d954-4ca8-967b-497cd01d9e54.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=343&amp;amp;id=u76002480&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=309&amp;amp;originWidth=810&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=39839&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u2eca81fc-588d-47a0-9e26-63296312b1f&amp;amp;title=&amp;amp;width=900.0000238418586&quot; alt=&quot;image.png&quot; /&gt;
jan_controller.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;/*
Copyright 2022 zhang peng.

Licensed under the Apache License, Version 2.0 (the &quot;License&quot;);
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an &quot;AS IS&quot; BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
*/

package jan

import (
	&quot;context&quot;
	&quot;encoding/json&quot;
	appsv1 &quot;k8s.io/api/apps/v1&quot;
	corev1 &quot;k8s.io/api/core/v1&quot;
	v1 &quot;k8s.io/api/networking/v1&quot;
	&quot;k8s.io/apimachinery/pkg/api/errors&quot;
	&quot;k8s.io/apimachinery/pkg/runtime&quot;
	utilruntime &quot;k8s.io/apimachinery/pkg/util/runtime&quot;
	&quot;reflect&quot;
	ctrl &quot;sigs.k8s.io/controller-runtime&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/log&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/reconcile&quot;

	janv1 &quot;develop-operator/apis/jan/v1&quot;
)

// JanReconciler reconciles a Jan object
type JanReconciler struct {
	client.Client
	Scheme *runtime.Scheme
}

//+kubebuilder:rbac:groups=mar.zhangpeng.com,resources=jan,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=mar.zhangpeng.com,resources=jan/status,verbs=get;update;patch
//+kubebuilder:rbac:groups=mar.zhangpeng.com,resources=jan/finalizers,verbs=update
//+kubebuilder:rbac:groups=apps,resources=deployments,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=apps,resources=deployments/status,verbs=get;update;patch
//+kubebuilder:rbac:groups=core,resources=services,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=networking,resources=ingresses,verbs=get;list;watch;create;update;patch;delete

// Reconcile is part of the main kubernetes reconciliation loop which aims to
// move the current state of the cluster closer to the desired state.
// TODO(user): Modify the Reconcile function to compare the state specified by
// the Jan object against the actual cluster state, and then
// perform operations to make the cluster state reflect the state specified by
// the user.
//
// For more details, check Reconcile and its Result here:
// - https://pkg.go.dev/sigs.k8s.io/controller-runtime@v0.11.2/pkg/reconcile
func (r *JanReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	defer utilruntime.HandleCrash()
	_ = log.FromContext(ctx)
	instance := &amp;amp;janv1.Jan{}
	err := r.Client.Get(context.TODO(), req.NamespacedName, instance)
	if err != nil {
		if errors.IsNotFound(err) {
			// Request object not found, could have been deleted after reconcile request.
			// Owned objects are automatically garbage collected. For additional cleanup logic use finalizers.
			// Return and don't requeue
			return reconcile.Result{}, nil
		}
		// Error reading the object - requeue the request.
		return reconcile.Result{}, err
	}
	if instance.DeletionTimestamp != nil {
		return reconcile.Result{}, err
	}

	// 如果不存在，则创建关联资源
	// 如果存在，判断是否需要更新
	//   如果需要更新，则直接更新
	//   如果不需要更新，则正常返回

	deploy := &amp;amp;appsv1.Deployment{}

	if err := r.Client.Get(context.TODO(), req.NamespacedName, deploy); err != nil &amp;amp;&amp;amp; errors.IsNotFound(err) {
		// 创建关联资源
		// 1. 创建 Deploy
		deploy := NewJan(instance)
		if err := r.Client.Create(context.TODO(), deploy); err != nil {
			return reconcile.Result{}, err
		}
		// 4. 关联 Annotations
		data, _ := json.Marshal(instance.Spec)

		if instance.Annotations != nil {
			instance.Annotations[&quot;spec&quot;] = string(data)
		} else {
			instance.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), instance); err != nil {
			return reconcile.Result{}, nil
		}
		return reconcile.Result{}, nil
	}
	Service := &amp;amp;corev1.Service{}

	if err := r.Client.Get(context.TODO(), req.NamespacedName, Service); err != nil &amp;amp;&amp;amp; errors.IsNotFound(err) {

		// 2. 创建 Service
		service := NewService(instance)
		if err := r.Client.Create(context.TODO(), service); err != nil {
			return reconcile.Result{}, err
		}
		// 4. 关联 Annotations
		data, _ := json.Marshal(service.Spec)

		if service.Annotations != nil {
			service.Annotations[&quot;spec&quot;] = string(data)
		} else {
			service.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), service); err != nil {
			return reconcile.Result{}, nil
		}
		return reconcile.Result{}, nil
	}
	Ingress := &amp;amp;v1.Ingress{}

	if err := r.Client.Get(context.TODO(), req.NamespacedName, Ingress); err != nil &amp;amp;&amp;amp; errors.IsNotFound(err) {

		// 2. 创建 Service
		ingress := NewIngress(instance)
		if err := r.Client.Create(context.TODO(), ingress); err != nil {
			return reconcile.Result{}, err
		}
		// 4. 关联 Annotations
		data, _ := json.Marshal(ingress.Spec)

		if ingress.Annotations != nil {
			ingress.Annotations[&quot;spec&quot;] = string(data)
		} else {
			ingress.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), ingress); err != nil {
			return reconcile.Result{}, nil
		}
		return reconcile.Result{}, nil
	}
	oldspec := janv1.JanSpec{}
	if err := json.Unmarshal([]byte(instance.Annotations[&quot;spec&quot;]), &amp;amp;oldspec); err != nil {
		return reconcile.Result{}, err
	}

	if !reflect.DeepEqual(instance.Spec, oldspec) {
		data, _ := json.Marshal(instance.Spec)

		if instance.Annotations != nil {
			instance.Annotations[&quot;spec&quot;] = string(data)
		} else {
			instance.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), instance); err != nil {
			return reconcile.Result{}, nil
		}
		// 更新关联资源
		newDeploy := NewJan(instance)
		oldDeploy := &amp;amp;appsv1.Deployment{}
		if err := r.Client.Get(context.TODO(), req.NamespacedName, oldDeploy); err != nil {
			return reconcile.Result{}, err
		}
		oldDeploy.Spec = newDeploy.Spec
		if err := r.Client.Update(context.TODO(), oldDeploy); err != nil {
			return reconcile.Result{}, err
		}

		newService := NewService(instance)
		oldService := &amp;amp;corev1.Service{}
		if err := r.Client.Get(context.TODO(), req.NamespacedName, oldService); err != nil {
			return reconcile.Result{}, err
		}
		oldService.Spec = newService.Spec
		if err := r.Client.Update(context.TODO(), oldService); err != nil {
			return reconcile.Result{}, err
		}
		return reconcile.Result{}, nil
	}
	newStatus := janv1.JanStatus{
		Replicas:      *instance.Spec.Replicas,
		ReadyReplicas: instance.Status.Replicas,
	}

	if newStatus.Replicas == newStatus.ReadyReplicas {
		newStatus.Phase = janv1.Running
	} else {
		newStatus.Phase = janv1.NotReady
	}
	if !reflect.DeepEqual(instance.Status, newStatus) {
		instance.Status = newStatus
		log.FromContext(ctx).Info(&quot;update game status&quot;, &quot;name&quot;, instance.Name)
		err = r.Client.Status().Update(ctx, instance)
		if err != nil {
			return reconcile.Result{}, err
		}
	}
	return reconcile.Result{}, nil
}

// SetupWithManager sets up the controller with the Manager.
func (r *JanReconciler) SetupWithManager(mgr ctrl.Manager) error {
	return ctrl.NewControllerManagedBy(mgr).
		For(&amp;amp;janv1.Jan{}).
		Owns(&amp;amp;appsv1.Deployment{}).
		Owns(&amp;amp;corev1.Service{}).
		Owns(&amp;amp;v1.Ingress{}).
		Complete(r)
}

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

make run尝试一下：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660036063175-3ee7e4ef-60b0-44c8-affa-c33b3d3046a4.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=544&amp;amp;id=ua19210a3&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=490&amp;amp;originWidth=1539&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=162340&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=udc74dfa4-f641-416e-86e9-d829b0b03f9&amp;amp;title=&amp;amp;width=1710.0000452995312&quot; alt=&quot;image.png&quot; /&gt;
注意：make run之前默认删除jan应用！
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng develop-operator]$ kubectl delete svc jan-sample
[zhangpeng@zhangpeng develop-operator]$ kubectl get svc
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
en service的自动恢复生效了
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660036097535-feea4439-d540-4934-94af-31857f3aa1a5.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=548&amp;amp;id=u3dd025ac&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=493&amp;amp;originWidth=1113&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=93613&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u7efc0b9b-e948-4c16-9bc7-b027417fb40&amp;amp;title=&amp;amp;width=1236.6666994271463&quot; alt=&quot;image.png&quot; /&gt;
然后试一试ingress
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng develop-operator]$ kubectl get ingress
[zhangpeng@zhangpeng develop-operator]$ kubectl delete ingress jan-sample
[zhangpeng@zhangpeng develop-operator]$ kubectl get ingress

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660036222840-80818540-fa2a-43d1-b9ef-0ee78363f501.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=247&amp;amp;id=u45177af3&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=222&amp;amp;originWidth=1053&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=46076&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ud45ab86c-cb63-4336-8118-de2056425a9&amp;amp;title=&amp;amp;width=1170.0000309944162&quot; alt=&quot;image.png&quot; /&gt;
继续发现问题:
en,我修改一下jan_v1_jan.yaml中host ww1.zhangpeng.com修改为ww11.zhangpeng.com,but ingress的相关信息没有及时更新啊？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660036302109-91ef321d-7aaf-444e-abf3-3fa3e0a05310.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=903&amp;amp;id=u6ff19330&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=813&amp;amp;originWidth=1527&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=167880&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ud3a24346-8f84-45f7-a0ba-58f4d9ad0d8&amp;amp;title=&amp;amp;width=1696.6667116129852&quot; alt=&quot;image.png&quot; /&gt;
继续模仿一下上面的service oldservice newservice新增 newIngress  oldIngress ：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660036326647-c47b4e3c-658e-4076-b1f5-10bd85b16770.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=541&amp;amp;id=u01b83f4f&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=487&amp;amp;originWidth=1186&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=93278&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u1b2c5fd9-8062-4d42-9373-bc791fc0d9d&amp;amp;title=&amp;amp;width=1317.7778126869682&quot; alt=&quot;image.png&quot; /&gt;
重新make run
ingress相关信息得到了修改
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1660036450676-696614ad-9106-4495-97cb-f496a070a854.png#clientId=u70c9a5f9-fd6a-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=1010&amp;amp;id=uc6c8ef64&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=909&amp;amp;originWidth=1590&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=218706&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u0ab84249-ca04-482e-b600-80ca6b7da3d&amp;amp;title=&amp;amp;width=1766.6667134673519&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;最终代码&quot;&gt;最终代码：&lt;/h2&gt;
jan_controller.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;/*
Copyright 2022 zhang peng.

Licensed under the Apache License, Version 2.0 (the &quot;License&quot;);
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an &quot;AS IS&quot; BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
*/

package jan

import (
	&quot;context&quot;
	&quot;encoding/json&quot;
	appsv1 &quot;k8s.io/api/apps/v1&quot;
	corev1 &quot;k8s.io/api/core/v1&quot;
	v1 &quot;k8s.io/api/networking/v1&quot;
	&quot;k8s.io/apimachinery/pkg/api/errors&quot;
	&quot;k8s.io/apimachinery/pkg/runtime&quot;
	utilruntime &quot;k8s.io/apimachinery/pkg/util/runtime&quot;
	&quot;reflect&quot;
	ctrl &quot;sigs.k8s.io/controller-runtime&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/log&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/reconcile&quot;

	janv1 &quot;develop-operator/apis/jan/v1&quot;
)

// JanReconciler reconciles a Jan object
type JanReconciler struct {
	client.Client
	Scheme *runtime.Scheme
}

//+kubebuilder:rbac:groups=mar.zhangpeng.com,resources=jan,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=mar.zhangpeng.com,resources=jan/status,verbs=get;update;patch
//+kubebuilder:rbac:groups=mar.zhangpeng.com,resources=jan/finalizers,verbs=update
//+kubebuilder:rbac:groups=apps,resources=deployments,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=apps,resources=deployments/status,verbs=get;update;patch
//+kubebuilder:rbac:groups=core,resources=services,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=networking,resources=ingresses,verbs=get;list;watch;create;update;patch;delete

// Reconcile is part of the main kubernetes reconciliation loop which aims to
// move the current state of the cluster closer to the desired state.
// TODO(user): Modify the Reconcile function to compare the state specified by
// the Jan object against the actual cluster state, and then
// perform operations to make the cluster state reflect the state specified by
// the user.
//
// For more details, check Reconcile and its Result here:
// - https://pkg.go.dev/sigs.k8s.io/controller-runtime@v0.11.2/pkg/reconcile
func (r *JanReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	defer utilruntime.HandleCrash()
	_ = log.FromContext(ctx)
	instance := &amp;amp;janv1.Jan{}
	err := r.Client.Get(context.TODO(), req.NamespacedName, instance)
	if err != nil {
		if errors.IsNotFound(err) {
			// Request object not found, could have been deleted after reconcile request.
			// Owned objects are automatically garbage collected. For additional cleanup logic use finalizers.
			// Return and don't requeue
			return reconcile.Result{}, nil
		}
		// Error reading the object - requeue the request.
		return reconcile.Result{}, err
	}
	if instance.DeletionTimestamp != nil {
		return reconcile.Result{}, err
	}

	// 如果不存在，则创建关联资源
	// 如果存在，判断是否需要更新
	//   如果需要更新，则直接更新
	//   如果不需要更新，则正常返回

	deploy := &amp;amp;appsv1.Deployment{}

	if err := r.Client.Get(context.TODO(), req.NamespacedName, deploy); err != nil &amp;amp;&amp;amp; errors.IsNotFound(err) {
		// 创建关联资源
		// 1. 创建 Deploy
		deploy := NewJan(instance)
		if err := r.Client.Create(context.TODO(), deploy); err != nil {
			return reconcile.Result{}, err
		}
		// 4. 关联 Annotations
		data, _ := json.Marshal(instance.Spec)

		if instance.Annotations != nil {
			instance.Annotations[&quot;spec&quot;] = string(data)
		} else {
			instance.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), instance); err != nil {
			return reconcile.Result{}, nil
		}
		return reconcile.Result{}, nil
	}
	Service := &amp;amp;corev1.Service{}

	if err := r.Client.Get(context.TODO(), req.NamespacedName, Service); err != nil &amp;amp;&amp;amp; errors.IsNotFound(err) {

		// 2. 创建 Service
		service := NewService(instance)
		if err := r.Client.Create(context.TODO(), service); err != nil {
			return reconcile.Result{}, err
		}
		// 4. 关联 Annotations
		data, _ := json.Marshal(service.Spec)

		if service.Annotations != nil {
			service.Annotations[&quot;spec&quot;] = string(data)
		} else {
			service.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), service); err != nil {
			return reconcile.Result{}, nil
		}
		return reconcile.Result{}, nil
	}
	Ingress := &amp;amp;v1.Ingress{}

	if err := r.Client.Get(context.TODO(), req.NamespacedName, Ingress); err != nil &amp;amp;&amp;amp; errors.IsNotFound(err) {

		// 2. 创建 Ingress
		ingress := NewIngress(instance)
		if err := r.Client.Create(context.TODO(), ingress); err != nil {
			return reconcile.Result{}, err
		}
		// 4. 关联 Annotations
		data, _ := json.Marshal(ingress.Spec)

		if ingress.Annotations != nil {
			ingress.Annotations[&quot;spec&quot;] = string(data)
		} else {
			ingress.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), ingress); err != nil {
			return reconcile.Result{}, nil
		}
		return reconcile.Result{}, nil
	}
	oldspec := janv1.JanSpec{}
	if err := json.Unmarshal([]byte(instance.Annotations[&quot;spec&quot;]), &amp;amp;oldspec); err != nil {
		return reconcile.Result{}, err
	}

	if !reflect.DeepEqual(instance.Spec, oldspec) {
		data, _ := json.Marshal(instance.Spec)

		if instance.Annotations != nil {
			instance.Annotations[&quot;spec&quot;] = string(data)
		} else {
			instance.Annotations = map[string]string{&quot;spec&quot;: string(data)}
		}
		if err := r.Client.Update(context.TODO(), instance); err != nil {
			return reconcile.Result{}, nil
		}
		// 更新关联资源
		newDeploy := NewJan(instance)
		oldDeploy := &amp;amp;appsv1.Deployment{}
		if err := r.Client.Get(context.TODO(), req.NamespacedName, oldDeploy); err != nil {
			return reconcile.Result{}, err
		}
		oldDeploy.Spec = newDeploy.Spec
		if err := r.Client.Update(context.TODO(), oldDeploy); err != nil {
			return reconcile.Result{}, err
		}

		newService := NewService(instance)
		oldService := &amp;amp;corev1.Service{}
		if err := r.Client.Get(context.TODO(), req.NamespacedName, oldService); err != nil {
			return reconcile.Result{}, err
		}
		oldService.Spec = newService.Spec
		if err := r.Client.Update(context.TODO(), oldService); err != nil {
			return reconcile.Result{}, err
		}
		newIngress := NewIngress(instance)
		oldIngress := &amp;amp;v1.Ingress{}
		if err := r.Client.Get(context.TODO(), req.NamespacedName, oldIngress); err != nil {
			return reconcile.Result{}, err
		}
		oldIngress.Spec = newIngress.Spec
		if err := r.Client.Update(context.TODO(), oldIngress); err != nil {
			return reconcile.Result{}, err
		}
		return reconcile.Result{}, nil
	}
	newStatus := janv1.JanStatus{
		Replicas:      *instance.Spec.Replicas,
		ReadyReplicas: instance.Status.Replicas,
	}

	if newStatus.Replicas == newStatus.ReadyReplicas {
		newStatus.Phase = janv1.Running
	} else {
		newStatus.Phase = janv1.NotReady
	}
	if !reflect.DeepEqual(instance.Status, newStatus) {
		instance.Status = newStatus
		log.FromContext(ctx).Info(&quot;update game status&quot;, &quot;name&quot;, instance.Name)
		err = r.Client.Status().Update(ctx, instance)
		if err != nil {
			return reconcile.Result{}, err
		}
	}
	return reconcile.Result{}, nil
}

// SetupWithManager sets up the controller with the Manager.
func (r *JanReconciler) SetupWithManager(mgr ctrl.Manager) error {
	return ctrl.NewControllerManagedBy(mgr).
		For(&amp;amp;janv1.Jan{}).
		Owns(&amp;amp;appsv1.Deployment{}).
		Owns(&amp;amp;corev1.Service{}).
		Owns(&amp;amp;v1.Ingress{}).
		Complete(r)
}

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;h1 id=&quot;总结&quot;&gt;总结&lt;/h1&gt;

&lt;ol&gt;
  &lt;li&gt;owns的一般使用&lt;/li&gt;
  &lt;li&gt;将 deployment service ingress或者其他资源作为operator应用的子资源，进行生命周期管理&lt;/li&gt;
  &lt;li&gt;下一步想处理一下 make run 控制台的输出，输出一些有用的信息&lt;/li&gt;
&lt;/ol&gt;
</description>
        <pubDate>Tue, 09 Aug 2022 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2022/08/09/Operator3-%E8%AE%BE%E8%AE%A1%E4%B8%80%E4%B8%AAoperator%E4%BA%8C-owns%E7%9A%84%E4%BD%BF%E7%94%A8/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2022/08/09/Operator3-%E8%AE%BE%E8%AE%A1%E4%B8%80%E4%B8%AAoperator%E4%BA%8C-owns%E7%9A%84%E4%BD%BF%E7%94%A8/</guid>
        
        <category>kubernetes</category>
        
        <category>operator</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2022-07-11-Operator-2从pod开始简单operator</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#创建pod&quot; id=&quot;markdown-toc-创建pod&quot;&gt;创建Pod&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#redisspec-增加image字段&quot; id=&quot;markdown-toc-redisspec-增加image字段&quot;&gt;RedisSpec 增加Image字段&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#先发布了一下crd&quot; id=&quot;markdown-toc-先发布了一下crd&quot;&gt;先发布了一下crd&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#镜像要不要发布一下&quot; id=&quot;markdown-toc-镜像要不要发布一下&quot;&gt;镜像要不要发布一下？&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#继续强调一下setupwebhookwithmanager&quot; id=&quot;markdown-toc-继续强调一下setupwebhookwithmanager&quot;&gt;继续强调一下SetupWebhookWithManager&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#创建createredis函数&quot; id=&quot;markdown-toc-创建createredis函数&quot;&gt;创建CreateRedis函数&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#reconcile调用createredis函数&quot; id=&quot;markdown-toc-reconcile调用createredis函数&quot;&gt;Reconcile调用CreateRedis函数&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#make-run-test&quot; id=&quot;markdown-toc-make-run-test&quot;&gt;make run test&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#pod资源删除&quot; id=&quot;markdown-toc-pod资源删除&quot;&gt;POD资源删除&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#清理资源&quot; id=&quot;markdown-toc-清理资源&quot;&gt;清理资源&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#redisspec增加副本数量字段&quot; id=&quot;markdown-toc-redisspec增加副本数量字段&quot;&gt;RedisSpec增加副本数量字段&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#help_redisgo&quot; id=&quot;markdown-toc-help_redisgo&quot;&gt;help_redis.go&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#修改controllersredis_controllergo&quot; id=&quot;markdown-toc-修改controllersredis_controllergo&quot;&gt;修改controllers/redis_controller.go：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#make-run--test&quot; id=&quot;markdown-toc-make-run--test&quot;&gt;make run &amp;amp; test&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#紧接着问题又来了&quot; id=&quot;markdown-toc-紧接着问题又来了&quot;&gt;紧接着问题又来了：&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#pod资源缩容&quot; id=&quot;markdown-toc-pod资源缩容&quot;&gt;Pod资源缩容&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#reconcile修改&quot; id=&quot;markdown-toc-reconcile修改&quot;&gt;Reconcile修改&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#make-run-开始测试&quot; id=&quot;markdown-toc-make-run-开始测试&quot;&gt;make run 开始测试&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#最终代码如下&quot; id=&quot;markdown-toc-最终代码如下&quot;&gt;最终代码如下：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#实现扩容缩容删除恢复&quot; id=&quot;markdown-toc-实现扩容缩容删除恢复&quot;&gt;实现扩容缩容删除恢复：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#其他的&quot; id=&quot;markdown-toc-其他的&quot;&gt;其他的&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#增加event事件支持&quot; id=&quot;markdown-toc-增加event事件支持&quot;&gt;增加Event事件支持&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#最终打包发布&quot; id=&quot;markdown-toc-最终打包发布&quot;&gt;最终打包发布：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#webhook&quot; id=&quot;markdown-toc-webhook&quot;&gt;webhook&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#img-build&quot; id=&quot;markdown-toc-img-build&quot;&gt;IMG build&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#发布&quot; id=&quot;markdown-toc-发布&quot;&gt;发布&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#权限&quot; id=&quot;markdown-toc-权限&quot;&gt;权限&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#总结&quot; id=&quot;markdown-toc-总结&quot;&gt;总结：&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;
前置内容：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/hg6ymd/nf8ghd#i5zPG&quot;&gt;Operator-1初识Operator&lt;/a&gt;，从pod开始简单创建operator……
&lt;h1 id=&quot;创建pod&quot;&gt;创建Pod&lt;/h1&gt;
&lt;h2 id=&quot;redisspec-增加image字段&quot;&gt;RedisSpec 增加Image字段&lt;/h2&gt;
恩 强调一下 我故意在api/v1/redis_type.go中加一个字段。接下来该怎么操作呢？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656649196625-e944870a-83b0-42cd-9168-6bda6bac44af.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=637&amp;amp;id=u3447f072&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=573&amp;amp;originWidth=1600&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=154513&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u560b78a3-21b4-4ea9-9a31-650605a4a3c&amp;amp;title=&amp;amp;width=1777.777824872807&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;先发布了一下crd&quot;&gt;先发布了一下crd&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ ./bin/controller-gen rbac:roleName=manager-role crd webhook paths=&quot;./...&quot; output:crd:artifacts:config=config/crd/bases
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/crd | kubectl apply -f -
customresourcedefinition.apiextensions.k8s.io/redis.myapp1.zhangpeng.com configured
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656649364607-2d09f950-ee6f-4bf0-94cf-da6aece1b5b5.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=1028&amp;amp;id=u96626f2e&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=925&amp;amp;originWidth=1725&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=246512&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u5ed69358-bed0-4e4d-aa0f-990c5ec6649&amp;amp;title=&amp;amp;width=1916.666717440995&quot; alt=&quot;image.png&quot; /&gt;
describe crd 配置里面已经有了Image字段！
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl describe crd redis.myapp1.zhangpeng.com 
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656649436885-5215972a-b348-4304-a0cb-0436991898f9.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=910&amp;amp;id=u62383478&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=819&amp;amp;originWidth=1578&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=103121&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u740afb59-880b-4d00-9e60-d387636c800&amp;amp;title=&amp;amp;width=1753.333379780806&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656649526029-ec1c669f-5613-4421-a191-ae3cbb56d193.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=1043&amp;amp;id=ud394dded&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=939&amp;amp;originWidth=1467&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=168874&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ueca0b009-a413-4df5-b0df-39607e7806b&amp;amp;title=&amp;amp;width=1630.0000431802548&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;镜像要不要发布一下&quot;&gt;镜像要不要发布一下？&lt;/h2&gt;
发布镜像的时候&lt;strong&gt;SetupWebhookWithManager&lt;/strong&gt;打开了….不打开貌似发布了会报错
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656662419248-884d3972-d128-4317-80fa-03e0848f1254.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=677&amp;amp;id=u61f24eae&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=609&amp;amp;originWidth=1598&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=161414&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u7d93da73-d551-4b61-a92b-37cde2e6e2c&amp;amp;title=&amp;amp;width=1775.555602591716&quot; alt=&quot;image.png&quot; /&gt;
&lt;strong&gt;打包镜像image并发布&lt;/strong&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656898939921-8892db28-be7b-4114-a4ef-d151e46bb2db.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=463&amp;amp;id=u2bc98baf&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=417&amp;amp;originWidth=1202&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=61559&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u7b211411-71cd-4deb-9deb-68cf5e96b2c&amp;amp;title=&amp;amp;width=1335.5555909356963&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ cd config/manager &amp;amp;&amp;amp;  kustomize edit set image controller=ccr.ccs.tencentyun.com/layatools/zpredis:v2
[zhangpeng@zhangpeng manager]$ cd ../../
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/default | kubectl apply -f -

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656658353438-578c9066-0099-4624-9a6f-23cfab64f193.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=291&amp;amp;id=u99770ba0&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=262&amp;amp;originWidth=1374&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=66292&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u60e536cd-2365-4a3f-9982-1abec0a11af&amp;amp;title=&amp;amp;width=1526.666707109523&quot; alt=&quot;image.png&quot; /&gt;
注：当然了能使用原生的命令更好， 我这系统还是有问题的
&lt;h2 id=&quot;继续强调一下setupwebhookwithmanager&quot;&gt;继续强调一下SetupWebhookWithManager&lt;/h2&gt;
发布完成继续关了main.go中 &lt;strong&gt;SetupWebhookWithManage&lt;/strong&gt;r，否则没法&lt;strong&gt;make run&lt;/strong&gt;本地调试哦。
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656662601632-62f3d364-61f7-4b51-ad22-53ab4b6e2064.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=631&amp;amp;id=uad08117c&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=568&amp;amp;originWidth=1608&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=162947&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u851f9452-77a5-4eef-8709-19adeca7664&amp;amp;title=&amp;amp;width=1786.666713997171&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;创建createredis函数&quot;&gt;创建CreateRedis函数&lt;/h2&gt;
helper/help_redis.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;package helper

import (
	&quot;context&quot;
	&quot;fmt&quot;
	corev1 &quot;k8s.io/api/core/v1&quot;
	v1 &quot;kube-oprator1/api/v1&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
)


func CreateRedis(client client.Client, redisConfig *v1.Redis) error {

	newpod := &amp;amp;corev1.Pod{}
	newpod.Name = podName
	newpod.Namespace = redisConfig.Namespace
	newpod.Spec.Containers = []corev1.Container{
		{
			Name:           redisConfig.Name,
			Image:           redisConfig.Spec.Image,
			ImagePullPolicy: corev1.PullIfNotPresent,
			Ports: []corev1.ContainerPort{
				{
					ContainerPort: int32(redisConfig.Spec.Port),
				},
			},
		},
	}
	return client.Create(context.Background(), newpod)

}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656662784265-fda91dda-0a6d-4ad0-ba47-59557c043c0d.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=898&amp;amp;id=u812e4bd7&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=808&amp;amp;originWidth=1516&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=171561&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ubc1b3467-cf1b-4b0f-a821-4e4ffb12f9d&amp;amp;title=&amp;amp;width=1684.4444890669847&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;reconcile调用createredis函数&quot;&gt;Reconcile调用CreateRedis函数&lt;/h2&gt;
&lt;strong&gt;controlers/redis_controller.go&lt;/strong&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	_ = log.FromContext(ctx)
	redis := &amp;amp;myapp1v1.Redis{}
	if err := r.Get(ctx, req.NamespacedName, redis); err != nil {
		fmt.Println(err)
	} else {
		fmt.Println(&quot;object&quot;, redis)
		err := helper.CreateRedis(r.Client, redis)
		return ctrl.Result{}, err

	}

	return ctrl.Result{}, nil
}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656925503920-e23b430d-3918-4fa5-a7d2-1d106471320a.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=736&amp;amp;id=u8f8756e9&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=662&amp;amp;originWidth=1659&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=191040&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uacdc6c2c-da21-4077-b99e-cc2ae3dd80f&amp;amp;title=&amp;amp;width=1843.3333821649917&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;make-run-test&quot;&gt;make run test&lt;/h2&gt;
注：其实也可以不make run了……都发布到集群中了， 可以到集群中查看operator日志了！
test/redis.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;apiVersion: myapp1.zhangpeng.com/v1
kind: Redis
metadata:
  name: zhangpeng1
spec:
  port: 6379
  image: redis:latest
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
注意：特意搞了两个又创建了一个name为zhangpeng2的应用！
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656663859019-5febd445-12f2-4a07-8982-3d98a63f0cb9.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=861&amp;amp;id=ud36ab4c4&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=775&amp;amp;originWidth=1649&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=179426&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u4297fc6a-2d04-45ae-ac46-f5c0811795a&amp;amp;title=&amp;amp;width=1832.2222707595367&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656663843817-f77c606f-647f-4c86-98cd-6f2f2fba7067.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=808&amp;amp;id=u760271b6&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=727&amp;amp;originWidth=1659&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=301292&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ud87a13ea-0a26-4f55-9ca3-d01a7646a2a&amp;amp;title=&amp;amp;width=1843.3333821649917&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656663893112-d4d073ff-62f8-447c-abd4-34acddbcc539.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=922&amp;amp;id=u5d63a456&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=830&amp;amp;originWidth=1794&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=428481&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u45ef45a0-13ad-44f6-8213-bcc93f49829&amp;amp;title=&amp;amp;width=1993.3333861386348&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng ~]$ kubectl get Redis
[zhangpeng@zhangpeng ~]$ kubectl get pods
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656663925048-a4713616-df62-4e3a-89a2-56549c537054.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=211&amp;amp;id=u64a7ff20&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=190&amp;amp;originWidth=1336&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=37243&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ua107e574-c82a-4ed2-8cfa-1ca3e9f6950&amp;amp;title=&amp;amp;width=1484.4444837687938&quot; alt=&quot;image.png&quot; /&gt;
创建成功！接着而来的是pod删除的问题：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng ~]$ kubectl delete Redis zhangpeng2
[zhangpeng@zhangpeng ~]$ kubectl get pod
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
恩删除了zhangpeng2 Redis，but pod资源还存在，该怎么处理，让pod资源一起删除呢？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656664227461-7fd00074-e6d9-408f-b188-9bdc730dd4af.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=169&amp;amp;id=u6a5fff1f&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=152&amp;amp;originWidth=1170&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=51172&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u9695eec5-e7eb-43b2-8a43-fe06f3c84e0&amp;amp;title=&amp;amp;width=1300.0000344382402&quot; alt=&quot;image.png&quot; /&gt;
&lt;h1 id=&quot;pod资源删除&quot;&gt;POD资源删除&lt;/h1&gt;
参照：&lt;a href=&quot;https://kubernetes.io/blog/2021/05/14/using-finalizers-to-control-deletion/&quot;&gt;https://kubernetes.io/blog/2021/05/14/using-finalizers-to-control-deletion/&lt;/a&gt;
Finalizers
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656665664159-6160c951-90bd-44fc-b963-92504b646ebd.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=726&amp;amp;id=u2945aaed&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=653&amp;amp;originWidth=1632&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=233581&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ua7832051-f196-4244-a097-89554f7cd72&amp;amp;title=&amp;amp;width=1813.3333813702632&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;清理资源&quot;&gt;清理资源&lt;/h2&gt;
清理一下资源删除webhook Redis 等相关资源
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get ValidatingWebhookConfiguration
NAME                                             WEBHOOKS   AGE
cert-manager-webhook                             1          3d23h
kube-oprator1-validating-webhook-configuration   1          3d23h
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete ValidatingWebhookConfiguration
error: resource(s) were provided, but no name was specified
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete ValidatingWebhookConfiguration kube-oprator1-validating-webhook-configuration 
validatingwebhookconfiguration.admissionregistration.k8s.io &quot;kube-oprator1-validating-webhook-configuration&quot; deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get MutatingWebhookConfiguration
NAME                                           WEBHOOKS   AGE
cert-manager-webhook                           1          3d23h
kube-oprator1-mutating-webhook-configuration   1          3d23h
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete MutatingWebhookConfiguration kube-oprator1-mutating-webhook-configuration 
mutatingwebhookconfiguration.admissionregistration.k8s.io &quot;kube-oprator1-mutating-webhook-configuration&quot; deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
NAME         AGE
zhangpeng3   5m
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete Redis zhangpeng3
redis.myapp1.zhangpeng.com &quot;zhangpeng3&quot; deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete pods zhangpeng3
Error from server (NotFound): pods &quot;zhangpeng3&quot; not found
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
No resources found in default namespace.

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656936868776-265f41b9-d307-4d08-b005-4b763e456f12.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=528&amp;amp;id=ue9c7025e&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=475&amp;amp;originWidth=1570&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=128357&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ub0db7085-7079-473c-8842-cb9cf378425&amp;amp;title=&amp;amp;width=1744.4444906564418&quot; alt=&quot;image.png&quot; /&gt;
这样作吧，还是为了本地调试方便，否则一些本地的修改，增加字段就要重新打包，发布，太麻烦了。老老实实make run 本地调试模式，待调试完成后再发布应用到集群，这才是正常的流程！
需求: 删除Redis 对应pod 可以删除，pod可以多副本。zhangpeng-0 zhangpeng-1  zhangpeng-3的顺序。更新策略，缩容策略。恩这是我想到的！当然了pod如果使用deployment 或者statefulset会更简单一些。这里还是拿pod演示了！
&lt;h2 id=&quot;redisspec增加副本数量字段&quot;&gt;RedisSpec增加副本数量字段&lt;/h2&gt;
修改api/v1/redis_types.go中RedisSpec struct,增加如下配置：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;	//+kubebuilder:validation:Minimum:=1
	//+kubebuilder:validation:Maximum:=5
	Num int `json:&quot;num,omitempty&quot;`
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656988840532-b1f6e17b-305b-4bc0-8d61-911e64bb9f91.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=480&amp;amp;id=ub21b2109&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=432&amp;amp;originWidth=1100&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=106802&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u6de07c42-ee81-4c5c-8701-152bc32491e&amp;amp;title=&amp;amp;width=1222.2222546000548&quot; alt=&quot;image.png&quot; /&gt;
num字段为pod副本数量字段，依着port配置把副本数量做了一个1-5的限制！
继续发布一下crd：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ ./bin/controller-gen rbac:roleName=manager-role crd webhook paths=&quot;./...&quot; output:crd:artifacts:config=config/crd/bases
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/crd | kubectl apply -f -
customresourcedefinition.apiextensions.k8s.io/redis.myapp1.zhangpeng.com configured
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656991861831-13aba9fd-aaa4-4a59-a49d-8ff586b049e8.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=964&amp;amp;id=u2cdb217b&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=868&amp;amp;originWidth=1683&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=231131&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u4beedc1c-1dcd-4f93-a66c-0aa36122194&amp;amp;title=&amp;amp;width=1870.0000495380839&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl describe crd redis.myapp1.zhangpeng.com
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
确认crd中产生对应字段：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1656991991275-3499490d-a609-4d20-8871-56c0017e3130.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=824&amp;amp;id=u4d2bfda8&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=742&amp;amp;originWidth=1233&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=92463&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u244e1d9c-0770-444b-a305-f74611c672d&amp;amp;title=&amp;amp;width=1370.0000362926069&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;help_redisgo&quot;&gt;help_redis.go&lt;/h2&gt;
修改helper/help_redis.go如下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;package helper

import (
	&quot;context&quot;
	&quot;fmt&quot;
	corev1 &quot;k8s.io/api/core/v1&quot;
	v1 &quot;kube-oprator1/api/v1&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
)
//拼装Pod名称列表
func GetRedisPodNames(redisConfig *v1.Redis) []string {
	podNames := make([]string, redisConfig.Spec.Num)
	for i := 0; i &amp;lt; redisConfig.Spec.Num; i++ {
		podNames[i] = fmt.Sprintf(&quot;%s-%d&quot;, redisConfig.Name, i)
	}
	fmt.Println(&quot;podnames:&quot;, podNames)
	return podNames
}
//判断对应名称的pod在finalizer中是否存在
func IsExist(podName string, redis *v1.Redis) bool {
	for _, pod := range redis.Finalizers {
		if podName == pod {
			return true
		}
	}
	return false

}

//创建pod
func CreateRedis(client client.Client, redisConfig *v1.Redis, podName string) (string, error) {
	if IsExist(podName, redisConfig) {
		return &quot;&quot;, nil
	}

	newpod := &amp;amp;corev1.Pod{}
	newpod.Name = podName
	newpod.Namespace = redisConfig.Namespace
	newpod.Spec.Containers = []corev1.Container{
		{
			Name:            podName,
			Image:           redisConfig.Spec.Image,
			ImagePullPolicy: corev1.PullIfNotPresent,
			Ports: []corev1.ContainerPort{
				{
					ContainerPort: int32(redisConfig.Spec.Port),
				},
			},
		},
	}
	return podName, client.Create(context.Background(), newpod)

}

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;h2 id=&quot;修改controllersredis_controllergo&quot;&gt;修改controllers/redis_controller.go：&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;import (
	&quot;context&quot;
	&quot;fmt&quot;
	v1 &quot;k8s.io/api/core/v1&quot;
	&quot;k8s.io/apimachinery/pkg/api/errors&quot;
	metav1 &quot;k8s.io/apimachinery/pkg/apis/meta/v1&quot;
	&quot;k8s.io/apimachinery/pkg/runtime&quot;
	&quot;k8s.io/client-go/tools/record&quot;
	myapp1v1 &quot;kube-oprator1/api/v1&quot;
	&quot;kube-oprator1/helper&quot;
	ctrl &quot;sigs.k8s.io/controller-runtime&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/log&quot;
)
func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	_ = log.FromContext(ctx)

	// TODO(user): your logic here
	redis := &amp;amp;myapp1v1.Redis{}
	if err := r.Client.Get(ctx, req.NamespacedName, redis); err != nil {
		if errors.IsNotFound(err) {
			return ctrl.Result{}, nil
		}
		return ctrl.Result{}, err
	}
  //取得需要创建的POD副本的名称
	podNames := helper.GetRedisPodNames(redis)
	fmt.Println(&quot;podNames,&quot;, podNames)
	updateFlag := false
  //删除POD，删除Kind:Redis过程中，会自动加上DeletionTimestamp字段，据此判断是否删除了自定义资源
	if !redis.DeletionTimestamp.IsZero() {
		fmt.Println(ctrl.Result{}, r.clearRedis(ctx, redis))
		return ctrl.Result{}, r.clearRedis(ctx, redis)
	}
  //创建POD
	for _, podName := range podNames {
		finalizerPodName, err := helper.CreateRedis(r.Client, redis, podName)
		if err != nil {
			fmt.Println(&quot;create pod failue,&quot;, err)
			return ctrl.Result{}, err
		}
		if finalizerPodName == &quot;&quot; {
			continue
		}
    //若该pod已经不在finalizers中，则添加
		redis.Finalizers = append(redis.Finalizers, finalizerPodName)
		updateFlag = true
	}
  //更新Kind Redis状态
	if updateFlag {
		err := r.Client.Update(ctx, redis)
		if err != nil {
			return ctrl.Result{}, err
		}
	}
	return ctrl.Result{}, nil
}
//删除POD逻辑
func (r *RedisReconciler) clearRedis(ctx context.Context, redis *myapp1v1.Redis) error {
	//从finalizers中取出podName，然后执行删除
	for _, finalizer := range redis.Finalizers {
		//删除pod
		err := r.Client.Delete(ctx, &amp;amp;v1.Pod{
			ObjectMeta: metav1.ObjectMeta{
				Name:      finalizer,
				Namespace: redis.Namespace,
			},
		})
		if err != nil {
			return err
		}
	}
  //清空finializers，只要它有值，就无法删除Kind
	redis.Finalizers = []string{}
	return r.Client.Update(ctx, redis)
}

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;h2 id=&quot;make-run--test&quot;&gt;make run &amp;amp; test&lt;/h2&gt;
控制台运行make run&amp;amp;&amp;amp;控制台2运行apply命令：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl apply -f test/redis.yaml 
redis.myapp1.zhangpeng.com/zhangpeng3 configured
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
test/redis.yaml
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;apiVersion: myapp1.zhangpeng.com/v1
kind: Redis
metadata:
  name: zhangpeng3
spec:
  port: 6379
  num: 2
  image: redis:latest
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657001379999-057aae85-a4a0-44ff-8b34-e740e51e04aa.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=972&amp;amp;id=uef815280&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=875&amp;amp;originWidth=1434&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=167655&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uc957edf3-caf8-44a2-9f9a-21c978a9166&amp;amp;title=&amp;amp;width=1593.3333755422532&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
[zhangpeng@zhangpeng kube-oprator1]$ kubectl apply -f test/redis.yaml 
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods

[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis/zhangpeng3 -o yaml

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657002119782-a38369d2-86cb-44d1-b5a9-527fa7a698c9.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=998&amp;amp;id=u819343f5&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=898&amp;amp;originWidth=1591&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=174844&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u623f392b-b728-48e4-a6f4-b0317a9bf1c&amp;amp;title=&amp;amp;width=1767.7778246078974&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete test/redis.yaml 
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657002144970-3db32853-8b39-411d-8f34-45e61471c7f4.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=679&amp;amp;id=uab37a8b8&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=611&amp;amp;originWidth=1338&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=103702&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ud322edf1-eb0e-40e8-9d72-83e11a4fc19&amp;amp;title=&amp;amp;width=1486.6667060498849&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;紧接着问题又来了&quot;&gt;紧接着问题又来了：&lt;/h2&gt;
&lt;strong&gt;创建副本为2：&lt;/strong&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657002398485-505e7915-bbf6-4f31-a762-18f162365866.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=937&amp;amp;id=u3898f46d&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=843&amp;amp;originWidth=1326&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=164335&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u28ca5ff5-00e9-414d-b568-bb5a44ed1ca&amp;amp;title=&amp;amp;width=1473.3333723633389&quot; alt=&quot;image.png&quot; /&gt;
&lt;strong&gt;修改副本数为3：&lt;/strong&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657002430587-71ee5f21-3820-4d4f-a9ed-a9b1c20c2b3b.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=1008&amp;amp;id=u01c36648&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=907&amp;amp;originWidth=1394&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=204101&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u2ef0d178-90e0-4d7e-bba1-361dcaa45af&amp;amp;title=&amp;amp;width=1548.8889299204332&quot; alt=&quot;image.png&quot; /&gt;
紧接着缩容副本为2,会出现怎么操作呢？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657002481380-20d24a0f-2415-4591-90a3-ce1618721e48.png#clientId=ufffb9314-8eb8-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=967&amp;amp;id=u29465bd9&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=870&amp;amp;originWidth=1390&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=185229&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ubfe645d1-ac51-470f-ae35-920315d6876&amp;amp;title=&amp;amp;width=1544.444485358251&quot; alt=&quot;image.png&quot; /&gt;
没有自动去调度，现在需要一个自动缩容的方法……
&lt;h1 id=&quot;pod资源缩容&quot;&gt;Pod资源缩容&lt;/h1&gt;
pod的标签定义的是zhangpeng-0 zhangpeng-1 zhangpeng-2的类型，扩容是 0  1  2  3 4的递增模式，缩容也从4 3 2 1 0依次去删除 pod
注意：默认情况下前面一步的Redis资源已经删除(kubectl delete -f test/redis.yaml)
&lt;h2 id=&quot;reconcile修改&quot;&gt;Reconcile修改&lt;/h2&gt;
controllers/redis_controller.go 中Reconcile修改为如下：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	_ = log.FromContext(ctx)

	// TODO(user): your logic here
	redis := &amp;amp;myapp1v1.Redis{}
	if err := r.Client.Get(ctx, req.NamespacedName, redis); err != nil {
		if errors.IsNotFound(err) {
			return ctrl.Result{}, nil
		}
		fmt.Println(&quot;object&quot;, redis)
	}
	if !redis.DeletionTimestamp.IsZero() || len(redis.Finalizers) &amp;gt; redis.Spec.Num {
		return ctrl.Result{}, r.clearRedis(ctx, redis)
	}
	if !redis.DeletionTimestamp.IsZero() || len(redis.Finalizers) &amp;gt; redis.Spec.Num {
		return ctrl.Result{}, r.clearRedis(ctx, redis)
	}
	podNames := helper.GetRedisPodNames(redis)
	fmt.Println(&quot;podNames,&quot;, podNames)
	updateFlag := false
	for _, podName := range podNames {
		finalizerPodName, err := helper.CreateRedis(r.Client, redis, podName)
		if err != nil {
			fmt.Println(&quot;create pod failue,&quot;, err)
			return ctrl.Result{}, err
		}
		if finalizerPodName == &quot;&quot; {
			continue
		}
		redis.Finalizers = append(redis.Finalizers, finalizerPodName)
		updateFlag = true
	}
	//更新Kind Redis状态
	if updateFlag {
		err := r.Client.Update(ctx, redis)
		if err != nil {
			return ctrl.Result{}, err
		}
	}
	return ctrl.Result{}, nil
}
func (r *RedisReconciler) clearRedis(ctx context.Context, redis *myapp1v1.Redis) error {
	/*
		//finalizers &amp;gt; num  可能出现，删除差值部分
		//finalizers = num 可能出现，删除全部
		//finalizers &amp;lt; num 不可能出现
	*/
	var deletedPodNames []string

	//删除finalizers切片的最后的指定元素
	position := redis.Spec.Num
	if (len(redis.Finalizers) - redis.Spec.Num) &amp;gt; 0 {
		deletedPodNames = redis.Finalizers[position:]
		redis.Finalizers = redis.Finalizers[:position]
	} else {
		deletedPodNames = redis.Finalizers[:position]
		redis.Finalizers = []string{}
	}

	fmt.Println(&quot;deletedPodNames&quot;, deletedPodNames)
	fmt.Println(&quot;redis.Finalizers&quot;, redis.Finalizers)
	for _, finalizer := range deletedPodNames {
		//删除pod
		err := r.Client.Delete(ctx, &amp;amp;v1.Pod{
			ObjectMeta: metav1.ObjectMeta{
				Name:      finalizer,
				Namespace: redis.Namespace,
			},
		})
		if err != nil {
			return err
		}
	}
	redis.Finalizers = []string{}
	return r.Client.Update(ctx, redis)
}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;h2 id=&quot;make-run-开始测试&quot;&gt;make run 开始测试&lt;/h2&gt;
控制台执行make run……控制台2 执行apply -f test/redis.yaml创建3个副本pod
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;apiVersion: myapp1.zhangpeng.com/v1
kind: Redis
metadata:
  name: zhangpeng3
spec:
  port: 6379
  num: 3
  image: redis:latest
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657077457268-18927f30-e8fb-4355-9cff-a72b9aca0e8c.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=981&amp;amp;id=uecf19131&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=883&amp;amp;originWidth=1437&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=175533&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ub50273e7-9385-41c4-8ace-f75a197d633&amp;amp;title=&amp;amp;width=1596.6667089638897&quot; alt=&quot;image.png&quot; /&gt;
修改yaml副本数量为2,缩容pod apply yaml文件，缩容成功，删除了zhangpeng3-2pod！
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657077482968-4f8e728b-4f5c-4688-a057-445d133ee5d6.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=982&amp;amp;id=u0ab4dcf5&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=884&amp;amp;originWidth=1274&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=167021&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u28ca0e67-7378-40ef-b4b8-2f793d4afd5&amp;amp;title=&amp;amp;width=1415.5555930549726&quot; alt=&quot;image.png&quot; /&gt;
but！问题来了我接着想扩容副本数量到3…..不能正常操作了……不能生成新的pod
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657077510485-176b9177-0380-40c4-bd2b-82ab08939a05.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=988&amp;amp;id=uf2ddd1ac&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=889&amp;amp;originWidth=1517&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=176694&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uf07e0a93-0450-4054-8e71-ffe9fbf0c44&amp;amp;title=&amp;amp;width=1685.5556002075302&quot; alt=&quot;image.png&quot; /&gt;
观查一下make run报错……
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657077527307-2466a01c-cafe-44f0-a98e-1a7a798ebfb4.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=987&amp;amp;id=u1ace5be1&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=888&amp;amp;originWidth=1710&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=201162&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u73d52e28-6fd0-4e29-b24d-716d3d3a3bf&amp;amp;title=&amp;amp;width=1900.0000503328124&quot; alt=&quot;image.png&quot; /&gt;
删除这几个资源重新来一遍，仔细观察一下步骤看看缺少了什么：
删除资源的时候明显发现绑定到pod跟Redis的资源没有绑定了？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657077820720-6f9a9a4a-478e-4b93-ad72-0cbb4801c22b.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=350&amp;amp;id=u5edcfc72&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=315&amp;amp;originWidth=891&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=64693&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u61e4063e-1788-413c-a8d3-698abbb199a&amp;amp;title=&amp;amp;width=990.0000262260444&quot; alt=&quot;image.png&quot; /&gt;
apply yaml 副本数量为2, Finalizers中数据：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657077929006-56c565d5-7651-4cc0-b189-255370b38761.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=864&amp;amp;id=u5663b0c1&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=778&amp;amp;originWidth=1319&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=125316&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ub240230d-e967-43aa-861b-5c54fdbcf45&amp;amp;title=&amp;amp;width=1465.5555943795202&quot; alt=&quot;image.png&quot; /&gt;
修改副本数为2……这 标签就没有了？
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657078031752-4b1c106e-b98f-4379-a7e4-5c7c12ee180d.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=953&amp;amp;id=u9ed67e52&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=858&amp;amp;originWidth=1225&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=141612&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ucdd4348b-dccd-4ffb-9389-860dc1d7118&amp;amp;title=&amp;amp;width=1361.111147168243&quot; alt=&quot;image.png&quot; /&gt;
继续修改副本数为3….恩问题应该还是出在绑定finalizers这里……
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657078081393-08056d62-0ee9-413a-ace2-3498f83cd8b4.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=947&amp;amp;id=u0788ea6e&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=852&amp;amp;originWidth=1138&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=128213&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uba7b2aa8-56ee-4e29-a7bf-505d7670053&amp;amp;title=&amp;amp;width=1264.444477940784&quot; alt=&quot;image.png&quot; /&gt;
&lt;h1 id=&quot;最终代码如下&quot;&gt;最终代码如下：&lt;/h1&gt;
以下代码摘抄自&lt;a href=&quot;https://github.com/ls-2018/k8s-kustomize&quot;&gt;https://github.com/ls-2018/k8s-kustomize&lt;/a&gt;
&lt;h2 id=&quot;实现扩容缩容删除恢复&quot;&gt;实现扩容缩容删除恢复：&lt;/h2&gt;
helper/redis_help.redis
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;package helper

import (
	&quot;context&quot;
	&quot;fmt&quot;
	corev1 &quot;k8s.io/api/core/v1&quot;
	&quot;k8s.io/apimachinery/pkg/runtime&quot;
	&quot;k8s.io/apimachinery/pkg/types&quot;
	v1 &quot;kube-oprator1/api/v1&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/controller/controllerutil&quot;
)

func GetRedisPodNames(redisConfig *v1.Redis) []string {
	podNames := make([]string, redisConfig.Spec.Num)
	fmt.Printf(&quot;%+v&quot;, redisConfig)
	for i := 0; i &amp;lt; redisConfig.Spec.Num; i++ {
		podNames[i] = fmt.Sprintf(&quot;%s-%d&quot;, redisConfig.Name, i)
	}

	fmt.Println(&quot;PodNames: &quot;, podNames)
	return podNames
}

//  判断 redis  pod 是否能获取
func IsExistPod(podName string, redis *v1.Redis, client client.Client) bool {
	err := client.Get(context.Background(), types.NamespacedName{
		Namespace: redis.Namespace,
		Name:      podName,
	},
		&amp;amp;corev1.Pod{},
	)

	if err != nil {
		return false
	}
	return true
}

func IsExistInFinalizers(podName string, redis *v1.Redis) bool {
	for _, fPodName := range redis.Finalizers {
		if podName == fPodName {
			return true

		}
	}
	return false
}

func CreateRedis(client client.Client, redisConfig *v1.Redis, podName string, schema *runtime.Scheme) (string, error) {
	if IsExistPod(podName, redisConfig, client) {
		return podName, nil
	}

	newPod := &amp;amp;corev1.Pod{}
	newPod.Name = podName
	newPod.Namespace = redisConfig.Namespace
	newPod.Spec.Containers =append(newPod.Spec.Containers, []corev1.Container{
			Name:            redisConfig.Name,
			Image:           redisConfig.Spec.Image,
			ImagePullPolicy: corev1.PullIfNotPresent,
			Ports: []corev1.ContainerPort{
				{
					ContainerPort: int32(redisConfig.Spec.Port),
				},
			},
		})

	//  set  owner  reference
	err := controllerutil.SetControllerReference(redisConfig, newPod, schema)
	if err != nil {
		return &quot;&quot;, err
	}

return podName, client.Create(context.Background(), newPod)
}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
controllers/redis_controller.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;/*
Copyright 2022 zhang peng.

Licensed under the Apache License, Version 2.0 (the &quot;License&quot;);
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an &quot;AS IS&quot; BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
*/

package controllers

import (
	&quot;context&quot;
	&quot;fmt&quot;
	corev1 &quot;k8s.io/api/core/v1&quot;
	metav1 &quot;k8s.io/apimachinery/pkg/apis/meta/v1&quot;
	&quot;k8s.io/apimachinery/pkg/runtime&quot;
	&quot;k8s.io/apimachinery/pkg/types&quot;
	&quot;k8s.io/client-go/tools/record&quot;
	&quot;k8s.io/client-go/util/workqueue&quot;
	myapp1v1 &quot;kube-oprator1/api/v1&quot;
	&quot;kube-oprator1/helper&quot;
	ctrl &quot;sigs.k8s.io/controller-runtime&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/client&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/controller/controllerutil&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/event&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/handler&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/log&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/reconcile&quot;
	&quot;sigs.k8s.io/controller-runtime/pkg/source&quot;
)

// RedisReconciler reconciles a Redis object
type RedisReconciler struct {
	client.Client
	Scheme      *runtime.Scheme
	EventRecord record.EventRecorder
}

//+kubebuilder:rbac:groups=myapp1.zhangpeng.com,resources=redis,verbs=get;list;watch;create;update;patch;delete
//+kubebuilder:rbac:groups=myapp1.zhangpeng.com,resources=redis/status,verbs=get;update;patch
//+kubebuilder:rbac:groups=myapp1.zhangpeng.com,resources=redis/finalizers,verbs=update

// Reconcile is part of the main kubernetes reconciliation loop which aims to
// move the current state of the cluster closer to the desired state.
// TODO(user): Modify the Reconcile function to compare the state specified by
// the Redis object against the actual cluster state, and then
// perform operations to make the cluster state reflect the state specified by
// the user.
//
// For more details, check Reconcile and its Result here:
// - https://pkg.go.dev/sigs.k8s.io/controller-runtime@v0.11.2/pkg/reconcile
func (r *RedisReconciler) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	_ = log.FromContext(ctx)
	redis := &amp;amp;myapp1v1.Redis{}
	// 删除后会往这发一个请求,只有NamespacedName数据，别的都没有
	if err := r.Get(ctx, req.NamespacedName, redis); err != nil {
		return ctrl.Result{}, nil
	}
	// 正在删除
	if !redis.DeletionTimestamp.IsZero() {
		return ctrl.Result{}, r.clearPods(context.Background(), redis)
	}
	// TODO pod 个数变动
	podNames := helper.GetRedisPodNames(redis)
	var err error
	if redis.Spec.Num &amp;gt; len(redis.Finalizers) {
		err = r.UpPods(ctx, podNames, redis)
		if err == nil {
			fmt.Printf(&quot;%d&quot;, redis.Spec.Num)
			//r.EventRecord.Event(redis, corev1.EventTypeNormal, &quot;UpPods&quot;, fmt.Sprintf(&quot;%d&quot;, redis.Spec.Num))
		} else {
			//			r.EventRecord.Event(redis, corev1.EventTypeWarning, &quot;DownPods&quot;, fmt.Sprintf(&quot;%d&quot;, redis.Spec.Num))
		}
	} else if redis.Spec.Num &amp;lt; len(redis.Finalizers) {
		err = r.DownPods(ctx, podNames, redis)
		if err == nil {
			//			r.EventRecord.Event(redis, corev1.EventTypeNormal, &quot;DownPods&quot;, fmt.Sprintf(&quot;%d&quot;, redis.Spec.Num))
		} else {
			//		r.EventRecord.Event(redis, corev1.EventTypeWarning, &quot;DownPods&quot;, fmt.Sprintf(&quot;%d&quot;, redis.Spec.Num))
		}
		redis.Status.RedisNum = len(redis.Finalizers)
	} else {
		for _, podName := range redis.Finalizers {
			if helper.IsExistPod(podName, redis, r.Client) {
				continue
			} else {
				//	 重建此pod
				err = r.UpPods(ctx, []string{podName}, redis)
				if err != nil {
					return ctrl.Result{}, err
				}
			}
		}
	}
	r.Status().Update(ctx, redis)

	return ctrl.Result{}, err
}

// SetupWithManager sets up the controller with the Manager.
func (r *RedisReconciler) SetupWithManager(mgr ctrl.Manager) error {
	return ctrl.NewControllerManagedBy(mgr).
		For(&amp;amp;myapp1v1.Redis{}).
		Watches(&amp;amp;source.Kind{Type: &amp;amp;corev1.Pod{}}, handler.Funcs{
			CreateFunc:  nil,
			UpdateFunc:  nil,
			DeleteFunc:  r.podDeleteHandler,
			GenericFunc: nil,
		}).
		Complete(r)
}

// 对于用户主动 删除的pod 需要重新创建
func (r *RedisReconciler) podDeleteHandler(event event.DeleteEvent, limitingInterface workqueue.RateLimitingInterface) {
	fmt.Printf(`######################
%s
######################
`, event.Object.GetName())
	for _, ref := range event.Object.GetOwnerReferences() {
		if ref.Kind == r.kind() &amp;amp;&amp;amp; ref.APIVersion == r.apiVersion() {
			//触发 Reconcile
			limitingInterface.Add(reconcile.Request{
				NamespacedName: types.NamespacedName{
					Namespace: event.Object.GetNamespace(),
					Name:      ref.Name,
				},
			})
		}
	}
}

func (r *RedisReconciler) kind() string {
	return &quot;Redis&quot;
}

func (r *RedisReconciler) apiVersion() string {
	return &quot;myapp1.zhangpeng.com/v1&quot;
}

func (r *RedisReconciler) clearPods(ctx context.Context, redis *myapp1v1.Redis) error {
	for _, podName := range redis.Finalizers {
		err := r.Client.Delete(ctx, &amp;amp;corev1.Pod{
			ObjectMeta: metav1.ObjectMeta{
				Name:      podName,
				Namespace: redis.Namespace,
			},
		})
		//TODO 如果pod已经被删除、
		if err != nil {
			return err
		}
	}
	redis.Finalizers = []string{}
	return r.Client.Update(ctx, redis)
}
func (r *RedisReconciler) DownPods(ctx context.Context, podNames []string, redis *myapp1v1.Redis) error {
	for i := len(redis.Finalizers) - 1; i &amp;gt;= len(podNames); i-- {
		if !helper.IsExistPod(redis.Finalizers[i], redis, r.Client) {
			continue
		}
		err := r.Client.Delete(ctx, &amp;amp;corev1.Pod{
			ObjectMeta: metav1.ObjectMeta{
				Name:      redis.Finalizers[i],
				Namespace: redis.Namespace,
			},
		})
		if err != nil {
			return err
		}
	}
	redis.Finalizers = append(redis.Finalizers[:0], redis.Finalizers[:len(podNames)]...)
	return r.Client.Update(ctx, redis)
}
func (r *RedisReconciler) UpPods(ctx context.Context, podNames []string, redis *myapp1v1.Redis) error {
	for _, podName := range podNames {
		podName, err := helper.CreateRedis(r.Client, redis, podName, r.Scheme)
		if err != nil {
			return err
		}
		if controllerutil.ContainsFinalizer(redis, podName) {
			continue
		}
		redis.Finalizers = append(redis.Finalizers, podName)
	}
	err := r.Client.Update(ctx, redis)
	return err
}

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657160745630-ac0d9a78-fa70-4b34-9d85-88b940513311.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=956&amp;amp;id=u5fab94d4&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=860&amp;amp;originWidth=1354&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=161112&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ubee97b42-b3c6-4f94-95c7-585a9250333&amp;amp;title=&amp;amp;width=1504.444484298613&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657160777908-f1883df6-3e3c-49ff-a160-7b1cae9b7516.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=994&amp;amp;id=u3f288cac&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=895&amp;amp;originWidth=1281&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=165298&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u439f3632-ef10-4cd5-ab83-f52f77a7ae4&amp;amp;title=&amp;amp;width=1423.333371038791&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657160801315-72c02254-af39-461c-814f-b2c346593cdd.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=971&amp;amp;id=ub24a5499&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=874&amp;amp;originWidth=1219&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=152588&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u9da5785a-7587-4975-bab9-928388379ad&amp;amp;title=&amp;amp;width=1354.4444803249698&quot; alt=&quot;image.png&quot; /&gt;
删除zhangpeng3  Redis

&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657160828977-c0a00d9e-8eb9-4085-a518-28c74adace1d.png#clientId=u337531bd-212e-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=974&amp;amp;id=u45e0fc5e&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=877&amp;amp;originWidth=1424&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=168798&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u5beae557-e1f4-4863-adcd-a9d395b21f5&amp;amp;title=&amp;amp;width=1582.2222641367982&quot; alt=&quot;image.png&quot; /&gt;
基本功能算是完成了，测试一下Pod重建：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657509732900-850283d5-4d06-45e1-9270-4aaa6430da6d.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=680&amp;amp;id=u269d7011&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=612&amp;amp;originWidth=1396&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=116607&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u7e268c00-aa00-4525-b001-02490921fcc&amp;amp;title=&amp;amp;width=1551.1111522015242&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657509772572-3ce36171-f174-4a7c-8047-33a9f127b2d4.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=701&amp;amp;id=u315ee6a1&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=631&amp;amp;originWidth=1713&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=240681&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uea4f5bac-2a93-498d-ba3e-50442c0b4d2&amp;amp;title=&amp;amp;width=1903.333383754449&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;其他的&quot;&gt;其他的&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657513367469-cb7690cf-689b-4f7e-ad91-ff7026315adb.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=257&amp;amp;id=uba240977&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=231&amp;amp;originWidth=821&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=40757&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u5fa6d137-1abb-4fe1-bee8-c71ed1c0e94&amp;amp;title=&amp;amp;width=912.2222463878591&quot; alt=&quot;image.png&quot; /&gt;
api/v1/redis_types.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;// RedisStatus defines the observed state of Redis
type RedisStatus struct {
	RedisNum int `json:&quot;num,omitempty&quot;`
}

//下面两个注释对应的是 kubectl get Redis 看到的状态
//+kubebuilder:printcolumn:JSONPath=&quot;.status.num&quot;,name=NUM,type=integer
//+kubebuilder:printcolumn:JSONPath=&quot;.metadata.creationTimestamp&quot;,name=AGE,type=date
//+kubebuilder:object:root=true
//+kubebuilder:subresource:status
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657513896029-f51d3b13-e691-477f-944f-cd109783f8eb.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=916&amp;amp;id=u27072f93&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=824&amp;amp;originWidth=1455&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=213625&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u26dccf92-fc56-4b74-8239-7e040cd2275&amp;amp;title=&amp;amp;width=1616.6667094937088&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ make install
[zhangpeng@zhangpeng kube-oprator1]$ make run
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
看一下config/crd/bases/myapp1.zhangpeng.com_redis.yaml
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657514112510-8d7bbaf5-e228-47c9-8173-57750245169e.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=872&amp;amp;id=u2eda6cbe&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=785&amp;amp;originWidth=1703&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=194902&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uf052a987-8147-4eff-be23-2c81a319d33&amp;amp;title=&amp;amp;width=1892.222272348994&quot; alt=&quot;image.png&quot; /&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657514133012-1bd0a4e0-5849-474a-8c9d-71f7fdcc49bd.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=323&amp;amp;id=u2a6715b4&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=291&amp;amp;originWidth=810&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=55613&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u2b1dfcd5-b414-492c-bf0b-04be5166b59&amp;amp;title=&amp;amp;width=900.0000238418586&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;增加event事件支持&quot;&gt;增加Event事件支持&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get Redis
NAME         NUM   AGE
zhangpeng3   2     82m
[zhangpeng@zhangpeng kube-oprator1]$ kubectl describe Redis zhangpeng3
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657520700375-834dac57-828e-4fe6-b9e3-4121e28d8ca0.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=714&amp;amp;id=u49947664&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=643&amp;amp;originWidth=1006&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=66065&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ua1d7c469-f8f0-480a-a13d-256aaa20815&amp;amp;title=&amp;amp;width=1117.7778073887773&quot; alt=&quot;image.png&quot; /&gt;
观察我redis_controller.go代码的时候发现我注释了这些代码……这些其实就是event的输出，不知道怎么会事情就空指针报错了 ，就注释掉了！
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657522382840-e5be5887-162e-4c23-9cb9-2a531be2a673.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=850&amp;amp;id=u0e0ef1f6&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=765&amp;amp;originWidth=1567&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=215671&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u89268c1b-3a97-4496-af30-8a0a6fadade&amp;amp;title=&amp;amp;width=1741.1111572348054&quot; alt=&quot;image.png&quot; /&gt;
什么原因呢？参照：&lt;a href=&quot;https://github.com/767829413/learn-to-apply/blob/3621065003918070635880c3348f1d72bf6ead88/docs/Kubernetes/kubernetes-secondary-development.md&quot;&gt;https://github.com/767829413/learn-to-apply/blob/3621065003918070635880c3348f1d72bf6ead88/docs/Kubernetes/kubernetes-secondary-development.md&lt;/a&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657525643561-f32802cf-4bc8-43f9-bfae-d5217bfd6b01.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=607&amp;amp;id=u778a2b87&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=546&amp;amp;originWidth=1499&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=121030&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u25fce07b-594d-45ad-8012-bad467fb7c6&amp;amp;title=&amp;amp;width=1665.5555996777111&quot; alt=&quot;image.png&quot; /&gt;
修改main.go
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;	if err = (&amp;amp;controllers.RedisReconciler{
		Client:      mgr.GetClient(),
		Scheme:      mgr.GetScheme(),
		EventRecord: mgr.GetEventRecorderFor(&quot;myapp1.zhangpeng.com&quot;), //名称任意
	}).SetupWithManager(mgr); err != nil {
		setupLog.Error(err, &quot;unable to create controller&quot;, &quot;controller&quot;, &quot;Redis&quot;)
		os.Exit(1)
	}
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657525667986-5efca21a-d7cb-41a9-b079-9c71f9f0cc1e.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=590&amp;amp;id=ua0100283&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=531&amp;amp;originWidth=1485&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=145693&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uc76d2cce-8872-450d-90f8-147f0c47706&amp;amp;title=&amp;amp;width=1650.000043710074&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657525725796-04d38375-bff2-4414-9c35-b6093fa13788.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=937&amp;amp;id=ue23baed1&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=843&amp;amp;originWidth=1444&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=132260&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u2b7954a1-f6cb-432c-b327-126689b972d&amp;amp;title=&amp;amp;width=1604.4444869477084&quot; alt=&quot;image.png&quot; /&gt;
注：刚才修改副本为2了，又修改成4进行测试的！
&lt;h1 id=&quot;最终打包发布&quot;&gt;最终打包发布：&lt;/h1&gt;
&lt;h2 id=&quot;webhook&quot;&gt;webhook&lt;/h2&gt;
打包发布第一步骤如果开启webhook
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657525826668-9a4073f6-ae75-418e-9173-1930d17e130c.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=878&amp;amp;id=u7e5f078b&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=790&amp;amp;originWidth=1637&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=218066&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u6e298385-5e26-4e31-abda-af173756f00&amp;amp;title=&amp;amp;width=1818.8889370729908&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;img-build&quot;&gt;IMG build&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ make install
[zhangpeng@zhangpeng kube-oprator1]$ make docker-build docker-push IMG=ccr.ccs.tencentyun.com/layatools/zpredis:v5
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657525999165-c1cfcd88-ef85-4640-a860-17ac3efd99ca.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=621&amp;amp;id=u1229690f&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=559&amp;amp;originWidth=1542&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=138500&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ud962fd71-96ca-4efc-b370-ed06d61628d&amp;amp;title=&amp;amp;width=1713.3333787211677&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657526435888-c8cc1d87-6862-4670-b930-655d35e46054.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=508&amp;amp;id=ua6af0417&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=457&amp;amp;originWidth=1169&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=86464&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u4bdb5b45-420f-49be-929f-f87bed22ddb&amp;amp;title=&amp;amp;width=1298.8889232976946&quot; alt=&quot;image.png&quot; /&gt;
Dockerfile中增加一下配置：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;COPY helper/ helper/
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657526606632-ba0380a6-6365-49fc-8f69-e39099168a5b.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=583&amp;amp;id=u5e2412c6&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=525&amp;amp;originWidth=1732&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=120851&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u8a0b8c77-c36a-41dd-b18d-27c3edf1277&amp;amp;title=&amp;amp;width=1924.4444954248136&quot; alt=&quot;image.png&quot; /&gt;
继续执行构建上传镜像：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ make docker-build docker-push IMG=ccr.ccs.tencentyun.com/layatools/zpredis:v5

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657526935179-7a5dd6d1-6289-4718-a9ae-9d58db83680a.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=620&amp;amp;id=ua13eb192&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=558&amp;amp;originWidth=1452&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=110384&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ue63e9934-98c2-494b-a34d-84954bbe7ea&amp;amp;title=&amp;amp;width=1613.3333760720723&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;发布&quot;&gt;发布&lt;/h2&gt;
正常流程：
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ make deploy IMG=ccr.ccs.tencentyun.com/layatools/zpredis:v5
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
由于 我的环境问题还要拆解一下命令：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ cd config/manager &amp;amp;&amp;amp;  kustomize edit set image controller=ccr.ccs.tencentyun.com/layatools/zpredis:v5
[zhangpeng@zhangpeng manager]$ cd ../../
[zhangpeng@zhangpeng kube-oprator1]$ kustomize build config/default | kubectl apply -f -
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657527028490-59469644-839b-497a-a685-2f78192d0a40.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=672&amp;amp;id=u3df9cec1&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=605&amp;amp;originWidth=1569&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=161181&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u1287c769-ebfc-4d0a-8683-515f039b557&amp;amp;title=&amp;amp;width=1743.3333795158965&quot; alt=&quot;image.png&quot; /&gt;
&lt;h2 id=&quot;权限&quot;&gt;权限&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods -n kube-oprator1-system 
NAME                                                READY   STATUS    RESTARTS   AGE
kube-oprator1-controller-manager-84c7dcf9fc-xxnk8   2/2     Running   
[zhangpeng@zhangpeng kube-oprator1]$ kubectl logs -f kube-oprator1-controller-manager-84c7dcf9fc-xxnk8 -n  kube-oprator1-system 
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657527692801-8ed0053a-7f73-4f08-97f2-986e663575b0.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=570&amp;amp;id=u10ec4c13&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=513&amp;amp;originWidth=1663&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=200360&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u5420d014-5be7-4393-8a54-670bf20df9c&amp;amp;title=&amp;amp;width=1847.7778267271738&quot; alt=&quot;image.png&quot; /&gt;
恩 权限不够 临时搞一个clusterrolebinding ：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl get sa kube-oprator1-controller-manager  -n kube-oprator1-system -o yaml
apiVersion: v1
kind: ServiceAccount
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {&quot;apiVersion&quot;:&quot;v1&quot;,&quot;kind&quot;:&quot;ServiceAccount&quot;,&quot;metadata&quot;:{&quot;annotations&quot;:{},&quot;name&quot;:&quot;kube-oprator1-controller-manager&quot;,&quot;namespace&quot;:&quot;kube-oprator1-system&quot;}}
  creationTimestamp: &quot;2022-06-30T10:53:04Z&quot;
  name: kube-oprator1-controller-manager
  namespace: kube-oprator1-system
  resourceVersion: &quot;1917&quot;
  uid: 46634b00-0c32-4862-8afb-17bb9d2181d0
secrets:
- name: kube-oprator1-controller-manager-token-x2c9f
[zhangpeng@zhangpeng kube-oprator1]$ kubectl create clusterrolebinding kube-oprator1-system --clusterrole cluster-admin --serviceaccount=kube-oprator1-system:kube-oprator1-controller-manager
clusterrolebinding.rbac.authorization.k8s.io/kube-oprator1-system created

&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657527796555-af54cda7-372c-405f-9319-191af6611eb4.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=631&amp;amp;id=ua5defd1d&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=568&amp;amp;originWidth=1664&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=117649&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=uc4daf3f2-3e86-4b9f-8192-d61f827f5fb&amp;amp;title=&amp;amp;width=1848.8889378677193&quot; alt=&quot;image.png&quot; /&gt;
delete pod等其启动：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[zhangpeng@zhangpeng kube-oprator1]$ kubectl delete pods kube-oprator1-controller-manager-84c7dcf9fc-xxnk8 -n  kube-oprator1-system 
pod &quot;kube-oprator1-controller-manager-84c7dcf9fc-xxnk8&quot; deleted
[zhangpeng@zhangpeng kube-oprator1]$ kubectl get pods -n kube-oprator1-system 
NAME                                                READY   STATUS    RESTARTS   AGE
kube-oprator1-controller-manager-84c7dcf9fc-fbzsl   1/2     Running   0          4s
[zhangpeng@zhangpeng kube-oprator1]$ kubectl logs -f kube-oprator1-controller-manager-84c7dcf9fc-fbzsl -n  kube-oprator1-system 
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
修改副本3为2：
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657527900073-f12b50cb-7ee4-4db9-847f-d708cc337986.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=821&amp;amp;id=u0ea3cf6c&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=739&amp;amp;originWidth=1718&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=221072&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=ua314cf71-8f8c-4b79-a329-9b42b8c5295&amp;amp;title=&amp;amp;width=1908.8889394571765&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657527960537-c993aa1b-b83d-4243-a780-7ad494f4acd0.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=733&amp;amp;id=u41f48e31&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=660&amp;amp;originWidth=1694&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=236163&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u4a012872-4810-4223-ab0d-913a8dff3ca&amp;amp;title=&amp;amp;width=1882.2222720840844&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657527991780-87b60bb6-9b95-45f5-92eb-3d7326608035.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=642&amp;amp;id=u7a7f8661&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=578&amp;amp;originWidth=1080&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=92715&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u2ddc6f0d-e607-4a91-9dc0-3552e2f42be&amp;amp;title=&amp;amp;width=1200.0000317891447&quot; alt=&quot;image.png&quot; /&gt;
&lt;img src=&quot;https://cdn.nlark.com/yuque/0/2022/png/2505271/1657528004252-cba98573-a35d-4bcd-b813-ac396cd08278.png#clientId=uc659eb64-2610-4&amp;amp;crop=0&amp;amp;crop=0&amp;amp;crop=1&amp;amp;crop=1&amp;amp;from=paste&amp;amp;height=559&amp;amp;id=u94e1756b&amp;amp;margin=%5Bobject%20Object%5D&amp;amp;name=image.png&amp;amp;originHeight=503&amp;amp;originWidth=916&amp;amp;originalType=binary&amp;amp;ratio=1&amp;amp;rotation=0&amp;amp;showTitle=false&amp;amp;size=58175&amp;amp;status=done&amp;amp;style=none&amp;amp;taskId=u7bd538b4-aedf-4931-b9aa-a659e5ba837&amp;amp;title=&amp;amp;width=1017.777804739682&quot; alt=&quot;image.png&quot; /&gt;
基本完成，不过深究一下,pod删除了重建是不是也可以增加一下记录？
&lt;h1 id=&quot;总结&quot;&gt;总结：&lt;/h1&gt;
参考一下github地址或者文章：
&lt;a href=&quot;https://github.com/ls-2018/k8s-kustomize/blob/main/redis/helper/redis_helper.go&quot;&gt;https://github.com/ls-2018/k8s-kustomize&lt;/a&gt;
关于Event修改main.go参照：&lt;a href=&quot;https://github.com/767829413/learn-to-apply/blob/3621065003918070635880c3348f1d72bf6ead88/docs/Kubernetes/kubernetes-secondary-development.md&quot;&gt;https://github.com/767829413/learn-to-apply/blob/3621065003918070635880c3348f1d72bf6ead88/docs/Kubernetes/kubernetes-secondary-development.md&lt;/a&gt;
文章可以参考：&lt;a href=&quot;https://www.cnblogs.com/cosmos-wong/p/15894689.html&quot;&gt;https://www.cnblogs.com/cosmos-wong/p/15894689.html&lt;/a&gt;
&lt;a href=&quot;https://podsbook.com/posts/kubernetes/operator/#%E5%9F%BA%E7%A1%80%E6%A6%82%E5%BF%B5&quot;&gt;https://podsbook.com/posts/kubernetes/operator/#%E5%9F%BA%E7%A1%80%E6%A6%82%E5%BF%B5&lt;/a&gt;这个文章也不错！
finalizers参照：&lt;a href=&quot;https://kubernetes.io/blog/2021/05/14/using-finalizers-to-control-deletion/&quot;&gt;https://kubernetes.io/blog/2021/05/14/using-finalizers-to-control-deletion/&lt;/a&gt;
至于关于redis  operator的文章以及github地址来说除了&lt;a href=&quot;https://podsbook.com/posts/kubernetes/operator&quot;&gt;https://podsbook.com/posts/kubernetes/operator&lt;/a&gt; 还有finalizers官方文档，都应该是沈叔的课程&lt;a href=&quot;https://www.jtthink.com/course/154&quot;&gt;k8s基础速学3:Operator、Prometheus、日志收集&lt;/a&gt;中的内容来的！
接下来准备写一下自己的operator……
</description>
        <pubDate>Mon, 11 Jul 2022 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2022/07/11/Operator-2%E4%BB%8Epod%E5%BC%80%E5%A7%8B%E7%AE%80%E5%8D%95operator/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2022/07/11/Operator-2%E4%BB%8Epod%E5%BC%80%E5%A7%8B%E7%AE%80%E5%8D%95operator/</guid>
        
        <category>kubernetes</category>
        
        <category>operator</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-20-Kubernetes 1.19.12升级到1.20.9(强调一下selfLink)</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#集群配置&quot; id=&quot;markdown-toc-集群配置&quot;&gt;集群配置:&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#1-参考官方文档&quot; id=&quot;markdown-toc-1-参考官方文档&quot;&gt;1. 参考官方文档&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-确认可升级版本与升级方案&quot; id=&quot;markdown-toc-2-确认可升级版本与升级方案&quot;&gt;2. 确认可升级版本与升级方案&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-升级k8s-master-03节点控制平面&quot; id=&quot;markdown-toc-3-升级k8s-master-03节点控制平面&quot;&gt;3. 升级k8s-master-03节点控制平面&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#1-yum升级kubernetes插件&quot; id=&quot;markdown-toc-1-yum升级kubernetes插件&quot;&gt;1. yum升级kubernetes插件&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#2-腾空节点检查集群是否可以升级&quot; id=&quot;markdown-toc-2-腾空节点检查集群是否可以升级&quot;&gt;2. 腾空节点检查集群是否可以升级&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#3-升级版本到1209&quot; id=&quot;markdown-toc-3-升级版本到1209&quot;&gt;3. 升级版本到1.20.9&lt;/a&gt;&lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#4-升级其他控制平面k8s-master-01-k8s-master-02&quot; id=&quot;markdown-toc-4-升级其他控制平面k8s-master-01-k8s-master-02&quot;&gt;4. 升级其他控制平面（k8s-master-01 k8s-master-02）&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#5-work节点的升级&quot; id=&quot;markdown-toc-5-work节点的升级&quot;&gt;5. work节点的升级&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#6-验证升级&quot; id=&quot;markdown-toc-6-验证升级&quot;&gt;6. 验证升级&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#7-其他v1200中禁用了selflink&quot; id=&quot;markdown-toc-7-其他v1200中禁用了selflink&quot;&gt;7. 其他——v1.20.0中禁用了selfLink&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

持续升级过程：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/kdvrku&quot;&gt;Kubernetes 1.16.15升级到1.17.17&lt;/a&gt;,&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/ln04dq&quot;&gt;Kubernetes 1.17.17升级到1.18.20&lt;/a&gt;，&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/fg0su9&quot;&gt;Kubernetes 1.18.20升级到1.19.12&lt;/a&gt;

&lt;h2 id=&quot;集群配置&quot;&gt;集群配置:&lt;/h2&gt;

&lt;table&gt;
  &lt;thead&gt;
    &lt;tr&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;主机名&lt;/th&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;系统&lt;/th&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;ip&lt;/th&gt;
    &lt;/tr&gt;
  &lt;/thead&gt;
  &lt;tbody&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-vip&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;slb&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.37&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-01&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.41&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-02&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.34&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-03&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.26&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-01&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.36&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-02&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.83&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-03&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.40&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-04&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.49&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-05&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.45&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-06&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.18&lt;/td&gt;
    &lt;/tr&gt;
  &lt;/tbody&gt;
&lt;/table&gt;

&lt;h2 id=&quot;1-参考官方文档&quot;&gt;1. 参考官方文档&lt;/h2&gt;

参照：&lt;a href=&quot;https://kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&quot;&gt;https://kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&lt;/a&gt;

&lt;h2 id=&quot;2-确认可升级版本与升级方案&quot;&gt;2. 确认可升级版本与升级方案&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum list --showduplicates kubeadm --disableexcludes=kubernetes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

通过以上命令查询到1.20当前最新版本是1.20.9-0版本。master有三个节点还是按照个人习惯先升级k8s-master-03节点

&lt;img src=&quot;/assets/images/2021/07-20/5525f643332f773096084c4af275a520.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;3-升级k8s-master-03节点控制平面&quot;&gt;3. 升级k8s-master-03节点控制平面&lt;/h2&gt;

依然k8s-master-03执行：

&lt;h3 id=&quot;1-yum升级kubernetes插件&quot;&gt;1. yum升级kubernetes插件&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.20.9-0 kubelet-1.20.9-0 kubectl-1.20.9-0 --disableexcludes=kubernetes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/c2c1ea2eeec37f6762da8add2149ce69.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;2-腾空节点检查集群是否可以升级&quot;&gt;2. 腾空节点检查集群是否可以升级&lt;/h3&gt;

依然算是温习drain命令：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl drain k8s-master-03 --ignore-daemonsets
sudo kubeadm upgrade plan
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/a57e5bd780b9de2a34045005afc51f28.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;3-升级版本到1209&quot;&gt;3. 升级版本到1.20.9&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubeadm upgrade apply 1.20.9
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/540729f622eda5f706a46b24a5344d8c.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[root@k8s-master-03 ~]# sudo systemctl daemon-reload
[root@k8s-master-03 ~]# sudo systemctl restart kubelet
[root@k8s-master-03 ~]# kubectl uncordon k8s-master-03
node/k8s-master-03 uncordoned
[root@k8s-master-03 ~]# kubectl get nodes
[root@k8s-master-03 ~]# kubectl get pods -n kube-system
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/ebcb3e81c4a2c57a2212bca4d1940ecf.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-20/4d60bbb2d85b36a012e324320f8c59cd.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;4-升级其他控制平面k8s-master-01-k8s-master-02&quot;&gt;4. 升级其他控制平面（k8s-master-01 k8s-master-02）&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.20.9-0 kubelet-1.20.9-0 kubectl-1.20.9-0 --disableexcludes=kubernetes
sudo kubeadm upgrade node
sudo systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/99a86c01e7071b6f32dde13c542ee20b.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-20/9300839ce5fb55d08e7fb03bdaf622dc.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;5-work节点的升级&quot;&gt;5. work节点的升级&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.20.9-0 kubelet-1.20.9-0 kubectl-1.20.9-0 --disableexcludes=kubernetes
sudo kubeadm upgrade node
sudo systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

注：  个人都没有腾空节点，看个人需求了

&lt;img src=&quot;/assets/images/2021/07-20/c8447e998221fdb5969be2db12eb59f0.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-20/72c99919b43e009c3036f745e5862177.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;6-验证升级&quot;&gt;6. 验证升级&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt; kubectl get nodes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/05205d082f65da1588d5e11da40a200d.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;7-其他v1200中禁用了selflink&quot;&gt;7. 其他——v1.20.0中禁用了selfLink&lt;/h2&gt;

由于我的Prometheus oprator是0.4的分支，就准备卸载重新安装了。版本差距太大了。现在也不想搞什么分支用了直接用主线版本了：

基本过程参照：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/tm6vl7&quot;&gt;Kubernetes 1.20.5 安装Prometheus-Oprator&lt;/a&gt;。基本过程都没有问题，讲一个有问题的地方：

我的kubernetes1.16升级上来的这个集群storageclass是用的nfs：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get sc
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/3dc17afb46038906933c89455eec8bc1.png&quot; alt=&quot;image.png&quot; /&gt;

最后一

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get pods -n monitoring
kubectl logs -f prometheus-operator-84dc795dc8-lkl5r -n monitoring
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/044b59c409d92c126222644bf7ba825f.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-20/6c7705cd0ffa15fb543d67665aff2d18.png&quot; alt=&quot;image.png&quot; /&gt;

看关键词吧：

additional 貌似是自动发现的配置？

首先将prometheus-prometheus.yaml文件中的自动发现的配置注释掉。嗯服务还是没有起来，再看一眼日志：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl logs -f prometheus-operator-84dc795dc8-lkl5r -n monitoring
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

没有什么新的输出，但是看一眼pv,pvc没有创建。去看一下nfs的pod日志：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get pods -n nfs
kubectl logs -f nfs-client-provisioner-6cb4f54cbc-wqqw9 -n nfs
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-20/7d54e221f8ac10ac82ebaf39a182dd81.png&quot; alt=&quot;image.png&quot; /&gt;

class “managed-nfs-storage”: unexpected error getting claim reference: selfLink was empty, can’t make reference

百度selfLink参照：&lt;a href=&quot;https://www.orchome.com/10024&quot;&gt;https://www.orchome.com/10024&lt;/a&gt;

&lt;img src=&quot;/assets/images/2021/07-20/cd7a049b628b3282c03a4b6e49cba2fa.png&quot; alt=&quot;image.png&quot; /&gt;

修改三个master节点的kube-apiserver.yaml

然后pv,pvc创建成功  Prometheus 服务启动成功。然后再回过头来看一眼我的additional自动发现配置：

我在&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/tm6vl7&quot;&gt;Kubernetes 1.20.5 安装Prometheus-Oprator&lt;/a&gt;

&lt;img src=&quot;/assets/images/2021/07-20/7019b811ad9c9e232c80c84f2c547f3c.png&quot; alt=&quot;image.png&quot; /&gt;

拿我的老版本的这个文件试试？：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt; prometheus-additional.yaml
- job_name: 'kubernetes-service-endpoints'
  kubernetes_sd_configs:
  - role: endpoints
  relabel_configs:
  - source_labels: [__meta_kubernetes_service_annotation_prometheus_io_scrape]
    action: keep
    regex: true
  - source_labels: [__meta_kubernetes_service_annotation_prometheus_io_scheme]
    action: replace
    target_label: __scheme__
    regex: (https?)
  - source_labels: [__meta_kubernetes_service_annotation_prometheus_io_path]
    action: replace
    target_label: __metrics_path__
    regex: (.+)
  - source_labels: [__address__, __meta_kubernetes_service_annotation_prometheus_io_port]
    action: replace
    target_label: __address__
    regex: ([^:]+)(?::\d+)?;(\d+)
    replacement: $1:$2
  - action: labelmap
    regex: __meta_kubernetes_service_label_(.+)
  - source_labels: [__meta_kubernetes_namespace]
    action: replace
    target_label: kubernetes_namespace
  - source_labels: [__meta_kubernetes_service_name]
    action: replace
    target_label: kubernetes_name
EOF
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl delete secret additional-configs -n monitoring
kubectl create secret generic additional-configs --from-file=prometheus-additional.yaml -n monitoring
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

再看日志启动起来了。初步先怀疑我配置文件中的prometheus-additional.yaml 有问题。当然了这是个人问题了。强调的主要是master节点kube-apiserver.yaml文件的修改添加：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;- --feature-gates=RemoveSelfLink=false
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
</description>
        <pubDate>Tue, 20 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/20/Kubernetes-1.19.12%E5%8D%87%E7%BA%A7%E5%88%B01.20.9(%E5%BC%BA%E8%B0%83%E4%B8%80%E4%B8%8BselfLink)/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/20/Kubernetes-1.19.12%E5%8D%87%E7%BA%A7%E5%88%B01.20.9(%E5%BC%BA%E8%B0%83%E4%B8%80%E4%B8%8BselfLink)/</guid>
        
        <category>kubernetes</category>
        
        <category>kubeadm</category>
        
        <category>selfLink</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-19-Kubernetes 1.18.20升级到1.19.12</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#集群配置&quot; id=&quot;markdown-toc-集群配置&quot;&gt;集群配置:&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#1-参考官方文档&quot; id=&quot;markdown-toc-1-参考官方文档&quot;&gt;1. 参考官方文档&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-确认可升级版本与升级方案&quot; id=&quot;markdown-toc-2-确认可升级版本与升级方案&quot;&gt;2. 确认可升级版本与升级方案&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-升级k8s-master-03节点控制平面&quot; id=&quot;markdown-toc-3-升级k8s-master-03节点控制平面&quot;&gt;3. 升级k8s-master-03节点控制平面&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#1-yum升级kubernetes插件&quot; id=&quot;markdown-toc-1-yum升级kubernetes插件&quot;&gt;1. yum升级kubernetes插件&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#2-腾空节点检查集群是否可以升级&quot; id=&quot;markdown-toc-2-腾空节点检查集群是否可以升级&quot;&gt;2. 腾空节点检查集群是否可以升级&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#3-升级版本到11912&quot; id=&quot;markdown-toc-3-升级版本到11912&quot;&gt;3. 升级版本到1.19.12&lt;/a&gt;&lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#4-升级其他控制平面k8s-master-01-k8s-master-02&quot; id=&quot;markdown-toc-4-升级其他控制平面k8s-master-01-k8s-master-02&quot;&gt;4. 升级其他控制平面（k8s-master-01 k8s-master-02）&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#5-work节点的升级&quot; id=&quot;markdown-toc-5-work节点的升级&quot;&gt;5. work节点的升级&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#6-验证升级&quot; id=&quot;markdown-toc-6-验证升级&quot;&gt;6. 验证升级&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#7-其他&quot; id=&quot;markdown-toc-7-其他&quot;&gt;7. 其他&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

升级是一件持续的事情：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/kdvrku&quot;&gt;Kubernetes 1.16.15升级到1.17.17&lt;/a&gt;,&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/ln04dq&quot;&gt;Kubernetes 1.17.17升级到1.18.20&lt;/a&gt;

&lt;h2 id=&quot;集群配置&quot;&gt;集群配置:&lt;/h2&gt;

&lt;table&gt;
  &lt;thead&gt;
    &lt;tr&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;主机名&lt;/th&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;系统&lt;/th&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;ip&lt;/th&gt;
    &lt;/tr&gt;
  &lt;/thead&gt;
  &lt;tbody&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-vip&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;slb&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.37&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-01&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.41&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-02&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.34&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-03&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.26&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-01&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.36&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-02&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.83&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-03&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.40&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-04&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.49&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-05&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.45&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-06&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.18&lt;/td&gt;
    &lt;/tr&gt;
  &lt;/tbody&gt;
&lt;/table&gt;

&lt;h2 id=&quot;1-参考官方文档&quot;&gt;1. 参考官方文档&lt;/h2&gt;

参照：&lt;a href=&quot;https://kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&quot;&gt;https://kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&lt;/a&gt;

&lt;h2 id=&quot;2-确认可升级版本与升级方案&quot;&gt;2. 确认可升级版本与升级方案&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum list --showduplicates kubeadm --disableexcludes=kubernetes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

通过以上命令查询到1.19当前最新版本是1.19.12-0版本。master有三个节点还是按照个人习惯先升级k8s-master-03节点

&lt;img src=&quot;/assets/images/2021/07-19/21b5fc168b6892cf1ed6a2dc2e15bf50.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;3-升级k8s-master-03节点控制平面&quot;&gt;3. 升级k8s-master-03节点控制平面&lt;/h2&gt;

依然k8s-master-03执行：

&lt;h3 id=&quot;1-yum升级kubernetes插件&quot;&gt;1. yum升级kubernetes插件&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.19.12-0 kubelet-1.19.12-0 kubectl-1.19.12-0 --disableexcludes=kubernetes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/eee9f9e4dd022c4c3615b23224e423ad.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;2-腾空节点检查集群是否可以升级&quot;&gt;2. 腾空节点检查集群是否可以升级&lt;/h3&gt;

依然算是温习drain命令：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl drain k8s-master-03 --ignore-daemonsets
sudo kubeadm upgrade plan
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/239cd20e88e6fb897bc07d587d00c4bf.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;3-升级版本到11912&quot;&gt;3. 升级版本到1.19.12&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubeadm upgrade apply 1.19.12
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

注意：特意强调一下work节点的版本也都是1.18.20了，没有出现夸更多版本的状况了

&lt;img src=&quot;/assets/images/2021/07-19/473d4431b9290d52f0961fb677aad0f4.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-19/bab644ca3a7e140c4260a8ffd38414e1.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[root@k8s-master-03 ~]# sudo systemctl daemon-reload
[root@k8s-master-03 ~]# sudo systemctl restart kubelet
[root@k8s-master-03 ~]# kubectl uncordon k8s-master-03
node/k8s-master-03 uncordoned
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/2d80e998c91c70041137917108385e40.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;4-升级其他控制平面k8s-master-01-k8s-master-02&quot;&gt;4. 升级其他控制平面（k8s-master-01 k8s-master-02）&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;sudo yum install kubeadm-1.19.12-0 kubelet-1.19.12-0 kubectl-1.19.12-0 --disableexcludes=kubernetes
sudo kubeadm upgrade node
sudo systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/0d4aba05e16672884ecda621234acea3.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-19/6f70fe0222c73f0b66d676997ecd8146.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;5-work节点的升级&quot;&gt;5. work节点的升级&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;sudo yum install kubeadm-1.19.12-0 kubelet-1.19.12-0 kubectl-1.19.12-0 --disableexcludes=kubernetes
sudo kubeadm upgrade node
sudo systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/b1d96282756bb2ea5a478198e6fc99ab.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;6-验证升级&quot;&gt;6. 验证升级&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt; kubectl get nodes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/a4c8eff6d737db3b874d69d1565faec2.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;7-其他&quot;&gt;7. 其他&lt;/h2&gt;

查看一眼kube-system下插件的日志，确认插件是否正常

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl logs -f kube-controller-manager-k8s-master-01 -n kube-system
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-19/631bf3ddbfdca94f94b1334133350048.png&quot; alt=&quot;image.png&quot; /&gt;

目测是没有问题的就不管了….嗯Prometheus的问题还是留着。本来也准备安装主线版本了。过去的准备卸载了.如出现cluseterrole问题可参照：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/kdvrku&quot;&gt;Kubernetes 1.16.15升级到1.17.17&lt;/a&gt;

&lt;img src=&quot;/assets/images/2021/07-19/243124f46e381343845a30da472d6bda.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-19/9fbe45fd87a561d557c09b2fbfd3f595.png&quot; alt=&quot;&quot; /&gt;
</description>
        <pubDate>Mon, 19 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/19/Kubernetes-1.18.20%E5%8D%87%E7%BA%A7%E5%88%B01.19.12/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/19/Kubernetes-1.18.20%E5%8D%87%E7%BA%A7%E5%88%B01.19.12/</guid>
        
        <category>kubernetes</category>
        
        <category>kubeadm</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-17-Kubernetes 1.17.17升级到1.18.20</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#集群配置&quot; id=&quot;markdown-toc-集群配置&quot;&gt;集群配置&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#1-参考官方文档&quot; id=&quot;markdown-toc-1-参考官方文档&quot;&gt;1. 参考官方文档&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-确认可升级版本与升级方案&quot; id=&quot;markdown-toc-2-确认可升级版本与升级方案&quot;&gt;2. 确认可升级版本与升级方案&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-升级k8s-master-03节点控制平面&quot; id=&quot;markdown-toc-3-升级k8s-master-03节点控制平面&quot;&gt;3. 升级k8s-master-03节点控制平面&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#1-yum升级kubernetes插件&quot; id=&quot;markdown-toc-1-yum升级kubernetes插件&quot;&gt;1. yum升级kubernetes插件&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#2-腾空节点检查集群是否可以升级&quot; id=&quot;markdown-toc-2-腾空节点检查集群是否可以升级&quot;&gt;2. 腾空节点检查集群是否可以升级&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#3-升级版本到11820&quot; id=&quot;markdown-toc-3-升级版本到11820&quot;&gt;3. 升级版本到1.18.20&lt;/a&gt;            &lt;ul&gt;
              &lt;li&gt;&lt;a href=&quot;#1-小插曲&quot; id=&quot;markdown-toc-1-小插曲&quot;&gt;1. 小插曲&lt;/a&gt;&lt;/li&gt;
              &lt;li&gt;&lt;a href=&quot;#2-升级到11820&quot; id=&quot;markdown-toc-2-升级到11820&quot;&gt;2. 升级到1.18.20&lt;/a&gt;&lt;/li&gt;
              &lt;li&gt;&lt;a href=&quot;#3-重启kubelet-取消节点保护&quot; id=&quot;markdown-toc-3-重启kubelet-取消节点保护&quot;&gt;3. 重启kubelet 取消节点保护&lt;/a&gt;&lt;/li&gt;
            &lt;/ul&gt;
          &lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#4-升级其他控制平面k8s-master-01-k8s-master-02&quot; id=&quot;markdown-toc-4-升级其他控制平面k8s-master-01-k8s-master-02&quot;&gt;4. 升级其他控制平面（k8s-master-01 k8s-master-02）&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#5-work节点的升级&quot; id=&quot;markdown-toc-5-work节点的升级&quot;&gt;5. work节点的升级&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#6-验证升级&quot; id=&quot;markdown-toc-6-验证升级&quot;&gt;6. 验证升级&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

参照：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/kdvrku&quot;&gt;https://www.yuque.com/duiniwukenaihe/ehb02i/kdvrku&lt;/a&gt; 完成了1.16.15到1.17.17 的升级，现在升级到1.18版本

&lt;h2 id=&quot;集群配置&quot;&gt;集群配置&lt;/h2&gt;

&lt;table&gt;
  &lt;thead&gt;
    &lt;tr&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;主机名&lt;/th&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;系统&lt;/th&gt;
      &lt;th style=&quot;text-align: left&quot;&gt;ip&lt;/th&gt;
    &lt;/tr&gt;
  &lt;/thead&gt;
  &lt;tbody&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-vip&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;slb&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.37&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-01&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.41&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-02&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.34&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-master-03&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.26&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-01&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.36&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-02&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.83&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-03&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.40&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-04&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.49&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-05&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.45&lt;/td&gt;
    &lt;/tr&gt;
    &lt;tr&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;k8s-node-06&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;centos7&lt;/td&gt;
      &lt;td style=&quot;text-align: left&quot;&gt;10.0.0.18&lt;/td&gt;
    &lt;/tr&gt;
  &lt;/tbody&gt;
&lt;/table&gt;

&lt;h2 id=&quot;1-参考官方文档&quot;&gt;1. 参考官方文档&lt;/h2&gt;

参照：&lt;a href=&quot;https://kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&quot;&gt;https://kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&lt;/a&gt;

&lt;img src=&quot;/assets/images/2021/07-17/36edaad43b4f75854a0b54240a8a7207.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;a href=&quot;https://v1-17.docs.kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&quot;&gt;https://v1-17.docs.kubernetes.io/zh/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/&lt;/a&gt;

kubeadm 创建的 Kubernetes 集群从 1.16.x 版本升级到 1.17.x 版本，以及从版本 1.17.x 升级到 1.17.y ，其中 y &amp;gt; x。现在继续将版本升级到1.18。从1.16升级到1.17有点理解错误：1.16.15我以为只能先升级到1.17.15。仔细看了下文档是没有这说法的。我就准备从1.17.17升级到1.18的最新版本了！

&lt;img src=&quot;/assets/images/2021/07-17/443a964b2f291bf5881b2c0b776d8999.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;2-确认可升级版本与升级方案&quot;&gt;2. 确认可升级版本与升级方案&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum list --showduplicates kubeadm --disableexcludes=kubernetes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

通过以上命令查询到1.18当前最新版本是1.18.20-0版本。master有三个节点还是按照个人习惯先升级k8s-master-03节点

&lt;img src=&quot;/assets/images/2021/07-17/7638dcc0087ef1c771680a2476475e0d.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;3-升级k8s-master-03节点控制平面&quot;&gt;3. 升级k8s-master-03节点控制平面&lt;/h2&gt;

依然k8s-master-03执行：

&lt;h3 id=&quot;1-yum升级kubernetes插件&quot;&gt;1. yum升级kubernetes插件&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.18.20-0 kubelet-1.18.20-0 kubectl-1.18.20-0 --disableexcludes=kubernetes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/2bf8ea0079a28957e118d0baae4c125f.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;2-腾空节点检查集群是否可以升级&quot;&gt;2. 腾空节点检查集群是否可以升级&lt;/h3&gt;

特意整一下腾空（1.16.15升级到1.17.17的时候没有整。就当温习一下drain命令了）

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl drain k8s-master-03 --ignore-daemonsets
sudo kubeadm upgrade plan
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/e3d6f5a621e726df15d81fd54d534118.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;3-升级版本到11820&quot;&gt;3. 升级版本到1.18.20&lt;/h3&gt;

&lt;h4 id=&quot;1-小插曲&quot;&gt;1. 小插曲&lt;/h4&gt;

嗯操作升级到1.18.20版本

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubeadm upgrade apply 1.18.20
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/abba12e22a560f2d0acbe33b41254a54.png&quot; alt=&quot;image.png&quot; /&gt;

嗯有一个work节点没有升级版本依然是&lt;strong&gt;1.16.15版本&lt;/strong&gt;哈哈哈提示一下。master节点应该是向下兼容一个版本的。先把test-ubuntu-01节点升级到1.17.17

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[root@k8s-master-01 ~]# kubectl get nodes
NAME             STATUS                     ROLES    AGE    VERSION
k8s-master-01    Ready                      master   317d   v1.17.17
k8s-master-02    Ready                      master   317d   v1.17.17
k8s-master-03    Ready,SchedulingDisabled   master   317d   v1.17.17
k8s-node-01      Ready                      node     569d   v1.17.17
k8s-node-02      Ready                      node     22d    v1.17.17
k8s-node-03      Ready                      node     569d   v1.17.17
k8s-node-04      Ready                      node     567d   v1.17.17
k8s-node-05      Ready                      node     567d   v1.17.17
k8s-node-06      Ready                      node     212d   v1.17.17
sh02-node-01     Ready                      node     16d    v1.17.17
test-ubuntu-01   Ready,SchedulingDisabled   &amp;lt;none&amp;gt;   22d    v1.16.15
tm-node-002      Ready,SchedulingDisabled   node     174d   v1.17.17
tm-node-003      Ready                      &amp;lt;none&amp;gt;   119d   v1.17.17
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/87ed36af0f736b2c91b7a357370e87e4.png&quot; alt=&quot;image.png&quot; /&gt;

先升级下test-ubuntu-01节点如下(此操作在test-ubuntu-01节点执行):

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;sudo apt-get install -y kubelet=1.17.17-00 kubectl=1.17.17-00 kubeadm=1.17.17-00
sudo kubeadm upgrade node
sudo systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

登陆任一master节点确认版本都为1.17.17版本（正常在k8s-master-03节点看就行了，我xshell开了好几个窗口就那01节点看了）：

&lt;img src=&quot;/assets/images/2021/07-17/b639269326f6cc053a80577c12b1972c.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h4 id=&quot;2-升级到11820&quot;&gt;2. 升级到1.18.20&lt;/h4&gt;

k8s-master-03节点继续执行升级：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubeadm upgrade apply v1.18.20
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/56cc28afd49da765ac5cd2be7097678d.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h4 id=&quot;3-重启kubelet-取消节点保护&quot;&gt;3. 重启kubelet 取消节点保护&lt;/h4&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[root@k8s-master-03 ~]# sudo systemctl daemon-reload
[root@k8s-master-03 ~]# sudo systemctl restart kubelet
[root@k8s-master-03 ~]# kubectl uncordon k8s-master-03
node/k8s-master-03 uncordoned
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/c954491c4bed6759be5ff8ebc77a2bd3.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;4-升级其他控制平面k8s-master-01-k8s-master-02&quot;&gt;4. 升级其他控制平面（k8s-master-01 k8s-master-02）&lt;/h2&gt;

k8s-master-01 k8s-master-02节点都执行以下操作（这里就没有清空节点了，看个人需求）：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.18.20-0 kubelet-1.18.20-0 kubectl-1.18.20-0 --disableexcludes=kubernetes
kubeadm upgrade node
systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/37cd25a3da4cbe6487cdd6252b64e4f9.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;5-work节点的升级&quot;&gt;5. work节点的升级&lt;/h2&gt;

没有执行清空节点（当然了 例行升级的话还是最后执行以下清空节点），直接升级了，如下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;yum install kubeadm-1.18.20-0 kubelet-1.18.20-0 kubectl-1.18.20-0 --disableexcludes=kubernetes
kubeadm upgrade node
systemctl daemon-reload
sudo systemctl restart kubelet
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;h2 id=&quot;6-验证升级&quot;&gt;6. 验证升级&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get nodes
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-17/7c9c75d27e56b50b5a679365e0c95615.png&quot; alt=&quot;image.png&quot; /&gt;

注意：test-ubuntu-01忽略。

目测是升级成功的，看一下kube-system下的几个系统组件发现：ontroller-manager的clusterrole system:kube-controller-manager的权限又有问题了？

&lt;img src=&quot;/assets/images/2021/07-17/c595b190871b8ae8ea4903d6fe12bccd.png&quot; alt=&quot;image.png&quot; /&gt;

同1.16.15升级1.17.17一样：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get  clusterrole system:kube-controller-manager -o yaml &amp;gt; 1.yaml
kubectl delete  clusterrole system:kube-controller-manager
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt;  kube-controller-manager.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  annotations:
    rbac.authorization.kubernetes.io/autoupdate: &quot;true&quot;
  creationTimestamp: &quot;2021-03-22T11:29:59Z&quot;
  labels:
    kubernetes.io/bootstrapping: rbac-defaults
  name: system:kube-controller-manager
  resourceVersion: &quot;92&quot;
  uid: 7480dabb-ec0d-4169-bdbd-418d178e2751
rules:
- apiGroups:
  - &quot;&quot;
  - events.k8s.io
  resources:
  - events
  verbs:
  - create
  - patch
  - update
- apiGroups:
  - coordination.k8s.io
  resources:
  - leases
  verbs:
  - create
- apiGroups:
  - coordination.k8s.io
  resourceNames:
  - kube-controller-manager
  resources:
  - leases
  verbs:
  - get
  - update
- apiGroups:
  - &quot;&quot;
  resources:
  - endpoints
  verbs:
  - create
- apiGroups:
  - &quot;&quot;
  resourceNames:
  - kube-controller-manager
  resources:
  - endpoints
  verbs:
  - get
  - update
- apiGroups:
  - &quot;&quot;
  resources:
  - secrets
  - serviceaccounts
  verbs:
  - create
- apiGroups:
  - &quot;&quot;
  resources:
  - secrets
  verbs:
  - delete
- apiGroups:
  - &quot;&quot;
  resources:
  - configmaps
  - namespaces
  - secrets
  - serviceaccounts
  verbs:
  - get
- apiGroups:
  - &quot;&quot;
  resources:
  - secrets
  - serviceaccounts
  verbs:
  - update
- apiGroups:
  - authentication.k8s.io
  resources:
  - tokenreviews
  verbs:
  - create
- apiGroups:
  - authorization.k8s.io
  resources:
  - subjectaccessreviews
  verbs:
  - create
- apiGroups:
  - '*'
  resources:
  - '*'
  verbs:
  - list
  - watch
- apiGroups:
  - &quot;&quot;
  resources:
  - serviceaccounts/token
  verbs:
  - create
EOF
kubectl apply -f kube-controller-manager.yaml
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

目测是可以了…………………..截图过程都找不到了，昨天晚上写的东西没有保存停电了……

这里的flannel没有什么问题 就不用看了 Prometheus依然是有问题的……我就先忽略了。因为我还准备升级集群版本…升级版本后再搞Prometheus了
</description>
        <pubDate>Sat, 17 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/17/Kubernetes-1.17.17%E5%8D%87%E7%BA%A7%E5%88%B01.18.20/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/17/Kubernetes-1.17.17%E5%8D%87%E7%BA%A7%E5%88%B01.18.20/</guid>
        
        <category>kubernetes</category>
        
        <category>kubeadm</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-16-TKE1.20.6搭建elasticsearch on kubernetes</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#1-在kubernete集群中部署eck&quot; id=&quot;markdown-toc-1-在kubernete集群中部署eck&quot;&gt;1. 在kubernete集群中部署ECK&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-安装自定义资源定义和操作员及其rbac规则&quot; id=&quot;markdown-toc-1-安装自定义资源定义和操作员及其rbac规则&quot;&gt;1. 安装自定义资源定义和操作员及其RBAC规则：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-监视操作日志&quot; id=&quot;markdown-toc-2-监视操作日志&quot;&gt;2. 监视操作日志：&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#2-部署elasticsearch集群&quot; id=&quot;markdown-toc-2-部署elasticsearch集群&quot;&gt;2. 部署elasticsearch集群&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-定制化elasticsearch-镜像&quot; id=&quot;markdown-toc-1-定制化elasticsearch-镜像&quot;&gt;1. 定制化elasticsearch 镜像&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#2-打包镜像并上传到腾讯云镜像仓库也可以是其他私有仓库&quot; id=&quot;markdown-toc-2-打包镜像并上传到腾讯云镜像仓库也可以是其他私有仓库&quot;&gt;2. 打包镜像并上传到腾讯云镜像仓库，也可以是其他私有仓库&lt;/a&gt;&lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-创建elasticsearch部署yaml文件部署elasticsearch集群&quot; id=&quot;markdown-toc-2-创建elasticsearch部署yaml文件部署elasticsearch集群&quot;&gt;2. 创建elasticsearch部署yaml文件，部署elasticsearch集群&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#1-创建部署elasticsearch应用的命名空间&quot; id=&quot;markdown-toc-1-创建部署elasticsearch应用的命名空间&quot;&gt;1. 创建部署elasticsearch应用的命名空间&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#2-部署yaml文件并查看应用部署状态&quot; id=&quot;markdown-toc-2-部署yaml文件并查看应用部署状态&quot;&gt;2. 部署yaml文件并查看应用部署状态&lt;/a&gt;&lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-获取elasticsearch凭据&quot; id=&quot;markdown-toc-3-获取elasticsearch凭据&quot;&gt;3. 获取elasticsearch凭据&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#4-直接安装kibana了&quot; id=&quot;markdown-toc-4-直接安装kibana了&quot;&gt;4. 直接安装kibana了&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#5-对外映射kibana-服务&quot; id=&quot;markdown-toc-5-对外映射kibana-服务&quot;&gt;5. 对外映射kibana 服务&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

昨天刚开通了TKE1.20.6版本，想体验下elasticsearch 环境搭建到集群上，基本参照&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/owzfle&quot;&gt;Kuberentes 1.20.5搭建eck&lt;/a&gt;。当然了版本还是有区别的当时安装的时候eck版本是1.5。现在貌似是1.6了？参见官方文档：&lt;a href=&quot;https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-deploy-eck.html&quot;&gt;https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-deploy-eck.html&lt;/a&gt;

&lt;img src=&quot;/assets/images/2021/07-16/be757e5104f1d8e0ab40a3eab2771f30.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h1 id=&quot;1-在kubernete集群中部署eck&quot;&gt;1. 在kubernete集群中部署ECK&lt;/h1&gt;

&lt;h2 id=&quot;1-安装自定义资源定义和操作员及其rbac规则&quot;&gt;1. 安装&lt;a href=&quot;https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/&quot;&gt;自定义资源定义&lt;/a&gt;和操作员及其RBAC规则：&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl apply -f https://download.elastic.co/downloads/eck/1.6.0/all-in-one.yaml
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/0cd6188c58fdf50cdef645b986ffa97a.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;2-监视操作日志&quot;&gt;2. 监视操作日志：&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl -n elastic-system logs -f statefulset.apps/elastic-operator
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/bed43955f234a43adab5d53750032328.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h1 id=&quot;2-部署elasticsearch集群&quot;&gt;2. 部署elasticsearch集群&lt;/h1&gt;

&lt;h2 id=&quot;1-定制化elasticsearch-镜像&quot;&gt;1. 定制化elasticsearch 镜像&lt;/h2&gt;

&lt;img src=&quot;/assets/images/2021/07-16/d9c8f0bacdc426fe9cfaf4e7cbe35054.png&quot; alt=&quot;image.png&quot; /&gt;

最新的版本 7.13.3了image标签 定制化一下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;FROM docker.elastic.co/elasticsearch/elasticsearch:7.13.3
ARG ACCESS_KEY=XXXXXXXXX
ARG SECRET_KEY=XXXXXXX
ARG ENDPOINT=cos.ap-shanghai.myqcloud.com
ARG ES_VERSION=7.13.3

ARG PACKAGES=&quot;net-tools lsof&quot;
ENV allow_insecure_settings 'true'
RUN rm -rf /etc/localtime &amp;amp;&amp;amp; cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

RUN echo 'Asia/Shanghai' &amp;gt; /etc/timezone
RUN  if [ -n &quot;${PACKAGES}&quot; ]; then  yum install -y $PACKAGES &amp;amp;&amp;amp; yum clean all &amp;amp;&amp;amp; rm -rf /var/cache/yum; fi
RUN \
     /usr/share/elasticsearch/bin/elasticsearch-plugin install --batch repository-s3 &amp;amp;&amp;amp; \
    /usr/share/elasticsearch/bin/elasticsearch-keystore create &amp;amp;&amp;amp; \
	echo &quot;XXXXXX&quot;  | /usr/share/elasticsearch/bin/elasticsearch-keystore add --stdin s3.client.default.access_key  &amp;amp;&amp;amp; \
	echo &quot;XXXXXX&quot;  | /usr/share/elasticsearch/bin/elasticsearch-keystore add --stdin s3.client.default.secret_key
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;h4 id=&quot;2-打包镜像并上传到腾讯云镜像仓库也可以是其他私有仓库&quot;&gt;2. 打包镜像并上传到腾讯云镜像仓库，也可以是其他私有仓库&lt;/h4&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt; docker build -t ccr.ccs.tencentyun.com/xxxx/elasticsearch:7.13.3 .
 docker push  ccr.ccs.tencentyun.com/xxxx/elasticsearch:7.13.3
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/963e41ee33348e4244b686e81840b25b.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;2-创建elasticsearch部署yaml文件部署elasticsearch集群&quot;&gt;2. 创建elasticsearch部署yaml文件，部署elasticsearch集群&lt;/h2&gt;

修改了自己打包 image tag ，使用了腾讯云cbs csi块存储。并定义了部署的namespace，创建了namespace logging.

&lt;h3 id=&quot;1-创建部署elasticsearch应用的命名空间&quot;&gt;1. 创建部署elasticsearch应用的命名空间&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl create ns logging
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

先下发下仓库秘钥：

&lt;img src=&quot;/assets/images/2021/07-16/9681dbe2addf11ac98398bb260bd3751.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt; elastic.yaml
apiVersion: elasticsearch.k8s.elastic.co/v1
kind: Elasticsearch
metadata:
  name: elastic
  namespace: logging
spec:
  version: 7.12.0
  image: ccr.ccs.tencentyun.com/XXXX/elasticsearch:7.12.0
  http:
    tls:
      selfSignedCertificate:
        disabled: true
  nodeSets:
  - name: laya
    count: 3
    podTemplate:
      spec:
        containers:
        - name: elasticsearch
          env:
          - name: ES_JAVA_OPTS
            value: -Xms2g -Xmx2g
          resources:
            requests:
              memory: 4Gi
              cpu: 0.5
            limits:
              memory: 4Gi
              cpu: 2
        imagePullSecrets:
        - name: qcloudregistrykey              
    config:
      node.master: true
      node.data: true
      node.ingest: true
      node.store.allow_mmap: false
    volumeClaimTemplates:
    - metadata:
        name: elasticsearch-data
      spec:
        accessModes:
        - ReadWriteOnce
        storageClassName: cbs-csi 
        resources:
          requests:
            storage: 200Gi
EOF          
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

注意：一定记得加上仓库秘钥如果是私有仓库

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;        imagePullSecrets:
        - name: qcloudregistrykey
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;h3 id=&quot;2-部署yaml文件并查看应用部署状态&quot;&gt;2. 部署yaml文件并查看应用部署状态&lt;/h3&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl apply -f elastic.yaml
kubectl get elasticsearch -n logging
kubectl get elasticsearch -n logging
kubectl -n logging get pods --selector='elasticsearch.k8s.elastic.co/cluster-name=elastic'
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/c45cff2f55ec44cb25db5895442d440a.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;3-获取elasticsearch凭据&quot;&gt;3. 获取elasticsearch凭据&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl -n logging get secret elastic-es-elastic-user -o=jsonpath='{.data.elastic}' | base64 --decode; echo
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/6dd84901a8bb30e26251b11e21a256a6.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;4-直接安装kibana了&quot;&gt;4. 直接安装kibana了&lt;/h2&gt;

修改了时区，和elasticsearch镜像一样都修改到了东八区，并将语言设置成了中文，关于selfSignedCertificate原因参照&lt;a href=&quot;https://www.elastic.co/guide/en/cloud-on-k8s/1.4/k8s-kibana-http-configuration.html&quot;&gt;https://www.elastic.co/guide/en/cloud-on-k8s/1.4/k8s-kibana-http-configuration.html&lt;/a&gt;。

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt; kibana.yaml
apiVersion: kibana.k8s.elastic.co/v1
kind: Kibana
metadata:
  name: elastic
  namespace: logging
spec:
  version: 7.13.3
  image: docker.elastic.co/kibana/kibana:7.13.3
  count: 1
  elasticsearchRef:
    name: elastic
  http:
    tls:
      selfSignedCertificate:
        disabled: true
  podTemplate:
    spec:
      containers:
      - name: kibana
        env:
        - name: I18N_LOCALE
          value: zh-CN
        resources:
          requests:
            memory: 1Gi
          limits:
            memory: 2Gi
        volumeMounts:
        - name: timezone-volume
          mountPath: /etc/localtime
          readOnly: true
      volumes:
      - name: timezone-volume
        hostPath:
          path: /usr/share/zoneinfo/Asia/Shanghai
EOF          
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/a5a843df4deb7b7f5b78abe748916f34.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-16/bcd921748f21f913d3a550185689e9ba.png&quot; alt=&quot;image.png&quot; /&gt;

注意： 嗯 kibana一直没有起来 发现我打elasticsearch镜像的时候忘了改elasticsearch的基础镜像，还是用了7.12好吧 修改一下。一定强调一下版本的一致性（镜像哪里我修改了，怕小伙伴跟我重新做一次，这里就强调一下）

重新部署更是刺激 看tke后台有重新部署选项：

&lt;img src=&quot;/assets/images/2021/07-16/864e9b051893e122f376220b2d819eed.png&quot; alt=&quot;image.png&quot; /&gt;

但是貌似没有生效还是老老实实的吧

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;imagePullPolicy: Always
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-16/4c46ed73a64cf824ca02652c07b455a0.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;5-对外映射kibana-服务&quot;&gt;5. 对外映射kibana 服务&lt;/h2&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF&amp;gt; kibana-ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: kibana-http
  namespace: logging
  annotations:
    kubernetes.io/ingress.class: traefik  
    traefik.ingress.kubernetes.io/router.entrypoints: web
spec:
  rules:
  - host: kibana.layabox.com
    http:
      paths:
      - pathType: Prefix
        path: /
        backend:
          service:
            name: elastic-kb-http
            port:
              number: 5601
EOF
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
</description>
        <pubDate>Fri, 16 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/16/TKE1.20.6%E6%90%AD%E5%BB%BAelasticsearch-on-kubernetes/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/16/TKE1.20.6%E6%90%AD%E5%BB%BAelasticsearch-on-kubernetes/</guid>
        
        <category>kubernetes</category>
        
        <category>elastic</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-15-Kubernets traefik代理ws wss应用</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#部署与分析过程&quot; id=&quot;markdown-toc-部署与分析过程&quot;&gt;部署与分析过程：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-关于我的应用&quot; id=&quot;markdown-toc-1-关于我的应用&quot;&gt;1. 关于我的应用：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-关于ws和http&quot; id=&quot;markdown-toc-2-关于ws和http&quot;&gt;2. 关于ws和http:&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-排查下是谁的锅&quot; id=&quot;markdown-toc-3-排查下是谁的锅&quot;&gt;3. 排查下是谁的锅&lt;/a&gt;        &lt;ul&gt;
          &lt;li&gt;&lt;a href=&quot;#1-搭建一个简单的ws应用&quot; id=&quot;markdown-toc-1-搭建一个简单的ws应用&quot;&gt;1. 搭建一个简单的ws应用&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#2内部wscat测试ws服务是否联通&quot; id=&quot;markdown-toc-2内部wscat测试ws服务是否联通&quot;&gt;2.内部wscat测试ws服务是否联通&lt;/a&gt;&lt;/li&gt;
          &lt;li&gt;&lt;a href=&quot;#3traefik对外代理ws应用并测试&quot; id=&quot;markdown-toc-3traefik对外代理ws应用并测试&quot;&gt;3.traefik对外代理ws应用并测试&lt;/a&gt;            &lt;ul&gt;
              &lt;li&gt;&lt;a href=&quot;#1-ingressroute方式&quot; id=&quot;markdown-toc-1-ingressroute方式&quot;&gt;1. ingressroute方式&lt;/a&gt;&lt;/li&gt;
              &lt;li&gt;&lt;a href=&quot;#2-ingress方式&quot; id=&quot;markdown-toc-2-ingress方式&quot;&gt;2. ingress方式&lt;/a&gt;&lt;/li&gt;
            &lt;/ul&gt;
          &lt;/li&gt;
        &lt;/ul&gt;
      &lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#关于其他&quot; id=&quot;markdown-toc-关于其他&quot;&gt;关于其他：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-ingressroute&quot; id=&quot;markdown-toc-1-ingressroute&quot;&gt;1. ingressroute：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-ingress&quot; id=&quot;markdown-toc-2-ingress&quot;&gt;2. ingress&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

团队要发布一组应用，springboot开发的ws应用。然后需要对外。支持ws wss协议。jenkins写完pipeline发布任务。记得过去没有上容器的时候都是用的腾讯云的&lt;a href=&quot;https://console.cloud.tencent.com/clb/&quot;&gt;cls&lt;/a&gt; 挂证书映射&lt;a href=&quot;https://console.cloud.tencent.com/cvm&quot;&gt;cvm&lt;/a&gt;端口。我现在的网络环境是这样的：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/odflm7&quot;&gt;Kubernetes 1.20.5 安装traefik在腾讯云下的实践&lt;/a&gt;（当然了本次的环境是跑在tke1.20.6上面的，都是按照上面实例搭建的—除了我新建了一个namespace traefik，并将traefik应用都安装在了这个命名空间内！这样做的原因是tke的kebe-system下的pod太多了！我有强迫症）

&lt;h1 id=&quot;部署与分析过程&quot;&gt;部署与分析过程：&lt;/h1&gt;

&lt;h2 id=&quot;1-关于我的应用&quot;&gt;1. 关于我的应用：&lt;/h2&gt;

应用的部署方式是statefulset，如下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt;  xxx-gateway.yaml
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: xxx-gateway
spec:
  serviceName: xxx-gateway
  replicas: 1
  selector:
    matchLabels:
      app: xxx-gateway
  template:
    metadata:
      labels:
        app: xxx-gateway
    spec:
      containers:
        - name: xxx-gateway
          image: ccr.ccs.tencentyun.com/xxx-master/xxx-gateway:202107151002
          env:
          - name: SPRING_PROFILES_ACTIVE
            value: &quot;official&quot;
          - name: SPRING_APPLICATION_JSON
            valueFrom:
             configMapKeyRef:
              name: spring-config
              key: dev-config.json
          ports:
            - containerPort: 8443
          resources:
            requests:
              memory: &quot;512M&quot;
              cpu: &quot;500m&quot;
            limits:
              memory: &quot;512M&quot;
              cpu: &quot;500m&quot; 
      imagePullSecrets:                                              
        - name: tencent
---

apiVersion: v1
kind: Service
metadata:
  name: xxx-gateway
  labels:
    app: xxx-gateway
spec:
  ports:
  - port: 8443
  selector:
    app: xxx-gateway
  clusterIP: None
EOF
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl apply -f xxx-gateway.yaml -n official
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

偷个懒直接copy了一个其他应用的 ingress yaml修改了一下,如下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt;  gateway-0-ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: layaverse-gateway-0-http
  namespace: official
  annotations:
    kubernetes.io/ingress.class: traefik  
    traefik.ingress.kubernetes.io/router.entrypoints: web
spec:
  rules:
  - host: xxx-gateway-0.xxx.com
    http:
      paths:
      - pathType: Prefix
        path: /
        backend:
          service:
            name: xxx-gateway 
            port: 
              number: 8443
EOF
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

部署ingress

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl apply -f gateway-0-ingress.yaml
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

查看ingress部署状况

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get ingress -n official
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/4e660ad277a713b30bec342b45049019.png&quot; alt=&quot;image.png&quot; /&gt;

嗯 然后测试一下wss（wss我直接用443端口了。证书挂载slb层的–这是我理解的!具体的参照我traefik的配置）,这里强调一下wscat这个工具。反正看了下我们的后端小伙伴测试ws应用都是用的在线的ws工具:

&lt;img src=&quot;/assets/images/2021/07-15/5c39afc4bd22cf7c9d3232ff7fb77e7b.png&quot; alt=&quot;image.png&quot; /&gt;

就这样的。然后正巧看到wscat就安装了一下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;sudo apt install npm
sudo npm install -g wscat 
wscat -c wss://xxx-gateway-0.xxx.com:443/ws
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/e0c42a73f9ffbe1ced5d9e7275531379.png&quot; alt=&quot;image.png&quot; /&gt;

嗯哼 基本上可以确认是应用对外成功了？

&lt;hr /&gt;

当然了以上只是我顺利的假想！

实际上是代理后连接后端的ws服务依然有各种问题（开始我怀疑是traefik的问题），还是连不上！我粗暴的把xxx-gateway 的暴露方式修改为NodePort  然后挂载到了slb层（在scl直接添加了ssl证书），测试了一下是可以的就直接用了。先让应用跑起来，然后再研究一下怎么处理。

&lt;h2 id=&quot;2-关于ws和http&quot;&gt;2. 关于ws和http:&lt;/h2&gt;

先不去管那么多，先整明白实现我的traefik如何实现代理ws呢？

&lt;img src=&quot;/assets/images/2021/07-15/c08554861298e648dab2dbc9b2dcd3f8.png&quot; alt=&quot;image.png&quot; /&gt;

图中内容摘自：&lt;a href=&quot;https://blog.csdn.net/fmm_sunshine/article/details/77918477&quot;&gt;https://blog.csdn.net/fmm_sunshine/article/details/77918477&lt;/a&gt;

&lt;hr /&gt;

&lt;h2 id=&quot;3-排查下是谁的锅&quot;&gt;3. 排查下是谁的锅&lt;/h2&gt;

&lt;h3 id=&quot;1-搭建一个简单的ws应用&quot;&gt;1. 搭建一个简单的ws应用&lt;/h3&gt;

后端的代码既然搞不懂，那我就找一个简单的ws的服务然后用traefik代理测试一下！

dockerhub搜得一个nodejs 的websocket镜像：&lt;a href=&quot;https://hub.docker.com/r/ksdn117/web-socket-test&quot;&gt;https://hub.docker.com/r/ksdn117/web-socket-test&lt;/a&gt;

部署一下：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt;  web-socket-test.yaml
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: web-socket-test
spec:
  serviceName: web-socket-test
  replicas: 1
  selector:
    matchLabels:
      app: web-socket-test
  template:
    metadata:
      labels:
        app: web-socket-test
    spec:
      containers:
        - name: web-socket-test
          image: ksdn117/web-socket-test
          ports:
            - containerPort: 8010
              name: web
            - containerPort: 8443
              name: ssl
          resources:
            requests:
              memory: &quot;512M&quot;
              cpu: &quot;500m&quot;
            limits:
              memory: &quot;512M&quot;
              cpu: &quot;500m&quot;
---

apiVersion: v1
kind: Service
metadata:
  name: web-socket-test
  labels:
    app: web-socket-test
spec:
  type: NodePort
  ports:
  - port: 8010
    targetPort: 8010
    protocol: TCP
    name: web
  - port: 8443
    targetPort: 8443
    name: ssl
    protocol: TCP
  selector:
    app: web-socket-test
EOF
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

注： 我这里的配置文件加了type:NodePort

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl  apply -f web-socket-test.yaml
kubectl get pods 
kubectl get svc 
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/57e6b37232ad08b2e3cdeab97b8d1b66.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;2内部wscat测试ws服务是否联通&quot;&gt;2.内部wscat测试ws服务是否联通&lt;/h3&gt;

先内部连接container pod ip测试一下服务：

&lt;img src=&quot;/assets/images/2021/07-15/ffb0ecf581bda317a8a6fdf4fabe6f98.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;wscat --connect ws://172.22.0.230:8010
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl logs -f web-socket-test-0
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/f6793fbfc8be215e87f5251bac09d2e5.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h3 id=&quot;3traefik对外代理ws应用并测试&quot;&gt;3.traefik对外代理ws应用并测试&lt;/h3&gt;

traefik正常的对外暴露服务可以用ingress的方式还有ingressroute我都去尝试一下：

&lt;h4 id=&quot;1-ingressroute方式&quot;&gt;1. ingressroute方式&lt;/h4&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt;  web-socket-ingressroute.yaml
apiVersion: traefik.containo.us/v1alpha1
kind: IngressRoute
metadata:
  name: web-socket-test-http
  namespaces: default
spec:
  entryPoints:
  - web
  routes:
  - match: Host(`web-socket-test.xxx.com`)
    kind: Rule
    services:
      - name: web-socket-test
        port: 8010
 EOF
 kubectl apply -f web-socket-ingressroute.yaml
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/f43e6ceffc048347ef4a8dabe1b51ec3.png&quot; alt=&quot;image.png&quot; /&gt;

wscat连接测试一下:

&lt;img src=&quot;/assets/images/2021/07-15/3d4f0073f95d757596df5860caff97c1.png&quot; alt=&quot;image.png&quot; /&gt;

这样测来是没有问题的？

删除ingress

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt; kubectl delete -f web-socket-ingressroute.yaml
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;h4 id=&quot;2-ingress方式&quot;&gt;2. ingress方式&lt;/h4&gt;

整一下ingress的方式：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;cat &amp;lt;&amp;lt;EOF &amp;gt;  web-socket-ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: web-socket-test
  namespace: default
  annotations:
    kubernetes.io/ingress.class: traefik  
    traefik.ingress.kubernetes.io/router.entrypoints: web
spec:
  rules:
  - host: web-socket-test.layame.com
    http:
      paths:
      - pathType: Prefix
        path: /
        backend:
          service:
            name: web-socket-test 
            port: 
              number: 8010
 EOF
 kubectl apply -f web-socket-ingress.yaml
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/95e4cfbe239509f180edc5c48a6c1606.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;wscat --connect wss://web-socket-test.xxx.com:443
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-15/e0398e2fcca9cdd4e8933447a42f7235.png&quot; alt=&quot;image.png&quot; /&gt;

甩锅基本完成起码不是我的基础设施应的问题…..让后端小伙伴测试一下看下是哪里有问题了。从我代理层来说是没有问题的！

&lt;h1 id=&quot;关于其他&quot;&gt;关于其他：&lt;/h1&gt;

当然了看一些博客还有要加&lt;strong&gt;passHostHeader: true&lt;/strong&gt;的配置的

&lt;h2 id=&quot;1-ingressroute&quot;&gt;1. ingressroute：&lt;/h2&gt;

&lt;img src=&quot;/assets/images/2021/07-15/c47fcce97a3a0cbb1af992978166b372.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;2-ingress&quot;&gt;2. ingress&lt;/h2&gt;
&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;ingress:traefik.ingress.kubernetes.io/service.passhostheader: &quot;true&quot;
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;
​

&lt;img src=&quot;/assets/images/2021/07-15/c47fcce97a3a0cbb1af992978166b372.png&quot; alt=&quot;image.png&quot; /&gt;

如果有问题 可以尝试一下上面的方式！
</description>
        <pubDate>Thu, 15 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/15/Kubernets-traefik%E4%BB%A3%E7%90%86ws-wss%E5%BA%94%E7%94%A8/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/15/Kubernets-traefik%E4%BB%A3%E7%90%86ws-wss%E5%BA%94%E7%94%A8/</guid>
        
        <category>kubernetes</category>
        
        <category>traefik</category>
        
        <category>ws</category>
        
        <category>wss</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-09-TKE1.20.6初探</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#创建tke1206集群&quot; id=&quot;markdown-toc-创建tke1206集群&quot;&gt;创建tke1.20.6集群&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-创建集群&quot; id=&quot;markdown-toc-1-创建集群&quot;&gt;1. 创建集群&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-节点命名个性化&quot; id=&quot;markdown-toc-2-节点命名个性化&quot;&gt;2. 节点命名个性化&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-安全组的报错&quot; id=&quot;markdown-toc-3-安全组的报错&quot;&gt;3. 安全组的报错&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#4-添加work节点&quot; id=&quot;markdown-toc-4-添加work节点&quot;&gt;4. 添加work节点&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#5-安装几个插件&quot; id=&quot;markdown-toc-5-安装几个插件&quot;&gt;5. 安装几个插件：&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#谈一下体验感受&quot; id=&quot;markdown-toc-谈一下体验感受&quot;&gt;谈一下体验感受：&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

前几天刚刚测试了一把tke1.18.4：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/dgic6s&quot;&gt;腾讯云TKE1.18初体验 &lt;/a&gt;，今天一看后台有了1.20.6的版本了。满怀欣喜的想升级一下tke集群的。但是仔细一看不支持升级。问了一下tke的小伙伴，要下个月才能支持版本升级。这点让人体验狠不好。新版本发出了。老版本缺不能升级？让老用户感觉到很是被抛弃的感觉。不知道其他用户是怎么感觉的，反正我是有这样感觉的。闲话少说，搭建一个新的tke1.20.6的版本体验下有那些不同吧！

&lt;h1 id=&quot;创建tke1206集群&quot;&gt;创建tke1.20.6集群&lt;/h1&gt;

&lt;h2 id=&quot;1-创建集群&quot;&gt;1. 创建集群&lt;/h2&gt;

依旧同1.18.4一样，当然了还是特别强调下容器的网络CIDR一定不要与其他集群或者vpc网络重合，当然了 vpc-cni有时间我也想体验一下

&lt;img src=&quot;/assets/images/2021/07-09/e1893efbc3c66c3efa0e569d0cb9624c.png&quot; alt=&quot;image.png&quot; /&gt;

系统依然选择了ubuntu1.18.4，高级设置kube-proxy选择了ipvs的代理方式

&lt;img src=&quot;/assets/images/2021/07-09/06c7e983b61cc53027f644467fc5247f.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;2-节点命名个性化&quot;&gt;2. 节点命名个性化&lt;/h2&gt;

下一步选择master 节点我选择了现有的三台服务器，work节点没有先加入选择了暂时不添加

服务器的配置发现了一个新鲜的不一样，不知道是过去就有没有注意还是新添加的了，竟然可以自定义主机名了？过去的tke集群都是以ip方式显示的看着很不喜欢

&lt;img src=&quot;/assets/images/2021/07-09/8ea4422b544cc55bb28a286c1d0a4140.png&quot; alt=&quot;image.png&quot; /&gt;

参照文档：&lt;a href=&quot;https://cloud.tencent.com/document/product/457/32189&quot;&gt;https://cloud.tencent.com/document/product/457/32189&lt;/a&gt;，主机名竟然可以自定义了？很是开心

&lt;img src=&quot;/assets/images/2021/07-09/f8c640dfe36a24b25f1cd734c0c2044a.png&quot; alt=&quot;image.png&quot; /&gt;

我将主机名自定义为ap-shanghai-k8s-master-{R:01}（其实我想要个0开头的 01  02  03这样的）

&lt;h2 id=&quot;3-安全组的报错&quot;&gt;3. 安全组的报错&lt;/h2&gt;

组件配置我就没有选择貌似就只有默认的cbs组件了，然后点完成的时候就出现了下面的报错：

&lt;img src=&quot;/assets/images/2021/07-09/d40a14f946ce10dbd3bc58a5955703a6.png&quot; alt=&quot;image.png&quot; /&gt;

security group quota exceeded 怀疑是安全组的问题，我就把3台master &amp;amp;etcd的节点加入到了tke1.18的集群（其实这样也不完整，仔细看了一眼那个安全组是172.19.0.0/16的放行，我这个cidr应该是172.22.0.0/16）。依然不行….为了下tke的小伙伴：嗯 我的安全组满了，看了一眼我的安全组规则有70条，貌似满了？不管了先删掉了几条无用的安全组。重新点完成 OK了。发现原来tke是自己会创建安全组的！

等待master初始化完成如下：

&lt;img src=&quot;/assets/images/2021/07-09/887f7571e347354ceb5911916a433011.png&quot; alt=&quot;image.png&quot; /&gt;

看着舒服多了总算不是再以ip为命名规则了！。但是我还是想加01  02的命名规则哎，怎可以搞一下呢？

&lt;h2 id=&quot;4-添加work节点&quot;&gt;4. 添加work节点&lt;/h2&gt;

再加入三台work工作节点：

&lt;img src=&quot;/assets/images/2021/07-09/bfeef34e0c9ca712abd9185817db458e.png&quot; alt=&quot;image.png&quot; /&gt;

也修改了一下主机名自定义了一下：ap-shanghai-k8s-node-{R:01}.等待完成

&lt;img src=&quot;/assets/images/2021/07-09/f8b2b92531f571143372ccfc377b1e84.png&quot; alt=&quot;image.png&quot; /&gt;

舒服多了 master的总算可以在前了看着舒服多了

&lt;img src=&quot;/assets/images/2021/07-09/23b86be90b2becef856e80fea024021c.png&quot; alt=&quot;image.png&quot; /&gt;

看了一眼这初始服务可真多啊，有点烦……

&lt;h2 id=&quot;5-安装几个插件&quot;&gt;5. 安装几个插件：&lt;/h2&gt;

这两个貌似是2选一的，关键插件安装都只能同时安装一个

&lt;img src=&quot;/assets/images/2021/07-09/3f3f3bc8d6618237c381d929087e6541.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-09/ab5f5b121e33d1025debe35a29b0a885.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-09/cb727172646aaec6b12887cc67541768.png&quot; alt=&quot;image.png&quot; /&gt;

最终安装了如下：

&lt;img src=&quot;/assets/images/2021/07-09/3b21796a4b1af7a0eb0fa933eb8a8b4b.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h1 id=&quot;谈一下体验感受&quot;&gt;谈一下体验感受：&lt;/h1&gt;

&lt;ol&gt;
  &lt;li&gt;节点名称可以自定义了对tke的用户体验来说是一个进步。当然了还有我想命名方式为01  02  03的这种命名方式可不可以支持呢？我就想占位。&lt;/li&gt;
  &lt;li&gt;tke与腾讯云其他产品间的结合还是不流畅，如我碰到的安全组问题。可不可以在用户创建集群过程中让用户看到安全组的配置？让我自动或者选择自动生成？让用户知道有那么一个步骤呢？&lt;/li&gt;
  &lt;li&gt;插件的安装也很诡异：为什么我不能同时进行多个任务？我想同时安装多个插件。每次点一个确认等待。来回切页面很是麻烦。&lt;/li&gt;
  &lt;li&gt;当然了最让老用户失望的是你开通了1.20.6版本。为什么不同时上线1.18.4版本的升级呢？这对老用户是一种冷落，对于我来说这是最不满意的地方。希望能将更新版本和发布新版本同时上线。用户可以选择不更新，但是可以更新是对老用户的重视。&lt;/li&gt;
  &lt;li&gt;当然了 还有我从1.18开始就关心的：独立部署集群master节点的添加删除功能。&lt;/li&gt;
  &lt;li&gt;准备迁移一下elastic on kubernetes集群跑一下看看。当然了还有其他服务。（但是这个版本升级滞后于新版本发布，还有master节点增加删除不让我自己能控制，让我还是不想迁移）&lt;/li&gt;
&lt;/ol&gt;
</description>
        <pubDate>Fri, 09 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/09/TKE1.20.6%E5%88%9D%E6%8E%A2/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/09/TKE1.20.6%E5%88%9D%E6%8E%A2/</guid>
        
        <category>kubernetes</category>
        
        <category>TKE</category>
        
        <category>腾讯云</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-08-关于centos8+kubeadm1.20.5+cilium+hubble的安装过程中cilium的配置问题--特别强调</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#复盘解决问题&quot; id=&quot;markdown-toc-复盘解决问题&quot;&gt;复盘解决问题&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-确认问题&quot; id=&quot;markdown-toc-1-确认问题&quot;&gt;1. 确认问题&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-阅读官方文档&quot; id=&quot;markdown-toc-2-阅读官方文档&quot;&gt;2. 阅读官方文档&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3找一个正确的参考&quot; id=&quot;markdown-toc-3找一个正确的参考&quot;&gt;3.找一个正确的参考&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

参见前文：&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/dkwh3p&quot;&gt;centos8+kubeadm1.20.5+cilium+hubble环境搭建&lt;/a&gt;，并升级到了1.21版本（&lt;a href=&quot;https://www.yuque.com/duiniwukenaihe/ehb02i/palbae&quot;&gt;Kubernetes 1.20.5 upgrade 1.21.0&lt;/a&gt;）。今天无聊查看一下集群呢突然发现一个问题：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[root@sh-master-01 ~]# kubectl get pods -n default -o wide
NAME                          READY   STATUS             RESTARTS   AGE    IP           NODE         
csi-app                       1/1     Running            11         106d   10.0.4.204   sh-work-01  
nginx                         1/1     Running            0          13d    10.0.4.60    sh-work-01  
nginx-1-kkfvd                 1/1     Running            0          13d    10.0.5.223   sh-work-02  
nginx-1-klgpx                 1/1     Running            0          13d    10.0.4.163   sh-work-01  
nginx-1-s5mzp                 1/1     Running            0          13d    10.0.3.208   sh-work-03   
nginx-2-8cb2j                 1/1     Running            0          13d    10.0.3.218   sh-work-03  
nginx-2-l527j                 1/1     Running            0          13d    10.0.5.245   sh-work-02   
nginx-2-qnsrq                 1/1     Running            0          13d    10.0.4.77    sh-work-01  
php-apache-5b95f8f674-clzn5   1/1     Running            2          99d    10.0.3.64    sh-work-03
pod-flag                      1/1     Running            316        13d    10.0.5.252   sh-work-02 
pod-nodeaffinity              1/1     Running            0          13d    10.0.4.118   sh-work-01
pod-prefer                    1/1     Running            0          13d    10.0.5.181   sh-work-02
pod-prefer1                   1/1     Running            0          13d    10.0.3.54    sh-work-03
with-node-affinity            0/1     ImagePullBackOff   0          13d    10.0.4.126   sh-work-01
with-pod-affinity             0/1     ImagePullBackOff   0          13d    10.0.5.30    sh-work-02
with-pod-antiaffinity         1/1     Running            0          13d    10.0.4.159   sh-work-01
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

主要是看ip一栏，这.，我记得我的 serviceSubnet: 172.254.0.0/16 , podSubnet: 172.3.0.0/16啊 是不是哪里搞错了了呢？

&lt;img src=&quot;/assets/images/2021/07-08/tjseoz2575.png&quot; alt=&quot;image.png&quot; /&gt;

再看一眼service的网络状况：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;[root@sh-master-01 ~]# kubectl get svc -n default -o wide
NAME         TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)   AGE    SELECTOR
kubernetes   ClusterIP   172.254.0.1      &amp;lt;none&amp;gt;        443/TCP   106d   &amp;lt;none&amp;gt;
php-apache   ClusterIP   172.254.13.205   &amp;lt;none&amp;gt;        80/TCP    99d    run=php-apache
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

这个ip段是对的呢！怎么会事情呢？

&lt;h1 id=&quot;复盘解决问题&quot;&gt;复盘解决问题&lt;/h1&gt;

&lt;h2 id=&quot;1-确认问题&quot;&gt;1. 确认问题&lt;/h2&gt;

cilium是oprator的方式安装的，找到oprator的pod:

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get pods -n kube-system -o wide
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-08/gbm60vy15x.png&quot; alt=&quot;image.png&quot; /&gt;

查看日志输出：

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl logs -f cilium-operator-f595b8f7d-7rvzz  -n kube-system
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

貌似找到了 下面箭头指向的这一段ipv4CIDRs是 10.0.0.0/8!

&lt;img src=&quot;/assets/images/2021/07-08/twrbjv2mco.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;2-阅读官方文档&quot;&gt;2. 阅读官方文档&lt;/h2&gt;

搭建集群我是参考的肥宅爽文的博客：&lt;a href=&quot;https://www.yuque.com/xiaowei-trt7k/tw/ah0ls0#SMT45&quot;&gt;02-02.kubeadm + Cilium 搭建kubernetes集群&lt;/a&gt;。博客上面写的比较完整的cilium搭建集群的貌似我俩写的了：&lt;a href=&quot;https://segmentfault.com/a/1190000040299919&quot;&gt;centos8+kubeadm1.20.5+cilium+hubble环境搭建&lt;/a&gt;。初步怀疑就是helm安装cilium的时候配置网络组件并没有走config.yaml中的配置。仔细看了一眼官方github仓库文件配置项：&lt;a href=&quot;https://github.com/cilium/cilium/tree/v1.10.2/install/kubernetes/cilium&quot;&gt;https://github.com/cilium/cilium/tree/v1.10.2/install/kubernetes/cilium&lt;/a&gt;。

&lt;img src=&quot;/assets/images/2021/07-08/n8noq98oh6.png&quot; alt=&quot;image.png&quot; /&gt;

注：我的版本是1.9.7，正常的找自己对应版本的配置文件看呢。差距不大我就没有去切换分支看了…

对照官方文档：在helm安装的时候没有指定ipam.operator.clusterPoolIPv4PodCIDR参数！网上的很多文章也都是草草来的，并没有详细的对ipv4的cidr进行指定那pod网络都是默认的10.0.0.0/8的cidr!我的&lt;a href=&quot;https://console.cloud.tencent.com/cvm/instance/index?rid=4&quot;&gt;cvm&lt;/a&gt; &lt;a href=&quot;https://console.cloud.tencent.com/vpc/vpc?rid=4&quot;&gt;vpc&lt;/a&gt;网络默认是10.0.0.0/8的大网络，这样下来ip地址应该是会有冲突的！

&lt;h2 id=&quot;3找一个正确的参考&quot;&gt;3.找一个正确的参考&lt;/h2&gt;

谷歌搜索文档搜到亚马逊的一篇blog:&lt;a href=&quot;https://aws.amazon.com/cn/blogs/containers/a-multi-cluster-shared-services-architecture-with-amazon-eks-using-cilium-clustermesh/&quot;&gt;https://aws.amazon.com/cn/blogs/containers/a-multi-cluster-shared-services-architecture-with-amazon-eks-using-cilium-clustermesh/&lt;/a&gt;

亚马逊的blog还是很好的。安装的过程很是详细可以参考一下：

&lt;img src=&quot;/assets/images/2021/07-08/unq2iqayvc.png&quot; alt=&quot;image.png&quot; /&gt;

至于我的集群只能upgrade了…

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt; helm upgrade cilium cilium/cilium --version 1.9.7   --namespace=kube-system --set ipam.operator.clusterPoolIPv4PodCIDR=&quot;172.3.0.0/16&quot;
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

目测应该是这样的特别强调一下，抄别人安装的时候还是要去看一下官方文档的详细参数定义！国内能搜到的这些cilium的 都大部分没有写podCIDR的配置的吧？参考别人博客的同时一定记得再仔细去看下官方文档参数！
</description>
        <pubDate>Thu, 08 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/08/%E5%85%B3%E4%BA%8Ecentos8+kubeadm1.20.5+cilium+hubble%E7%9A%84%E5%AE%89%E8%A3%85%E8%BF%87%E7%A8%8B%E4%B8%ADcilium%E7%9A%84%E9%85%8D%E7%BD%AE%E9%97%AE%E9%A2%98-%E7%89%B9%E5%88%AB%E5%BC%BA%E8%B0%83/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/08/%E5%85%B3%E4%BA%8Ecentos8+kubeadm1.20.5+cilium+hubble%E7%9A%84%E5%AE%89%E8%A3%85%E8%BF%87%E7%A8%8B%E4%B8%ADcilium%E7%9A%84%E9%85%8D%E7%BD%AE%E9%97%AE%E9%A2%98-%E7%89%B9%E5%88%AB%E5%BC%BA%E8%B0%83/</guid>
        
        <category>kubernetes</category>
        
        <category>kubeadm</category>
        
        <category>cilium</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
      <item>
        <title>2021-07-02-腾讯云TKE1.18初体验</title>
        <description>&lt;ul id=&quot;markdown-toc&quot;&gt;
  &lt;li&gt;&lt;a href=&quot;#背景&quot; id=&quot;markdown-toc-背景&quot;&gt;背景：&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#tke开通体验&quot; id=&quot;markdown-toc-tke开通体验&quot;&gt;tke开通体验：&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-打开管理控制台&quot; id=&quot;markdown-toc-1-打开管理控制台&quot;&gt;1. 打开管理控制台：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-新建集群&quot; id=&quot;markdown-toc-2-新建集群&quot;&gt;2. 新建集群&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-特别强调说一下容器的网络&quot; id=&quot;markdown-toc-3-特别强调说一下容器的网络&quot;&gt;3. 特别强调说一下容器的网络：&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#4-操作系统与proxy选型&quot; id=&quot;markdown-toc-4-操作系统与proxy选型&quot;&gt;4. 操作系统与proxy选型&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#5-新建或者将已有资源加入master-work节点&quot; id=&quot;markdown-toc-5-新建或者将已有资源加入master-work节点&quot;&gt;5. 新建或者将已有资源加入master work节点&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#6-添加增强的组件&quot; id=&quot;markdown-toc-6-添加增强的组件&quot;&gt;6. 添加增强的组件&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#tke使用体验&quot; id=&quot;markdown-toc-tke使用体验&quot;&gt;tke使用体验&lt;/a&gt;    &lt;ul&gt;
      &lt;li&gt;&lt;a href=&quot;#1-特别不爽的一点-kuberctl-get-node的排序&quot; id=&quot;markdown-toc-1-特别不爽的一点-kuberctl-get-node的排序&quot;&gt;1. 特别不爽的一点 kuberctl get node的排序&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#2-csi-cbs-controller插件的异常&quot; id=&quot;markdown-toc-2-csi-cbs-controller插件的异常&quot;&gt;2. csi-cbs-controller插件的异常&lt;/a&gt;&lt;/li&gt;
      &lt;li&gt;&lt;a href=&quot;#3-应用市场-prometheus-opraoter的错误&quot; id=&quot;markdown-toc-3-应用市场-prometheus-opraoter的错误&quot;&gt;3. 应用市场 prometheus-opraoter的错误&lt;/a&gt;&lt;/li&gt;
    &lt;/ul&gt;
  &lt;/li&gt;
  &lt;li&gt;&lt;a href=&quot;#后记&quot; id=&quot;markdown-toc-后记&quot;&gt;后记：&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;h1 id=&quot;背景&quot;&gt;背景：&lt;/h1&gt;

作为腾讯云的老用户我大概是2018年开始使用腾讯云的tke服务的。当时是1.10，现在线上还有一个tke1.12的集群，鉴于早期更新迭代较慢。我选择了在腾讯云上面kubeadm的方式自建kubernetes集群的方式。参见：&lt;a href=&quot;https://duiniwukenaihe.github.io/2019/09/02/k8s-install/&quot;&gt;https://duiniwukenaihe.github.io/2019/09/02/k8s-install/&lt;/a&gt;。后面持续升级，现在是1.17.17版本。最近看腾讯云云原生公众号更新的内容都比较多，并且tke的版本到了1.18我选择了尝试一下tke的服务！

注：昨天开通搭建没有截图….今天就将就一下模拟演示吧！

&lt;h1 id=&quot;tke开通体验&quot;&gt;tke开通体验：&lt;/h1&gt;

注：我之前开通过tke服务注册账号，服务授权就忽略了！，关于这部分的内容可以参照官方文档：&lt;a href=&quot;https://cloud.tencent.com/document/product/457/54231&quot;&gt;https://cloud.tencent.com/document/product/457/54231&lt;/a&gt;

&lt;h2 id=&quot;1-打开管理控制台&quot;&gt;1. 打开管理控制台：&lt;/h2&gt;

&lt;a href=&quot;https://console.cloud.tencent.com/tke2/cluster?rid=4&quot;&gt;https://console.cloud.tencent.com/tke2/cluster?rid=4&lt;/a&gt;

&lt;img src=&quot;/assets/images/2021/07-02/0ew1t2mbph.png&quot; alt=&quot;image.png&quot; /&gt;

名为k8s的集群为老的集群。k8s-shanghai为昨天新建的tke1.18的新的集群。由于集群已经创建了。现在就只是截图重复一遍步骤，不去做新集群的开通了！

&lt;h2 id=&quot;2-新建集群&quot;&gt;2. 新建集群&lt;/h2&gt;

设置集群的名称，新增资源所属的项目，我这里就都是默认了。选择kubernetes的版本。当前最新版本是1.18.4。至于runtime运行时组件。我是直接用了containerd了。当然了docker也还算可以的在1.18的版本。地域我的服务器资源都部署在上海。然后选择集群的网络环境。容器网络的组件使用了默认的Global Router，VPC-CNI对于我来说还没有这样的需求

&lt;img src=&quot;/assets/images/2021/07-02/c3i1n7338k.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;3-特别强调说一下容器的网络&quot;&gt;3. 特别强调说一下容器的网络：&lt;/h2&gt;

我的cvm网络CIDR是10.0.0.0/16的网络。容器的网络是要跟集群网络分开的正常来说选择192.168或者 172.X.0.0.0/16。当然了也可以可变长子网掩码。自己玩的不是太好还是按照提示老老实实的了默认的提示X是

16，18，….，31。16用过了,18貌似也用了 我就选择了19。故容器网络的CIDR是172.19.0.0/16.节点的pod分配方式也可以满足我的要求！

&lt;img src=&quot;/assets/images/2021/07-02/z3pfv77n3u.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h2 id=&quot;4-操作系统与proxy选型&quot;&gt;4. 操作系统与proxy选型&lt;/h2&gt;

操作系统我都选择了ubuntu18.04。嗯也可以用腾讯云的tencent linux 或者centos.kube-proxy代理方式我选择了ipvs。当然了对应我们这样业务的量级两个proxy代理的方式差距并不是太大，也没有孰好孰坏一说，看自己需求了！

&lt;h2 id=&quot;5-新建或者将已有资源加入master-work节点&quot;&gt;5. 新建或者将已有资源加入master work节点&lt;/h2&gt;

&lt;img src=&quot;/assets/images/2021/07-02/q2c2c191na.png&quot; alt=&quot;image.png&quot; /&gt;

服务器的配置这里我是使用了已有的节点资源，master独立部署的方式。直接把我资源池中的cvm资源分配给了master和work。其中master节点是4核8G内存配置，work节点是16核心36G内存配置。

&lt;h2 id=&quot;6-添加增强的组件&quot;&gt;6. 添加增强的组件&lt;/h2&gt;

至于组件配置就看个人需求了。这边不方便截图了。我就在搭建完成的集群中理一下我随手安装的几个组件：

&lt;img src=&quot;/assets/images/2021/07-02/wpxbtum1mx.png&quot; alt=&quot;image.png&quot; /&gt;

cbs  cfs cos 存储组件是不可缺少的对我来说。

&lt;img src=&quot;/assets/images/2021/07-02/6n25aps7t8.png&quot; alt=&quot;image.png&quot; /&gt;

NodeProblemDetectorPlus  OOMGuard看着很有用， 我也就安装上了。

NodeProblemDetectorPlus参数设置我应该设置了一个异常重启kubelet的功能这边后台也无法查看配置参数有点不好玩了然后等待集群的初始化完成。嗯，服务器的密码可以自动生成也可以使用ssh-key或者自己手工输入的看自己需求了。

&lt;h1 id=&quot;tke使用体验&quot;&gt;tke使用体验&lt;/h1&gt;

&lt;h2 id=&quot;1-特别不爽的一点-kuberctl-get-node的排序&quot;&gt;1. 特别不爽的一点 kuberctl get node的排序&lt;/h2&gt;

登陆任一一台master节点，第一件事情kubectl get nodes查看一下集群：

&lt;img src=&quot;/assets/images/2021/07-02/uq9rzzjxp8.png&quot; alt=&quot;image.png&quot; /&gt;

what？为什么排序拍的杂七乱八的….能不能ROLES master在前？如下图：

&lt;img src=&quot;/assets/images/2021/07-02/cyb33prdjl.png&quot; alt=&quot;image.png&quot; /&gt;

正常的排序不都这样吗？tke用ip方式显示主机名。但是master能不能排在前面？至于node节点的排序能不能有个排序的方式呢？排序这个东西提交了工单。客服回应说设计如此。幸好朋友圈有几个腾讯云的小伙伴，看我吐糟，帮拉了tke的一个群，反应了一下。然后tke的小伙伴记录了一下。

&lt;h2 id=&quot;2-csi-cbs-controller插件的异常&quot;&gt;2. csi-cbs-controller插件的异常&lt;/h2&gt;

&lt;img src=&quot;/assets/images/2021/07-02/w3eonit4eb.png&quot; alt=&quot;&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-02/kk7c7au0sh.png&quot; alt=&quot;&quot; /&gt;

没有去细看，端口异常不知道跟哪个服务冲突了。客服最后也没有能告诉我是跟哪一个插件冲突了，后面恢复了。……主要是懒得看了。用集成服务。前提是稳定的。我个人觉得一定是可以开箱即用的。

&lt;h2 id=&quot;3-应用市场-prometheus-opraoter的错误&quot;&gt;3. 应用市场 prometheus-opraoter的错误&lt;/h2&gt;

tke有一个应用市场，算是一个helm仓库吧。跑一个Prometheus-oprator的helm应用测试一下，然后又陷入了忧伤：

&lt;img src=&quot;/assets/images/2021/07-02/vmdbyyrs3n.png&quot; alt=&quot;&quot; /&gt;

&lt;img src=&quot;/assets/images/2021/07-02/bhfctxpx7m.png&quot; alt=&quot;&quot; /&gt;

monitoring-kube-state-metrics服务无法启动。最后看了一下这个POD是使用hostNetwork模式的 需要使用主机端口，POD所在节点 这个端口是否被其他应用所占用？看了一眼此节点日志嗯 8080确实被占用了：一个名为launcher的服务占用了此端口：

&lt;img src=&quot;/assets/images/2021/07-02/79j49z3knu.png&quot; alt=&quot;image.png&quot; /&gt;

客服给的解决方案：

&lt;img src=&quot;/assets/images/2021/07-02/w70ih4je52.png&quot; alt=&quot;image.png&quot; /&gt;

个人还是不太相信。因为我没有安装任何应用只安装了增强组件和存储组件。登陆其他work节点也确认一下发现每个节点都有一个launcher应用。怀疑这是一个系统组件

&lt;div class=&quot;language-plaintext highlighter-rouge&quot;&gt;&lt;div class=&quot;highlight&quot;&gt;&lt;pre class=&quot;highlight&quot;&gt;&lt;code&gt;kubectl get pods --all-namespaces|grep launcher
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/div&gt;

&lt;img src=&quot;/assets/images/2021/07-02/lem3nctb48.png&quot; alt=&quot;image.png&quot; /&gt;

最后找客服确认了一下，如下：

&lt;img src=&quot;/assets/images/2021/07-02/inrth2zkkg.png&quot; alt=&quot;image.png&quot; /&gt;

按照客服提示修改端口吧…….嗯总算起来了：

&lt;img src=&quot;/assets/images/2021/07-02/myuxgtz9cr.png&quot; alt=&quot;image.png&quot; /&gt;

&lt;h1 id=&quot;后记&quot;&gt;后记：&lt;/h1&gt;

这是用tke1.18的第一印象。当然了tke的小伙伴还是很给力的，朋友帮拉了群。各种问题可以随时反馈，还是不错的。

&lt;img src=&quot;/assets/images/2021/07-02/mbvnh84ne2.png&quot; alt=&quot;image.png&quot; /&gt;

这算是初体验吧，然后看看下一步体验一下部署其他应用，将服务clb代理。一步一步来吧。也希望tke能有更好的用户体验！
</description>
        <pubDate>Fri, 02 Jul 2021 02:00:00 +0000</pubDate>
        <link>https://duiniwukenaihe.github.io/2021/07/02/%E8%85%BE%E8%AE%AF%E4%BA%91TKE1.18%E5%88%9D%E4%BD%93%E9%AA%8C/</link>
        <guid isPermaLink="true">https://duiniwukenaihe.github.io/2021/07/02/%E8%85%BE%E8%AE%AF%E4%BA%91TKE1.18%E5%88%9D%E4%BD%93%E9%AA%8C/</guid>
        
        <category>kubernetes</category>
        
        <category>tke</category>
        
        <category>腾讯云</category>
        
        
        <category>kubernetes</category>
        
      </item>
    
  </channel>
</rss>
