# 一、基本使用

```js
go_memstats_other_sys_bytes
```
可以通过表的方式进行筛选查询
![image.png](/static/img/e981ee4df07a7c78719fb183fef8c756.image.webp)

![image.png](/static/img/6435cac1c2986fa42053ed77f55ed33b.image.webp)

# 二、命令
查看帮助命令
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus -h
```

指定当前目录下的配置文件启动
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus --config.file="prometheus.yml"
```
允许IP访问，如果要允许特定IP访问修改前面的IP
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus --web.listen-address=0.0.0.0:9090
```

限制最大的并发连接数量
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus --web.max-connections=512
```

指定数据库存放的目录
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus--storage.tsdb.path="data/"
```
日志级别
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus --log.level=info
```
日志格式
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus --log.format=logfmt
```
一般使用命令，可写入/etc/rc.local开机自启

```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus --config.file="/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus.yml" --web.listen-address=0.0.0.0:9090  --web.max-connections=512 &>>/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus.log &
```
# 三、systemctl服务管理

```js
vi /etc/systemd/system/prometheus.service
```
```js
[Unit]
Description=Prometheus Monitoring System
Documentation=https://prometheus.io/docs/introduction/overview/
After=network.target

[Service]
ExecStart=/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus \
  --config.file=/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus.yml \
  --web.listen-address=0.0.0.0:9090 \
  --web.max-connections=512
Restart=on-failure
RestartSec=30s
LimitNOFILE=65536
StandardOutput=syslog
StandardError=syslog
SyslogIdentifier=prometheus

[Install]
WantedBy=multi-user.target
```


```js
#授权
chmod 777 /etc/systemd/system/prometheus.service

#重载服务
sudo systemctl daemon-reload

#开机自启
sudo systemctl enable prometheus

#查看状态
systemctl status prometheus.service

#实时查看日志
journalctl -u prometheus -f
```

# 四、yml文件解释

```yml
# 全局配置
global:
  # 数据抓取间隔（默认1分钟）
  scrape_interval: 15s
  # 告警规则评估频率（建议与抓取间隔一致）
  evaluation_interval: 15s
  # 抓取超时时间（默认10秒）

# 告警配置
alerting:
  alertmanagers:
    - static_configs:
        - targets:
          # 启用Alertmanager时需配置实际地址
          # - alertmanager:9093

# 规则文件配置
rule_files:
  # 告警规则文件路径（支持通配符）
  # - 'alert_rules/*.rules'
  # 记录规则文件路径
  # - 'recording_rules/*.rules'

# 监控目标配置
scrape_configs:
  # Prometheus自监控任务
  - job_name: "prometheus"
    # 监控目标（默认暴露在9090端口）
    static_configs:
      - targets: ["localhost:9090"]
        # 自定义标签（用于维度筛选）
        labels:
          app: "prometheus"
          env: "production"
```

2.Prometheus使用

# 一、环境准备
## 1.准备两台服务器，一台用于安装Prometheus用于数据的采集，一台安装Grafana用于数据的展示
```js
hostnamectl set-hostname  prometeus
hostnamectl set-hostname  grafana
```

```js
cat >> /etc/hosts <<EOF
192.168.201.110 prometeus
192.168.201.111  grafana
EOF
```
## 2.同步服务器时间（很重要），因为普罗米修斯是时间数据库

```js
yum install ntpdate -t
ntpdate -u ntp.aliyun.com
timedatectl set-timezone Asia/Shanghai
```
# 二、下载安装包
下载网址：https://prometheus.io/download/

下面是长期稳定版本

![image.png](/static/img/3de5eb461ec05730698295fcd7228dbc.image.webp)

![image.png](/static/img/da6fab4b23d3d93300d8bc61346a1304.image.webp)

在Prometheus服务器创建一个文件目录，上传到该目录下

```js
mkdir -p /server/prometheus
```

![image.png](/static/img/9044419afd48ca108e274693b45fcfbd.image.webp)

```js
tar -zxvf prometheus-3.5.0.linux-amd64.tar.gz
```

进入目录后，prometheus是命令，prometheus.yml是配置文件，两个最核心的东西。
![image.png](/static/img/cd99da7956a68c58d470c52afc07d8c9.image.webp)


查看当前版本
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus  --version
```

![image.png](/static/img/35ba9abcdf714c5650a2efbfe570539e.image.webp)

# 启动prometeus
默认前台启动
```js
/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus
```
后台启动
```js
nohup /server/prometheus/prometheus-3.5.0.linux-amd64/prometheus &>>/server/prometheus/prometheus-3.5.0.linux-amd64/prometheus.log &
```
启动后，访问默认9090端口：http://192.168.201.110:9090/query


![image.png](/static/img/6a0141ab3ebfdf0b25f3051e99fd090e.image.webp)

全局设置勾选
![image.png](/static/img/a4f9938a21b9cc1a764995776613b289.image.webp)

1.Prometheus安装

# 一、安装IngressNginxController
先到图形化界面
![image.png](/static/img/7b73a3abc6f4d01c8cf31fe516fabcce.image.webp)


![image.png](/static/img/2f6bc1541e5d17ce3c0551b0b339235b.image.webp)


![image.png](/static/img/852753362509e7ad8f8afbb9f7eb2ddd.image.webp)

![image.png](/static/img/210d082079c1e1a2d8ee5cacba3a3763.image.webp)

![image.png](/static/img/8946ba9a32cb5e78c5d260df934f8241.image.webp)


# 二、配置harbor仓库私服信息

![image.png](/static/img/8d9ef19accf0fae9092d900bac1fac4b.image.webp)

![image.png](/static/img/34a124b3fb618bd7ad5c9e58318b4256.image.webp)

然后去主节点和工作节点都加上docker配置

```js
vi /etc/docker/daemon.json
```

```js
{
    "registry-mirrors": [
        "https://docker.m.daocloud.io",
        "https://docker.1panel.live",
        "https://hub.rat.dev"
    ],
   "insecure-registries":["192.168.201.107:80"]
}

```
然后重启docker，测试是否能登录,记住测试登录加端口，不然docker默认是https协议就是443


# 三、先准备部署到k8s的yml文件

```yml
apiVersion: v1
kind: Namespace
metadata:
  name: test1test
  labels:
    app: test1test
```

pipeline.yml
```yml
apiVersion: apps/v1
kind: Deployment
metadata:
  name: test1test
  namespace: test1test
  labels:
    app: test1test
spec:
  replicas: 2
  selector:
    matchLabels:
      app: test1test
  template:
    metadata:
      labels:
        app: test1test
    spec:
      containers:
        - name: test1test
          image: 192.168.201.107:80/mytest1test/mytest1test:V8.0.2
          imagePullPolicy: Always
          ports:
            - containerPort: 8080
---
apiVersion: v1
kind: Service
metadata:
  name: test1test
  namespace: test1test
  labels:
    app: test1test
spec:
  selector:
    app: test1test
  ports:
    - protocol: TCP
      port: 8081
      targetPort: 8080
  type: NodePort
---
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: test1test
  namespace: test1test
  labels:
    app: test1test
  annotations:
    nginx.ingress.kubernetes.io/rewrite-target: /
spec:
  ingressClassName: ingress
  rules:
    - host: songxuan.com
      http:
        paths:
          - path: /
            pathType: Prefix
            backend:
              service:
                name: test1test
                port:
                  number: 8081
```
启动后访问ing的IP+Service暴露的32403端口进行访问测试
![image.png](/static/img/1e605f60ab35bc4b855a92bc6b544f89.image.webp)

![image.png](/static/img/221a8b238c601f59efa7127bbcf8160a.image.webp)
测试没有问题

# 四、去Jenkins整合到k8s中
在gitlab创建一个pipeline.yml文件，把上面的yml文件沾上去

![image.png](/static/img/5d882a2f9954f4bfb4b49051b1910922.image.webp)
先去主节点服务器创建一个目录
```js
mkdir /songxuan
```
然后去Jenkins全局配置新增一个远程连接到k8s服务器的配置


![image.png](/static/img/840d62065a5e5c195ff979dec3cf4560.image.webp)

然后生成语法

![image.png](/static/img/08a439800342e1425fb82aa926122fda.image.webp)

```js
sshPublisher(publishers: [sshPublisherDesc(configName: 'K8S', transfers: [sshTransfer(cleanRemote: false, excludes: '', execCommand: '', execTimeout: 120000, flatten: false, makeEmptyDirs: false, noDefaultExcludes: false, patternSeparator: '[, ]+', remoteDirectory: '', remoteDirectorySDF: false, removePrefix: '', sourceFiles: 'pipeline.yml')], usePromotionTimestamp: false, useWorkspaceInPromotion: false, verbose: false)])
```

在gitlab更改Jenkinsfile文件，把之前的第6步替换掉
![image.png](/static/img/aa25e30f1af1adb2078e1d8859fb66e2.image.webp)


然后进入Jenkins容器内部配置免密登录
如果没有~/.ssh目录下没有东西或没目录，用以下命令重新生成一下
```js
# 强制创建.ssh目录并设置权限
mkdir -p ~/.ssh
chmod 700 ~/.ssh

# 生成RSA密钥对（无密码）
ssh-keygen -t rsa -b 4096 -f ~/.ssh/id_rsa -N ""

# 设置密钥权限
chmod 600 ~/.ssh/id_rsa
chmod 644 ~/.ssh/id_rsa.pub

# 将公钥追加到authorized_keys
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
```
把Jenkins内部容器的公钥给到master节点
```js
$ cat id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDGYg72GXNQmFPwEEp986OqHF7vCcVxJw6mox5iKifJReaUKdcLEXqjUcu6mUi29j3hFMi4QT7Oc3+JmgEeAxWLWmC4zADm0NWqzKDJ6qdptU01cMkFlukpBU9u/GBAyCLQ6sgK75O62HTIq2MVe9TqXOficr90IOSxpObPFq1ZEnWp6i76Ag7hMO3e8Hm4wSD4e6edxbDIgzzRNo58GO1YikHEiYkd86sMzJTI/Xf2myw9ETgen7MlFGrOgdBPktmD4Wexg3Ug72uZJxOB96sn5TOXzIYs9YsGvJeOsZ/zTk9okrRCIybjBjDJvmfDmjUNFF77byIFHCu2UAWpYGHeui3BlVwSjRdaysHIPFUEmadUwi0Oa3JpgnhU600UfsEJn3fGVm2XrwtLR0bhrj/LTsvM0UmvsAs0RC4b8EzrExbPWPfQPwUJLxKZcEfyW1cK6a4y8+qb2WV7HXv7acBtywTwBHAuuYeo6HKweyYoz/c2/pTWjZ3PpGETBUYB6km3WWrjDEzfxYVlGFb5mB+GWh1m5Knak9wABv06k9XVt3NL6ZjzkwH0WBd5Lr0YvfFocLLurq8gGjaBiWQ0lOPjDqILLwaV6Xm9ZoXyUb2My9yIBwYm2w9VhA9LreI0H8G8JDOzF+hBYV8ikF/8meqFuJgJMGe+/RZSNDhU/3FKQw== jenkins@5ca614ac051b
```
把Jenkins的公钥放到master节点的~/.ssh/authorized_keys里面

```js
vi ~/.ssh/authorized_keys
```

![image.png](/static/img/7cefdafdd8eedaf7e9279a361a62bcf4.image.webp)

然后测试免密是否成功，在Jenkins容器内部执行ssh命令

![image.png](/static/img/2ba284f1250e5c5d368c86ed2841b4ee.image.webp)

最后去Jenkins生成语法

![image.png](/static/img/83cbc4e315f4010f0f3d81c3f19bb32c.image.webp)

```js
sh 'ssh root@192.168.201.108  kubectl apply -f /songxuan/pipeline.yml'
```
然后去gitlab的Jenkins文件再加一条
![image.png](/static/img/550a6c8ccccb1df3943fd96d9effaa15.image.webp)


```js
pipeline {
    agent any
    
    stages {
        stage('1.拉取git仓库代码') {
            steps {
                checkout scmGit(branches: [[name: '${tag}']], extensions: [], userRemoteConfigs: [[credentialsId: '41ccb3f5-d95e-4f7c-94cd-8af30c885e0d', url: 'http://192.168.201.105:8929/root/mytest1.git']])
            }
        }
        
        stage('2.通过Maven构建项目') {
            steps {
                sh '/var/jenkins_home/maven/bin/mvn  clean package -DskipTests'
            }
        }
        
        stage('3.质量代码检测') {
            steps {
                sh '/var/jenkins_home/sonar-scanner-4.8.0.2856-linux/bin/sonar-scanner  -Dsonar.sources=./  -Dsonar.projectname=${JOB_NAME}  -Dsonar.projectKey=${JOB_NAME}   -Dsonar.java.binaries=./target/  -Dsonar.login=178e1842a7318cabd37749b7f2f5a5b88a5fb997'            
                }
        }
        
        stage('4.Docker制作镜像') {
            steps {
                sh '''cp -rf  ./target/*.jar ./docker/
docker build -t ${JOB_NAME}:${tag} ./docker/'''
            }
        }
        
        stage('5.自定义镜像推送Harbor') {
            steps {
               sh '''docker login 192.168.201.107:80 -u admin -p 123456
docker tag ${JOB_NAME}:${tag} 192.168.201.107:80/${JOB_NAME}/${JOB_NAME}:${tag}
docker push  192.168.201.107:80/${JOB_NAME}/${JOB_NAME}:${tag}'''
            }
        }
        
        stage('6.将yml文件传到k8smaster节点上') {
            steps {
                sshPublisher(publishers: [sshPublisherDesc(configName: 'K8S', transfers: [sshTransfer(cleanRemote: false, excludes: '', execCommand: '', execTimeout: 120000, flatten: false, makeEmptyDirs: false, noDefaultExcludes: false, patternSeparator: '[, ]+', remoteDirectory: '', remoteDirectorySDF: false, removePrefix: '', sourceFiles: 'pipeline.yml')], usePromotionTimestamp: false, useWorkspaceInPromotion: false, verbose: false)])
            }
        }
        stage('7.执行kubectl apply命令把k8s部署起来') {
            steps {
                sh 'ssh root@192.168.201.108  kubectl apply -f /songxuan/pipeline.yml'
            }
        }		
    }




post {
    success {
        dingtalk (
            robot: 'jenkins-dingding',
            type: 'MARKDOWN',
            title: "构建成功: ${env.JOB_NAME}",
            text: [
                "### 项目: ${env.JOB_NAME}",
                "### 版本: ${tag}",
                "### 构建结果: SUCCESS",
                "### 持续时间: ${currentBuild.durationString}"
                
                
            ],
            at: []
        )
    }
    failure {
        dingtalk (
            robot: 'jenkins-dingding',
            type: 'MARKDOWN',
            title: "构建失败: ${env.JOB_NAME}",
            text: [
                "### 项目: ${env.JOB_NAME}",
                "### 版本: ${tag}",
                "### 构建结果: FAILURE",
                "### 持续时间: ${currentBuild.durationString}",               
                "**失败原因:**",
                "${currentBuild.currentResult}"
            ],
            atAll: true
        )
    }
}


} 
```

最后去Jenkins执行任务


14.Jenkins发布至K8S

# 一、前提先安装好docker

安装k8s的1.19版本，该版本还支持docker
```js
export REGISTRY_MIRROR=https://registry.cn-hangzhou.aliyuncs.com
curl -sSL https://kuboard.cn/install-script/v1.19.x/install_kubelet.sh | sh -s 1.19.5
```

然后master节点执行以下命令
```js
export MASTER_IP=192.168.201.108

# 替换 apiserver.demo 为 您想要的 dnsName
export APISERVER_NAME=songxuan.com
# Kubernetes 容器组所在的网段，该网段安装完成后，由 kubernetes 创建，事先并不存在于您的物理网络中
export POD_SUBNET=10.100.0.1/16
echo "${MASTER_IP}    ${APISERVER_NAME}" >> /etc/hosts
curl -sSL https://kuboard.cn/install-script/v1.19.x/init_master.sh | sh -s 1.19.5
```

如果拉取镜像不下来，配置docker加速地址

![image.png](/static/img/aa2563295fc736db9555f092b04163cc.image.webp)


```js
vi /etc/docker/daemon.json

```

```js
{
    "registry-mirrors": [
        "https://docker.m.daocloud.io",
        "https://docker.1panel.live",
        "https://hub.rat.dev"
    ]
}
```
```js
systemctl daemon-reload
systemctl restart docker
```
![image.png](/static/img/06b8550c274187583e649fd5618f25d7.image.webp)

# 二、在主节点生成token让node节点加入
主节点执行
```js
kubeadm token create --print-join-command
```
获取到的加入节点token
![image.png](/static/img/59b3589df4e23ebb2247e499b5511c18.image.webp)


工作节点执行

```js
# 只在 worker 节点执行
# 替换 x.x.x.x 为 master 节点的内网 IP
export MASTER_IP=192.168.201.108
# 替换 apiserver.demo 为初始化 master 节点时所使用的 APISERVER_NAME
export APISERVER_NAME=songxuan.com
echo "${MASTER_IP}    ${APISERVER_NAME}" >> /etc/hosts

# 替换为 master 节点上 kubeadm token create 命令的输出
kubeadm join songxuan.com:6443 --token pwvmg4.1ismiw5mrztxkufm     --discovery-token-ca-cert-hash sha256:58ce169877173dbe41dce9ac563955d8561916bc87ebc3b905b7bc38af6b7ad7
```

最后完成k8s的安装
![image.png](/static/img/39b5a81795a5f5234ace076bbdf037e6.image.webp)


# 三、安装Kuboard图形化界面

Kuboard地址：https://www.kuboard.cn/install/v3/install-in-k8s.html#%E6%96%B9%E6%B3%95%E4%B8%80-%E4%BD%BF%E7%94%A8-hostpath-%E6%8F%90%E4%BE%9B%E6%8C%81%E4%B9%85%E5%8C%96

```js
kubectl apply -f https://addons.kuboard.cn/kuboard/kuboard-v3.yaml
```

在浏览器中打开链接 http://IP:30080

输入初始用户名和密码，并登录

用户名： admin
密码： Kuboard123


![image.png](/static/img/f1cdaa5fd805c03a72e08dc9925b723b.image.webp)

13.整合K8S-安装K8S和K8S图形化界面

# 一、下载插件

![image.png](/static/img/2e3d284e3aad2ccdf57053b44b7d7c6a.image.webp)

然后去钉钉添加机器人
![image.png](/static/img/0aabd322b74d280179dd3b925cb2cb6c.image.webp)

![image.png](/static/img/a66a9ca6c4b7b09a2ab56b405e37252d.image.webp)

![image.png](/static/img/96faa845d04f4fc88cab2e76009360b5.image.webp)

![image.png](/static/img/f8215b459b65986af3c30a84356e7276.image.webp)

复制下来
![image.png](/static/img/b2fbc34ca294c49f39a5d58937c47fc2.image.webp)

```js
https://oapi.dingtalk.com/robot/send?access_token=f1888f239560668660d65047a4c8079ceba05e96c07c6a3f7686f6875b602839
```

# 二、Jenkins配置钉钉
![image.png](/static/img/e9fe745d1fdb8ca09ed28bed211ec273.image.webp)


![image.png](/static/img/822c1c658bab1e4bb546a3dfea8df317.image.webp)


然后去gitlab仓库的jenkins文件添加代码

![image.png](/static/img/06f99d8b97bda414d6b1d9bff83e9d4c.image.webp)
```js
pipeline {
    agent any
    
    stages {
        stage('1.拉取git仓库代码') {
            steps {
                checkout scmGit(branches: [[name: '${tag}']], extensions: [], userRemoteConfigs: [[credentialsId: '41ccb3f5-d95e-4f7c-94cd-8af30c885e0d', url: 'http://192.168.201.105:8929/root/mytest1.git']])
            }
        }
        
        stage('2.通过Maven构建项目') {
            steps {
                sh '/var/jenkins_home/maven/bin/mvn  clean package -DskipTests'
            }
        }
        
        stage('3.质量代码检测') {
            steps {
                sh '/var/jenkins_home/sonar-scanner-4.8.0.2856-linux/bin/sonar-scanner  -Dsonar.sources=./  -Dsonar.projectname=${JOB_NAME}  -Dsonar.projectKey=${JOB_NAME}   -Dsonar.java.binaries=./target/  -Dsonar.login=178e1842a7318cabd37749b7f2f5a5b88a5fb997'            
                }
        }
        
        stage('4.Docker制作镜像') {
            steps {
                sh '''cp -rf  ./target/*.jar ./docker/
docker build -t ${JOB_NAME}:${tag} ./docker/'''
            }
        }
        
        stage('5.自定义镜像推送Harbor') {
            steps {
               sh '''docker login 192.168.201.107:80 -u admin -p 123456
docker tag ${JOB_NAME}:${tag} 192.168.201.107:80/${JOB_NAME}/${JOB_NAME}:${tag}
docker push  192.168.201.107:80/${JOB_NAME}/${JOB_NAME}:${tag}'''
            }
        }
        
        stage('6.通知目标服务器拉取镜像启动') {
            steps {
                sshPublisher(publishers: [sshPublisherDesc(configName: '测试本机服务器', transfers: [sshTransfer(cleanRemote: false, excludes: '', execCommand: "jiaoben.sh 192.168.201.107:80 mytest1test ${JOB_NAME} $tag  $host_port $port", execTimeout: 120000, flatten: false, makeEmptyDirs: false, noDefaultExcludes: false, patternSeparator: '[, ]+', remoteDirectory: '', remoteDirectorySDF: false, removePrefix: '', sourceFiles: '')], usePromotionTimestamp: false, useWorkspaceInPromotion: false, verbose: false)])
            }
        }
    }




post {
    success {
        dingtalk (
            robot: 'jenkins-dingding',
            type: 'MARKDOWN',
            title: "构建成功: ${env.JOB_NAME}",
            text: [
                "### 项目: ${env.JOB_NAME}",
                "### 版本: ${tag}",
                "### 构建结果: SUCCESS",
                "### 持续时间: ${currentBuild.durationString}"
                
                
            ],
            at: []
        )
    }
    failure {
        dingtalk (
            robot: 'jenkins-dingding',
            type: 'MARKDOWN',
            title: "构建失败: ${env.JOB_NAME}",
            text: [
                "### 项目: ${env.JOB_NAME}",
                "### 版本: ${tag}",
                "### 构建结果: FAILURE",
                "### 持续时间: ${currentBuild.durationString}",               
                "**失败原因:**",
                "${currentBuild.currentResult}"
            ],
            atAll: true
        )
    }
}


} 
```
执行完成Jenkins流水线任务后，成功通知钉钉机器人
![image.png](/static/img/d871579affb0cfd83bafe6a00a9a3eec.image.webp)
