一、Docker軟件部署

1.構建yum源

在/etc/yum.repos.d下創建docker-ce.repo

docker-ce.repok可在https://download.docker.com/linux/centos/docker-ce.repo下載

查看倉庫中全部docker版本，并選擇特定版本安裝

[root@node1 yum.repos.d]# yum makecache
Loaded plugins: fastestmirror, product-id, search-disabled-repos, subscription-manager

This system is not registered with an entitlement server. You can use subscription-manager to register.

docker-ce-stable                                                                                                                          | 3.5 kB  00:00:00
Loading mirror speeds from cached hostfile
docker-ce-stable/7/x86_64/primary_db                                                                                                      |  70 kB  00:00:00
docker-ce-stable/7/x86_64/filelists_db                                                                                                    |  29 kB  00:00:00
docker-ce-stable/7/x86_64/other_db                                                                                                        | 122 kB  00:00:00
Metadata Cache Created
[root@node1 yum.repos.d]# yum list  |grep docker
containerd.io.x86_64             1.4.12-3.1.el7                 docker-ce-stable
docker-ce.x86_64                 3:20.10.12-3.el7               docker-ce-stable
docker-ce-cli.x86_64             1:20.10.12-3.el7               docker-ce-stable
docker-ce-rootless-extras.x86_64 20.10.12-3.el7                 docker-ce-stable
docker-ce-selinux.noarch         17.03.3.ce-1.el7               docker-ce-stable
docker-scan-plugin.x86_64        0.12.0-3.el7                   docker-ce-stable

2.安裝docker-ce

[root@node1 yum.repos.d]# yum install docker-ce -y

解決安裝報錯:

只需要安裝container-selinux包，就可以了

[root@localhost ~]# yum install -y container-selinux
  Loaded plugins: fastestmirror
  Loading mirror speeds from cached hostfile
  
  - base: mirrors.bfsu.edu.cn
  - extras: mirrors.bfsu.edu.cn
  - updates: mirrors.bfsu.edu.cn
    Resolving Dependencies
    --> Running transaction check
    ---> Package container-selinux.noarch 2:2.119.2-1.911c772.el7_8 will be installed
    --> Processing Dependency: selinux-policy-targeted >= 3.13.1-216.el7 for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch
    --> Processing Dependency: selinux-policy-base >= 3.13.1-216.el7 for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch
    --> Processing Dependency: selinux-policy >= 3.13.1-216.el7 for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch
    --> Processing Dependency: policycoreutils-python for package: 2:container-selinux-2.119.2-1.911c772.el7_8.noarch
    --> Running transaction check

3.啟動docker

 systemctl start docker
 systemctl enable docker
 systemctl status docker

二、Docker拉取PG14鏡像并構建PG14容器

1.拉取pg14.1鏡像

[root@localhost ~]# docker pull postgres:14.1
14.1: Pulling from library/postgres
a2abf6c4d29d: Pull complete
e1769f49f910: Pull complete
33a59cfee47c: Pull complete
461b2090c345: Pull complete
8ed8ab6290ac: Pull complete
495e42c822a0: Pull complete
18e858c71c58: Pull complete
594792c80d5f: Pull complete
794976979956: Pull complete
eb5e1a73c3ca: Pull complete
6d6360292cba: Pull complete
131e916e1a28: Pull complete
b84c0e55930b: Pull complete
Digest: sha256:17286f7ca2590bdfdfa3afd3305d839780c33c4f9af167a45e537f22d3cafcb0
Status: Downloaded newer image for postgres:14.1
docker.io/library/postgres:14.1

2.查看本地PG鏡像

[root@localhost ~]# docker images
REPOSITORY   TAG       IMAGE ID       CREATED      SIZE
postgres     14.1      cdbebe091601   2 days ago   374MB

3.映射目錄

創建postgresql數據庫容器的數據目錄路徑掛載到的宿主機路徑，保證容器銷毀后數據還在

[root@localhost ~]# mkdir -p /docker/postgresql/data/

4.運行PG容器

[root@localhost ~]# docker run -d --name postgresql --restart always -v /docker/postgresql/data/:/var/lib/postgresql/data -e POSTGRES_PASSWORD=123456 -p 15432:5432 postgres:14.1
09b45ee81642527ebcdf25c48a25a9e2524068562f889b8a103a915444363c78

-d 表示啟動后在后臺運行，不啟動日志

-name 容器名 表示給容器命名

–restart always 表示如果容器死掉，會自動拉起，可以不配置

-v 宿主機路徑:容器內路徑 把容器內路徑掛載到宿主機路徑，保證容器銷毀后數據還在

-p 宿主機端口:容器端口 把宿主機端口和容器內端口進行映射

-e POSTGRES_PASSWORD=123456 設置環境變量值，這里設置了數據庫的密碼

5.查看啟動的容器狀態

[root@localhost ~]# docker ps
CONTAINER ID   IMAGE           COMMAND                  CREATED         STATUS         PORTS                                         NAMES
09b45ee81642   postgres:14.1   "docker-entrypoint.s…"   8 seconds ago   Up 6 seconds   0.0.0.0:15432->5432/tcp, :::15432->5432/tcp   postgresql

（查看所有的容器用docker ps -a）

6.進入容器查看PG數據庫版本

[root@localhost ~]# docker exec -it postgresql bash
root@09b45ee81642:/# su - postgres
postgres@09b45ee81642:~$ psql
psql (14.1 (Debian 14.1-1.pgdg110+1))
Type "help" for help.

postgres=# select version();
                                                           version
-----------------------------------------------------------------------------------------------------------------------------
 PostgreSQL 14.1 (Debian 14.1-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
(1 row)

-i:?以交互模式運行容器，通常與 -t 同時使用

-t: 為容器重新分配一個偽輸入終端，通常與 -i 同時使用；

PG14的docker部署完成

三、Docker部署prometheus容器

1.搜索prometheus鏡像

搜索可用的prometheus鏡像，并選擇使用數量最多的

[root@localhost ~]# docker search prometheus

2.拉取prometheus鏡像

[root@localhost ~]# docker pull prom/prometheus
Using default tag: latest
latest: Pulling from prom/prometheus
3cb635b06aa2: Pull complete
34f699df6fe0: Pull complete
33d6c9635e0f: Pull complete
f2af7323bed8: Pull complete
c16675a6a294: Pull complete
827843f6afe6: Pull complete
3d272942eeaf: Pull complete
7e785cfa34da: Pull complete
05e324559e3b: Pull complete
170620261a59: Pull complete
ec35f5996032: Pull complete
5509173eb708: Pull complete
Digest: sha256:cb9817249c346d6cfadebe383ed3b3cd4c540f623db40c4ca00da2ada45259bb
Status: Downloaded newer image for prom/prometheus:latest
docker.io/prom/prometheus:latest

[root@localhost ~]# docker images
REPOSITORY        TAG       IMAGE ID       CREATED      SIZE
postgres          14.1      cdbebe091601   2 days ago   374MB
prom/prometheus   latest    a3d385fc29f9   6 days ago   201MB

3.開啟prometheus容器

[root@localhost ~]#  docker run --name prometheus --privileged=true -di -p 9090:9090 prom/prometheus
708e0cb45bdb16c9ccc5b6d89204c361c6145f03ff7bf3e8be78f2941b707e6a
[root@localhost ~]# docker ps

CONTAINER ID   IMAGE             COMMAND                  CREATED             STATUS             PORTS                                         NAMES

708e0cb45bdb   prom/prometheus   "/bin/prometheus --c…"   5 minutes ago       Up 5 minutes       0.0.0.0:9090->9090/tcp, :::9090->9090/tcp     prometheus

09b45ee81642   postgres:14.1     "docker-entrypoint.s…"   About an hour ago   Up About an hour   0.0.0.0:15432->5432/tcp, :::15432->5432/tcp   postgresql

4.bash報錯，可以用/bin/sh替代

[root@localhost ~]# docker exec -it prometheus bash
OCI runtime exec failed: exec failed: container_linux.go:380: starting container process caused: exec: "bash": executable file not found in $PATH: unknown
[root@localhost ~]# docker exec -it prometheus /bin/sh

/prometheus $ find / -name prometheus
/bin/prometheus
/etc/prometheus
find: /root: Permission denied
/usr/share/prometheus
find: /proc/tty/driver: Permission denied
/prometheus

5.拉起prometheus

/prometheus $ /bin/prometheus --web.listen-address="0.0.0.0:9090" --config.file="/etc/prometheus/prometheus.yml" --log.level=info
ts=2021-12-24T10:17:39.879Z caller=main.go:478 level=info msg="No time or size retention was set so using the default time retention" duration=15d
ts=2021-12-24T10:17:39.880Z caller=main.go:515 level=info msg="Starting Prometheus" version="(version=2.32.1, branch=HEAD, revision=41f1a8125e664985dd30674e5bdf6b683eff5d32)"
ts=2021-12-24T10:17:39.880Z caller=main.go:520 level=info build_context="(go=go1.17.5, user=root@54b6dbd48b97, date=20211217-22:08:06)"
ts=2021-12-24T10:17:39.880Z caller=main.go:521 level=info host_details="(Linux 3.10.0-693.el7.x86_64 #1 SMP Tue Aug 22 21:09:27 UTC 2017 x86_64 708e0cb45bdb (none))"
ts=2021-12-24T10:17:39.880Z caller=main.go:522 level=info fd_limits="(soft=1048576, hard=1048576)"
ts=2021-12-24T10:17:39.880Z caller=main.go:523 level=info vm_limits="(soft=unlimited, hard=unlimited)"
ts=2021-12-24T10:17:39.883Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090


/prometheus $ ps -ef | grep prometheus
    1 nobody    0:00 /bin/prometheus --config.file=/etc/prometheus/prometheus.yml --storage.tsdb.path=/prometheus --web.console.libraries=/usr/share/prometheus/console_libraries --web.console.templates=/usr/share/prometheus/consoles
/prometheus $ netstat -altp | grep 9090
tcp        0      0 localhost:58478         localhost:9090          ESTABLISHED 1/prometheus
tcp        0      0 :::9090                 :::*                    LISTEN      1/prometheus
tcp        0      0 ::ffff:127.0.0.1:9090   ::ffff:127.0.0.1:58478  ESTABLISHED 1/prometheus

6.去瀏覽器驗證

我的地址為172.20.10.5，所以訪問的地址為172.20.10.5:9090

如果配置exporter的話，可以通過如下界面獲取exporter的狀態，可以點擊endpoint，來查看當前抽取到的一些指標，這些指標監控項可以在Graph界面查詢值和隨時間變化的趨勢，可以根據表達式進行處理，或者加入到grafana上邊，形成更加直觀的界面。

四、Docker部署postgres_exporter容器

1.拉取postgres_exporter

[root@localhost ~]# docker pull wrouesnel/postgres_exporter
Using default tag: latest
latest: Pulling from wrouesnel/postgres_exporter
45b42c59be33: Pull complete
4634a89d50c2: Pull complete
fbcf7c278f83: Pull complete
Digest: sha256:54bd3ba6bc39a9da2bf382667db4dc249c96e4cfc837dafe91d6cc7d362829e0
Status: Downloaded newer image for wrouesnel/postgres_exporter:latest
docker.io/wrouesnel/postgres_exporter:latest

[root@localhost ~]# docker images
REPOSITORY                    TAG       IMAGE ID       CREATED         SIZE
postgres                      14.1      cdbebe091601   2 days ago      374MB
prom/prometheus               latest    a3d385fc29f9   6 days ago      201MB
wrouesnel/postgres_exporter   latest    9fe9d3d02141   10 months ago   88.7MB

2.數據庫配置

需在監控的數據庫上建立監控用戶并執行一下以下命令 。以非超級用戶身份運行時候為了能夠從pg_stat_activity和pg_stat_replication 作為非超級用戶收集指標，必須以超級用戶的身份創建功能和視圖，并分別為它們分配權限。

postgres=# CREATE USER postgres_exporter WITH PASSWORD 'postgres_exporter123';
CREATE ROLE
postgres=# ALTER USER postgres_exporter SET SEARCH_PATH TO postgres_exporter,pg_catalog;
ALTER ROLE

postgres=# CREATE SCHEMA postgres_exporter AUTHORIZATION postgres_exporter;
CREATE SCHEMA

postgres=# CREATE FUNCTION postgres_exporter.f_select_pg_stat_activity()
RETURNS setof pg_catalog.pg_stat_activity
LANGUAGE sql
SECURITY DEFINER
AS $$
  SELECT * from pg_catalog.pg_stat_activity;
$$;
CREATE FUNCTION

postgres=# CREATE FUNCTION postgres_exporter.f_select_pg_stat_replication()
RETURNS setof pg_catalog.pg_stat_replication
LANGUAGE sql
SECURITY DEFINER
AS $$
  SELECT * from pg_catalog.pg_stat_replication;
$$;
CREATE FUNCTION

postgres=# CREATE VIEW postgres_exporter.pg_stat_replication
AS
  SELECT * FROM postgres_exporter.f_select_pg_stat_replication();
CREATE VIEW

postgres=# CREATE VIEW postgres_exporter.pg_stat_activity
AS
  SELECT * FROM postgres_exporter.f_select_pg_stat_activity();
CREATE VIEW

postgres=# GRANT SELECT ON postgres_exporter.pg_stat_replication TO postgres_exporter;
GRANT

postgres=# GRANT SELECT ON postgres_exporter.pg_stat_activity TO postgres_exporter;
GRANT

修改pg_hba.conf,使能訪問數據庫，注意密碼校驗的時候password_encryption參數以及pg_authid里密碼的加密方式。

postgres=# show password_encryption;
 password_encryption
---------------------
 scram-sha-256
(1 row)

postgres=# select * from pg_authid where rolname='postgres_exporter';
-[ RECORD 1 ]--+--------------------------------------------------------------------------------------------------------------------------------------
oid            | 16384
rolname        | postgres_exporter
rolsuper       | f
rolinherit     | t
rolcreaterole  | f
rolcreatedb    | f
rolcanlogin    | t
rolreplication | f
rolbypassrls   | f
rolconnlimit   | -1
rolpassword    | SCRAM-SHA-256$4096:1VfD4I+8uxNHv+qDEZACCg==$b/2Wgt6zGMkHPCMk9RIN+aPci8lK0oSYc87Eu8wXfNk=:f8lituzDMMMdb6rMA/5pdiFWC4j/MuS4cAVy/awMjJA=
rolvaliduntil  |

pg_hba.conf加的部分如下

host    all      postgres_exporter     172.20.10.5/32     scram-sha-256

注意docker容器最簡模式里可能使用不了vim或者ps,可以用如下方法解決。如果容器沒有權限執行，可以在進入容器時候加上-u 0以root權限進入，再執行如下操作

root@09b45ee81642:/# apt-get update
Get:1 http://security.debian.org/debian-security bullseye-security InRelease [44.1 kB]
Get:2 http://deb.debian.org/debian bullseye InRelease [116 kB]
Get:3 http://security.debian.org/debian-security bullseye-security/main amd64 Packages [102 kB]
Get:4 http://deb.debian.org/debian bullseye-updates InRelease [39.4 kB]
Get:5 http://apt.postgresql.org/pub/repos/apt bullseye-pgdg InRelease [86.7 kB]
Get:6 http://deb.debian.org/debian bullseye/main amd64 Packages [8,183 kB]
Get:7 http://apt.postgresql.org/pub/repos/apt bullseye-pgdg/main amd64 Packages [234 kB]
Get:8 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [2,592 B]
Fetched 8,808 kB in 3min 55s (37.5 kB/s)
Reading package lists... Done

root@09b45ee81642:/# apt-get install -y vim
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  libgpm2 vim-common vim-runtime xxd
Suggested packages:
  gpm ctags vim-doc vim-scripts
The following NEW packages will be installed:
  libgpm2 vim vim-common vim-runtime xxd
0 upgraded, 5 newly installed, 0 to remove and 0 not upgraded.
Need to get 8,174 kB of archives.
After this operation, 36.9 MB of additional disk space will be used.
Get:1 http://deb.debian.org/debian bullseye/main amd64 xxd amd64 2:8.2.2434-3+deb11u1 [192 kB]
Get:2 http://deb.debian.org/debian bullseye/main amd64 vim-common all 2:8.2.2434-3+deb11u1 [226 kB]
Get:3 http://deb.debian.org/debian bullseye/main amd64 libgpm2 amd64 1.20.7-8 [35.6 kB]
Get:4 http://deb.debian.org/debian bullseye/main amd64 vim-runtime all 2:8.2.2434-3+deb11u1 [6,226 kB]
Get:5 http://deb.debian.org/debian bullseye/main amd64 vim amd64 2:8.2.2434-3+deb11u1 [1,494 kB]
Fetched 8,174 kB in 7s (1,187 kB/s)

root@09b45ee81642:/# apt-get install -y procps

注意：在對docker里數據庫進行配置修改后，需要重啟生效時，建議直接將容器重啟，不僅節約時間，也避免容器內重啟庫帶來問題。例如:

[root@localhost ~]# docker restart postgresql

postgresql

3.運行容器使postgres_exporter可以抽取數據庫指標

[root@localhost ~]#  docker run --name postgres_exporter --net=host -d -e DATA_SOURCE_NAME="postgresql://postgres:123456@172.20.10.5:15432/postgres?sslmode=disable" wrouesnel/postgres_exporter
fdff211e4514859b29fae3d7bf5ecdf2c10083034f2254d522753f2bc20d0dca

[root@localhost ~]# docker ps
CONTAINER ID   IMAGE                         COMMAND                  CREATED             STATUS             PORTS                                         NAMES
be590925e24b   wrouesnel/postgres_exporter   "/postgres_exporter"     5 seconds ago       Up 4 seconds       0.0.0.0:9187->9187/tcp, :::9187->9187/tcp     postgres_exporter
708e0cb45bdb   prom/prometheus               "/bin/prometheus --c…"   About an hour ago   Up About an hour   0.0.0.0:9090->9090/tcp, :::9090->9090/tcp     prometheus
09b45ee81642   postgres:14.1                 "docker-entrypoint.s…"   2 hours ago         Up 2 hours         0.0.0.0:15432->5432/tcp, :::15432->5432/tcp   postgresql

4.修改prometheus里的yml文件，加上postgres_exporter部分

[root@localhost ~]# docker exec -it prometheus /bin/sh

/prometheus $ cd /etc/prometheus/
/etc/prometheus $ ls
console_libraries  consoles           prometheus.yml

/etc/prometheus $ vi prometheus.yml

最下邊黃框部分是我加的postgres_exporter部分

5.重啟prometheus容器

[root@localhost ~]# docker restart prometheus
prometheus

6.瀏覽器驗證

依舊是登錄到prometheus的9090端口

點擊查看metrics里指標，部分指標如下。

五、Docker部署grafana容器

1.拉取grafana鏡像

[root@localhost ~]# docker pull grafana/grafana:5.1.0
5.1.0: Pulling from grafana/grafana
2a72cbf407d6: Pull complete
89f824064239: Pull complete
b90280be2e0d: Pull complete
Digest: sha256:a6b37f9afdd9782f1e6264acaf3b09519aad454f34ca6b0e863dd9873e11fa67
Status: Downloaded newer image for grafana/grafana:5.1.0
docker.io/grafana/grafana:5.1.0

如果下載太慢的話可以執行參考下邊操作再下載,速度會遠遠加快

[root@localhost ~]# vim /etc/docker/daemon.json

[root@localhost ~]# cat /etc/docker/daemon.json
{
  "registry-mirrors": ["https://9cpn8tt6.mirror.aliyuncs.com"]
}

[root@localhost ~]# systemctl daemon-reload
[root@localhost ~]# systemctl restart docker

2.拉起grafana容器

[root@localhost ~]# docker run --name grafana -d -p 3000:3000 grafana/grafana:5.1.0
37fa23cf597ef65a3fadfc22002b083bda6c917e0c1caadbceb54a78b92be10f

[root@localhost ~]# docker ps
CONTAINER ID   IMAGE                         COMMAND                  CREATED             STATUS          PORTS                                         NAMES
37fa23cf597e   grafana/grafana:5.1.0         "/run.sh"                11 seconds ago      Up 9 seconds    0.0.0.0:3000->3000/tcp, :::3000->3000/tcp     grafana
f5e8d696c988   wrouesnel/postgres_exporter   "/postgres_exporter"     About an hour ago   Up 45 minutes   0.0.0.0:9187->9187/tcp, :::9187->9187/tcp     postgres_exporter
708e0cb45bdb   prom/prometheus               "/bin/prometheus --c…"   4 hours ago         Up 44 minutes   0.0.0.0:9090->9090/tcp, :::9090->9090/tcp     prometheus
09b45ee81642   postgres:14.1                 "docker-entrypoint.s…"   5 hours ago         Up 54 minutes   0.0.0.0:15432->5432/tcp, :::15432->5432/tcp   postgresql

可以看到最終有四個容器。

3.環境檢查及網頁驗證

（1）.登錄界面

如下是docker的進程,PostgreSQL14數據庫的容器端口為5432，映射到了宿主機15432的端口。postgres_expoeter的端口宿主機和容器映射為同樣的9187,prometheus的端口宿主機和容器映射為同樣的9090，grafana的端口宿主機和容器映射為同樣的3000。

我本地的ip為172.20.10.5，訪問172.20.10.5:3000

初始用戶名密碼為admin/admin

進入之后界面為

可以創建登錄用戶

（2）.配置數據源

點擊Data Sources配置數據源

點擊增加

（3）.導入面板的json文件或者面板id

點擊import

我這里選擇的是填寫面板id

之后會出現面板的一些信息，點擊import

（4）.驗證

然后選擇上邊的數據源，實例，數據庫。監控界面如圖所示。

搭建完畢。

六、小結

本文章是用的postgres_exporter的docker鏡像搭建的，沒有實現指標的自定義。

如果想自定義監控項：

1.可以通過編寫ymal文件，并在啟動postgres_exporter時候指定 --extend.query-path=""選項，使其根據你的文件獲取監控項。

2.使用node_exporter,通過–collector.textfile.directory參數，指定自定義監控項的prom路徑，需要配合腳本及crontab，將數據輸出到該目錄下，并產生.prom文件（需要注意文件權限）