prometheus持久化到mysql_Prometheus数据持久化存储（二）

Prometheus(普罗米修斯)

Prometheus数据持久化存储(二)

Prometheus&＃43;Influx&＃43;Grafana&＃43;Mysql数据持久化存储

Prometheus的存储数据库默认只保留15天的数据&＃xff0c;Grafana存储的配置以及图表都还在容器之中它自己生成的sqlit数据库中长期存储并不友好。

为了更适应老板的需求&＃xff0c;长期存储数据&＃xff0c;我们可以添加时序数据库InfluxDB作为prometheus后端存储&＃xff0c;可以修改grafana的存储为mysql以便自己做一些自定义操作的时候方便一点。

Prometheus&＃43;Influx存储数据

cat docker-compose-prometheus-influxdb.yml

version: "2.3"

services:

prometheus:

image: prom/prometheus:latest

container_name: prometheus

hostname: prometheus

restart: always

volumes:

- /prometheus/prometheus/config:/etc/prometheus

- /prometheus/prometheus/data:/prometheus

- /etc/localtime:/etc/localtime

command:

- &＃39;--config.file&＃61;/etc/prometheus/prometheus.yml&＃39;

- &＃39;--log.level&＃61;info&＃39;

- &＃39;--web.listen-address&＃61;0.0.0.0:9090&＃39;

- &＃39;--storage.tsdb.path&＃61;/prometheus&＃39;

- &＃39;--storage.tsdb.retention&＃61;15d&＃39;

- &＃39;--query.max-concurrency&＃61;50&＃39;

- &＃39;--web.enable-lifecycle&＃39;

ports:

- "9090:9090"

depends_on:

- influxdb

logging:

driver: "json-file"

options:

max-size: "1g"

networks:

- prom_monitor

influxdb:

image: influxdb:latest

container_name: influxdb

hostname: influxdb

restart: always

volumes:

- /prometheus/prometheus/influxdb/config:/etc/influxdb

- /prometheus/prometheus/influxdb/data:/var/lib/influxdb/data

- /etc/localtime:/etc/localtime

ports:

- "8086:8086"

- "8083:8083"

environment:

- INFLUXDB_DB&＃61;prometheus

- INFLUXDB_ADMIN_ENABLED&＃61;true

- INFLUXDB_ADMIN_USER&＃61;admin

- INFLUXDB_ADMIN_PASSWORD&＃61;adminpwd

- INFLUXDB_USER&＃61;prometheus

- INFLUXDB_USER_PASSWORD&＃61;prometheuspwd

- INFLUXDB_CONFIG_PATH&＃61;/etc/influxdb/influxdb.conf

logging:

driver: "json-file"

options:

max-size: "1g"

networks:

- prom_monitor

networks:

prom_monitor:

driver: bridge

mkdir -p influxdb/data influxdb/config

cat influxdb/config/influxdb.conf

[meta]

dir &＃61; "/var/lib/influxdb/meta"

[data]

dir &＃61; "/var/lib/influxdb/data"

engine &＃61; "tsm1"

wal-dir &＃61; "/var/lib/influxdb/wal"

通过以上文件看出&＃xff0c;重新指定了Prometheus的存储数据库为InfluxDB&＃xff0c;当然&＃xff0c;还需要配置Prometheus.yml文件。

cat config/prometheus.yml

在Prometheus的配置文件中&＃xff0c;添加远程读写。

# 指定了Prometheus的存储数据库为InfluxDB

remote_write:

- url: "http://influxdb:8086/api/v1/prom/write?db&＃61;prometheus&u&＃61;prometheus&p&＃61;prometheuspwd"

remote_read:

- url: "http://influxdb:8086/api/v1/prom/read?db&＃61;prometheus&u&＃61;prometheus&p&＃61;prometheuspwd"

其它配置&＃xff1a;

cat config/prometheus.yml

添加如下配置

scrape_configs:

- job_name: &＃39;linux-server&＃39;# 定义任务名

scrape_interval: 5s

static_configs:

file_sd_configs:

- files:

- &＃39;/etc/prometheus/fileconfig/*-nodes.json&＃39;

file_sd_configs启动prometheus的文件发现功能&＃xff0c;可以将配置主机等信息写入文件中&＃xff0c;如果用户修改了配置&＃xff0c;比如增加或删除了某些主机&＃xff0c;那么Prometheus会自动发现这些更改。

cat config/fileconfig/office-nodes.json

[

{

"targets": ["192.168.1.20:9100"],

"labels": {

"instance": "192.168.1.20",

"alias": "office0",

"job": "node"

}

},

{

"targets": ["192.168.1.17:9111"],

"labels": {

"instance": "192.168.1.17",

"alias": "office3",

"job": "node"

}

}

]

登录influxdb数据库查看相应的数据信息

docker exec -it influxdb bash

influx

use prometheus

show MEASUREMENTS

select * from up

可以查看到相关数据。

完整的prometheus.yml文件

global:

scrape_interval: 15s # 默认抓取间隔, 15秒向目标抓取一次数据。

external_labels:

monitor: &＃39;codelab-monitor&＃39;

# 这里表示抓取对象的配置

scrape_configs:

- job_name: &＃39;linux-server&＃39;# 定义任务名

scrape_interval: 5s

static_configs:

file_sd_configs:

- files:

- &＃39;/etc/prometheus/fileconfig/*-nodes.json&＃39;

# 指定了Prometheus的存储数据库为InfluxDB

remote_write:

- url: "http://influxdb:8086/api/v1/prom/write?db&＃61;prometheus&u&＃61;prometheus&p&＃61;prometheuspwd"

remote_read:

- url: "http://influxdb:8086/api/v1/prom/read?db&＃61;prometheus&u&＃61;prometheus&p&＃61;prometheuspwd"

# 配置告警规则位置

rule_files:

- "rules/*rules.yml"

# 配置alertmanager告警发送消息配置

alerting:

alertmanagers:

- static_configs:

- targets: [&＃39;192.168.1.20:9093&＃39;]

附加&＃xff1a;

influxdb时序数据库的基本命令

# influxdb相关操作

#登录数据库

influx

或

influx -host 127.0.0.1 -port 8086 -username prometheus -password prometheuspwd

#查看数据库

show databases

#切换数据库

use prometheus

#查看数据表

show MEASUREMENTS

#查看数据

select * from up

#查看用户

show users

#创建用户

create user "username" with password &＃39;password&＃39; with all privileges

#删除用户

drop user username

Grafana&＃43;Mysql存储数据

cat docker-compose-grafana-mysql.yml

version: "2.3"

services:

grafana:

image: grafana/grafana:latest

container_name: grafana

hostname: grafana

restart: always

volumes:

- /prometheus/grafana/config:/etc/grafana

- /prometheus/grafana/logs:/var/log/grafana

- /prometheus/grafana/data:/var/lib/grafana

- /prometheus/grafana/dashboards:/etc/grafana/provisioning/dashboards

- /etc/localtime:/etc/localtime

ports:

- "3000:3000"

user: "104"

depends_on:

- db

networks:

- prom_monitor

db:

image: mysql:5.7

command: --character-set-server&＃61;utf8mb4 --collation-server&＃61;utf8mb4_unicode_ci

container_name: mysql

hostname: mysql

restart: always

environment:

- MYSQL_ROOT_PASSWORD&＃61;Admin_pwd

- MYSQL_DATABASE&＃61;grafana

- MYSQL_USER&＃61;grafana

- MYSQL_PASSWORD&＃61;grafana

volumes:

- /prometheus/grafana/mysql:/var/lib/mysql

- /etc/localtime:/etc/localtime

expose:

- "3306"

networks:

- prom_monitor

networks:

prom_monitor:

driver: bridge

grafana配置文件增加数据库信息

cat config/grafana.ini

[database]

type &＃61; mysql

host &＃61; mysql:3306

name &＃61; grafana

user &＃61; grafana

password &＃61; grafana

url &＃61; mysql://grafana:grafana&＃64;mysql:3306/grafana

[session]

provider &＃61; mysql

provider_config &＃61; &＃96;grafana:grafana&＃64;tcp(mysql:3306)/grafana&＃96;

COOKIE_name &＃61; grafana_session

COOKIE_secure &＃61; false

session_life_time &＃61; 86400

启动服务

docker-compose -f docker-compose-grafana-mysql.yml up -d

登录数据库查看信息

docker exec -it mysql bash

mysql -ugrafana -pgrafana

mysql> use grafana;

mysql> show tables;

可查看到相关的数据表