Skip to content

Commit b1d9621

Browse files
judasnjudasn
committed
🚧 Elasticsearch
1 parent 6fb9561 commit b1d9621

File tree

3 files changed

+83
-109
lines changed

3 files changed

+83
-109
lines changed

‎markdown-file/ELK-Install-And-Settings.md‎

Lines changed: 0 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -26,30 +26,6 @@
2626

2727
- 请看 logstash 专题文：[logstash 相关知识](Logstash-Base.md)
2828

29-
### 安装 Kibana
30-
31-
- 选择一台机子安装即可，我选择：192.168.1.127 这台
32-
- 切换到存放目录：`cd /usr/program/elk`
33-
- 解压：`tar zxvf kibana-4.6.1-linux-x86_64.tar.gz`
34-
- 修改配置文件：`vim /usr/program/elk/kibana-4.6.1-linux-x86_64/config/kibana.yml`，打开下面注释并配置：
35-
36-
``` nginx
37-
server.port: 5601 #端口
38-
server.host: "192.168.1.127" #访问ip地址
39-
elasticsearch.url: "http://192.168.1.127:9200" #连接elastic
40-
kibana.index: ".kibana" #在elastic中添加.kibana索引
41-
```
42-
43-
- 记得先切换到 elasticsearch 用户下，然后先启动 elasticsearch。先确保 elasticsearch 集群是启动的。
44-
- 再切换到 root 用户下，启动 kibana
45-
- 带控制台的启动（比较慢）：`/usr/program/elk/kibana-4.6.1-linux-x86_64/bin/kibana`
46-
- 守护进程方式启动：`/usr/program/elk/kibana-4.6.1-linux-x86_64/bin/kibana -d`
47-
- 守护进程方式停止：`ps -ef|grep kibana`，只能通过 kill pid 来结束
48-
- 然后你可以访问：`http://192.168.1.127:5601`，可以看到 kibana 的相关界面。
49-
- 在 logstash 安装这一步，如果你刚刚有按着我说的去做一个 elasticsearch 索引，那你此时不会看到这样的提示：`Unable to fetch mapping. Do you have indices matching the pattern?`
50-
- 此时你可以直接点击 `create` 统计 `logstash-*` 格式的索引结果，看到相关内容
51-
- 如果你知道你的索引名称的规则，比如我现在要统计 Tomcat 的相关索引，我的索引名称是：`tomcat-log-*`，则我输入这个，点击：create 即可。
52-
- kibana 的高级用法请看我单独的一篇文章：[kibana 相关知识](Kibana-Base.md)
5329

5430

5531
## 资料

‎markdown-file/Elasticsearch-Base.md‎

Lines changed: 29 additions & 83 deletions
Original file line numberDiff line numberDiff line change
@@ -122,94 +122,40 @@ type=rpm-md
122122

123123
- 如果就单个节点测试，新建索引的时候副本数记得填 0。
124124

125-
#### 批量增加 / 删除测试数据
125+
#### 创建索引并设置 mapping
126126

127-
- 官网文档：<https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html>
128-
- 批量增加，接口地址：`POST /_bulk`
127+
- 官网类型说明：<https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping.html>
129128

130129
```
131-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100001" } }
132-
{ "post_date" : "2018-12-01 10:00:00", "request_num" : 1 }
133-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100002" } }
134-
{ "post_date" : "2018-12-01 10:00:05", "request_num" : 2 }
135-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100003" } }
136-
{ "post_date" : "2018-12-01 10:00:10", "request_num" : 3 }
137-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100004" } }
138-
{ "post_date" : "2018-12-01 10:00:15", "request_num" : 4 }
139-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100005" } }
140-
{ "post_date" : "2018-12-01 10:00:20", "request_num" : 5 }
141-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100006" } }
142-
{ "post_date" : "2018-12-01 10:00:25", "request_num" : 6 }
143-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100007" } }
144-
{ "post_date" : "2018-12-01 10:00:30", "request_num" : 7 }
145-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100008" } }
146-
{ "post_date" : "2018-12-01 10:00:35", "request_num" : 8 }
147-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100009" } }
148-
{ "post_date" : "2018-12-01 10:00:40", "request_num" : 9 }
149-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100010" } }
150-
{ "post_date" : "2018-12-01 10:00:45", "request_num" : 10 }
151-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100011" } }
152-
{ "post_date" : "2018-12-01 10:00:50", "request_num" : 1 }
153-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100012" } }
154-
{ "post_date" : "2018-12-01 10:00:55", "request_num" : 2 }
155-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100013" } }
156-
{ "post_date" : "2018-12-01 10:01:00", "request_num" : 3 }
157-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100014" } }
158-
{ "post_date" : "2018-12-01 10:01:05", "request_num" : 4 }
159-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100015" } }
160-
{ "post_date" : "2018-12-01 10:01:10", "request_num" : 5 }
161-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100016" } }
162-
{ "post_date" : "2018-12-01 10:01:15", "request_num" : 6 }
163-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100017" } }
164-
{ "post_date" : "2018-12-01 10:01:20", "request_num" : 7 }
165-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100018" } }
166-
{ "post_date" : "2018-12-01 10:01:25", "request_num" : 8 }
167-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100019" } }
168-
{ "post_date" : "2018-12-01 10:01:30", "request_num" : 9 }
169-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100020" } }
170-
{ "post_date" : "2018-12-01 10:01:35", "request_num" : 10 }
171-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100021" } }
172-
{ "post_date" : "2018-12-01 10:01:40", "request_num" : 1 }
173-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100022" } }
174-
{ "post_date" : "2018-12-01 10:01:45", "request_num" : 2 }
175-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100023" } }
176-
{ "post_date" : "2018-12-01 10:01:50", "request_num" : 3 }
177-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100024" } }
178-
{ "post_date" : "2018-12-01 10:01:55", "request_num" : 4 }
179-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100025" } }
180-
{ "post_date" : "2018-12-01 10:02:00", "request_num" : 5 }
181-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100026" } }
182-
{ "post_date" : "2018-12-01 10:02:05", "request_num" : 6 }
183-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100027" } }
184-
{ "post_date" : "2018-12-01 10:02:10", "request_num" : 7 }
185-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100028" } }
186-
{ "post_date" : "2018-12-01 10:02:15", "request_num" : 8 }
187-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100029" } }
188-
{ "post_date" : "2018-12-01 10:02:20", "request_num" : 9 }
189-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100030" } }
190-
{ "post_date" : "2018-12-01 10:02:25", "request_num" : 10 }
191-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100031" } }
192-
{ "post_date" : "2018-12-01 10:02:30", "request_num" : 1 }
193-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100032" } }
194-
{ "post_date" : "2018-12-01 10:02:35", "request_num" : 2 }
195-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100033" } }
196-
{ "post_date" : "2018-12-01 10:02:40", "request_num" : 3 }
197-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100034" } }
198-
{ "post_date" : "2018-12-01 10:02:45", "request_num" : 4 }
199-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100035" } }
200-
{ "post_date" : "2018-12-01 10:02:50", "request_num" : 5 }
201-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100036" } }
202-
{ "post_date" : "2018-12-01 10:02:55", "request_num" : 6 }
203-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100037" } }
204-
{ "post_date" : "2018-12-01 10:03:00", "request_num" : 7 }
205-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100038" } }
206-
{ "post_date" : "2018-12-01 10:03:05", "request_num" : 8 }
207-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100039" } }
208-
{ "post_date" : "2018-12-01 10:03:10", "request_num" : 9 }
209-
{ "index" : { "_index" : "grafanadb", "_type" : "radar", "_id" : "100040" } }
210-
{ "post_date" : "2018-12-01 10:03:15", "request_num" : 10 }
130+
curl -XPUT 'http://127.0.0.1:9200/grafanadb' -H 'Content-Type: application/json' -d'
131+
{
132+
"settings": {
133+
"refresh_interval": "5s",
134+
"number_of_shards": 5,
135+
"number_of_replicas": 0
136+
},
137+
"mappings": {
138+
"radar": {
139+
"properties": {
140+
"request_num": {
141+
"type": "long"
142+
},
143+
"post_date": {
144+
"type": "date",
145+
"format": "yyyy-MM-dd HH:mm:ss||epoch_millis"
146+
}
147+
}
148+
}
149+
}
150+
}
151+
'
211152
```
212153

154+
155+
#### 批量增加 / 删除测试数据
156+
157+
- 官网文档：<https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html>
158+
- 批量增加，接口地址：`POST /_bulk`
213159
- cURL 格式：
214160

215161
```

‎markdown-file/Kibana-Base.md‎

Lines changed: 54 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,64 @@
22

33
## 基础知识
44

5-
- 官网文档：<https://www.elastic.co/guide/en/kibana/5.2/getting-started.html>
5+
- 官网文档：<https://www.elastic.co/guide/en/kibana/current/getting-started.html>
66

7+
### 安装 Kibana
78

8-
## 案例
9+
- CentOS 7.4
10+
- 至少需要 500M 内存
11+
- 官网文档：<https://www.elastic.co/guide/en/kibana/current/install.html>
12+
- 官网文档 CentOS：<https://www.elastic.co/guide/en/kibana/current/rpm.html>
13+
- 添加 KEY：`rpm --import https://artifacts.elastic.co/GPG-KEY-elasticsearch`
14+
- 添加源：`vim /etc/yum.repos.d/kibana.repo`
915

16+
```
17+
[kibana-6.x]
18+
name=Kibana repository for 6.x packages
19+
baseurl=https://artifacts.elastic.co/packages/6.x/yum
20+
gpgcheck=1
21+
gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticsearch
22+
enabled=1
23+
autorefresh=1
24+
type=rpm-md
25+
```
1026

27+
- 开始安装：`yum install -y kibana`，预计文件有 200M 左右，国内网络安装可能会很慢，慢慢等
28+
- 安装完后会多了一个：kibana 用户和组
29+
- 启动和停止软件（默认是不启动的）：
30+
- 启动：`systemctl start kibana.service`
31+
- 状态：`systemctl status kibana.service`
32+
- 停止：`systemctl stop kibana.service`
33+
- 重新启动：`systemctl restart kibana.service`
34+
- 安装完成后，增加系统自启动：
35+
- `/bin/systemctl daemon-reload`
36+
- `/bin/systemctl enable kibana.service`
37+
38+
#### RPM 安装后的一些配置位置说明
39+
40+
- 官网文档 CentOS：<https://www.elastic.co/guide/en/kibana/current/rpm.html>
41+
- 配置文件的参数说明：<https://www.elastic.co/guide/en/kibana/6.5/settings.html>
42+
- kibana 安装后位置：`/usr/share/kibana`
43+
- kibana 的配置文件：`/etc/kibana/kibana.yml`
44+
- Log 位置：`/var/log/kibana/`
45+
- 数据位置：`/var/lib/kibana`
46+
- 插件位置：`/usr/share/kibana/plugins`
47+
48+
49+
#### 配置
50+
51+
- 编辑配置文件：`vim /etc/kibana/kibana.yml`
52+
- 默认只能 localhost 访问，修改成支持外网访问
53+
54+
```
55+
打开这个注释：#server.host: "localhost"
56+
改为：server.host: "0.0.0.0"
57+
```
58+
59+
- 然后你可以访问：`http://192.168.0.105:5601`，可以看到 kibana 的相关界面。
60+
- 在 logstash 安装这一步，如果你刚刚有按着我说的去做一个 elasticsearch 索引，那你此时不会看到这样的提示：`Unable to fetch mapping. Do you have indices matching the pattern?`
61+
- 此时你可以直接点击 `create` 统计 `logstash-*` 格式的索引结果，看到相关内容
62+
- 如果你知道你的索引名称的规则，比如我现在要统计 Tomcat 的相关索引，我的索引名称是：`tomcat-log-*`，则我输入这个，点击：create 即可。
1163

1264

1365
## 资料

0 commit comments

Comments
 (0)