{"id":40886,"date":"2023-04-05T05:33:19","date_gmt":"2023-04-12T18:01:19","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/"},"modified":"2024-04-29T21:59:37","modified_gmt":"2024-04-29T13:59:37","slug":"%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/","title":{"rendered":"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09"},"content":{"rendered":"<h1>\u9996\u5148<\/h1>\n<p>\u8fd9\u662f\u5173\u4e8e\u5728Microsoft Azure AKS\u4e0a\u642d\u5efa\u57fa\u4e8ePrometheus\u548cGrafana\u7684\u8d44\u6e90\u76d1\u63a7\uff0c\u4ee5\u53ca\u57fa\u4e8eElasticsearch\u3001fluentd\u548cKibana\u7684\u65e5\u5fd7\u805a\u5408\uff0c\u8fd8\u6709\u57fa\u4e8eGrafana\u7684\u8d44\u6e90\u548c\u65e5\u5fd7\u62a5\u8b66\u901a\u77e5\u7684\u7cfb\u5217\u6587\u7ae0\u7684\u7b2c\u4e8c\u90e8\u5206\u3002<\/p>\n<p>\u7b2c\u4e00\u56de\uff1ahttps:\/\/qiita.com\/nmatsui\/items\/6d8319f3216bd8786eb9<br \/>\n\u7b2c\u4e8c\u56de\uff1ahttps:\/\/qiita.com\/nmatsui\/items\/ef7cf8f5c957f82d2ca1<\/p>\n<p>\u7b2c\u4e00\u56de\uff1ahttps:\/\/qiita.com\/nmatsui\/items\/6d8319f3216bd8786eb9<br \/>\n\u7b2c\u4e8c\u56de\uff1ahttps:\/\/qiita.com\/nmatsui\/items\/ef7cf8f5c957f82d2ca1<\/p>\n<p>\u4e0a\u4e00\u6b21\uff0c\u6211\u4eec\u5728Azure AKS\u4e0a\u6784\u5efa\u4e86Prometheus\u548cGrafana\uff0c\u5e76\u89e3\u91ca\u4e86\u5982\u4f55\u8fdb\u884c\u8d44\u6e90\u76d1\u63a7\u3002\u8fd9\u4e00\u6b21\uff0c\u6211\u4eec\u5c06\u5728Azure AKS\u4e0a\u542f\u52a8Elasticsearch + Fluentd + Kibana\uff0c\u5c06\u5404\u4e2a\u8282\u70b9\u548cPod\u7684\u65e5\u5fd7\u6536\u96c6\u8d77\u6765\uff0c\u5e76\u4f7f\u7528Curator\u8fdb\u884c\u5220\u9664\u64cd\u4f5c\uff0c\u5982\u679c\u65e5\u5fd7\u4e2d\u5b58\u5728\u7279\u5b9a\u7684\u5b57\u7b26\u4e32\uff0c\u5219\u901a\u8fc7Grafana\u5411Slack\u53d1\u9001\u901a\u77e5\u3002<\/p>\n<h1>\u9a8c\u8bc1\u73af\u5883<\/h1>\n<ul class=\"post-ul\">\u30af\u30e9\u30a6\u30c9\u5074<\/ul>\n<div>\n<div class=\"post-table\">\n\u30d0\u30fc\u30b8\u30e7\u30f3Microsoft Azure AKS1.11.1<\/div>\n<\/div>\n<ul class=\"post-ul\">\u30af\u30e9\u30a4\u30a2\u30f3\u30c8\u5074<\/ul>\n<div>\n<div class=\"post-table\">\n\u30d0\u30fc\u30b8\u30e7\u30f3kubectl1.11.2azure-cli2.0.44helm2.9.1<\/div>\n<\/div>\n<p>\u9a8c\u8bc1\u6240\u4f7f\u7528\u7684YAML\u7b49\u8be6\u7ec6\u4fe1\u606f\u5df2\u5728GitHub\u4e0a\u516c\u5f00\u3002\u8bf7\u53c2\u8003nmatsui\/kubernetes-monitoring\u3002<\/p>\n<h1>\u73af\u5883\u5efa\u8bbe<\/h1>\n<h2>\u786e\u8ba4Microsoft Azure AKS<\/h2>\n<p>\u6211\u4eec\u5c06\u7ee7\u7eed\u4f7f\u7528\u4e0a\u4e00\u6b21\u521b\u5efa\u7684Azure AKS\u73af\u5883\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>az aks show <span class=\"nt\">--resource-group<\/span> k8s <span class=\"nt\">--name<\/span> k8saks\r\n<span class=\"nv\">$ <\/span>az aks get-credentials <span class=\"nt\">--resource-group<\/span> k8s <span class=\"nt\">--name<\/span> k8saks\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get nodes\r\nNAME                       STATUS    ROLES     AGE       VERSION\r\naks-nodepool1-14983502-0   Ready     agent     6h        v1.11.1\r\naks-nodepool1-14983502-1   Ready     agent     6h        v1.11.1\r\naks-nodepool1-14983502-2   Ready     agent     6h        v1.11.1\r\n<\/code><\/pre>\n<h2>\u5b89\u88c5 Elasticsearch + Fluentd + Kibana\u3002<\/h2>\n<p>\u5728\u4e4b\u524d\uff0c\u6211\u4f7f\u7528\u4e86\u7ecf\u8fc7CoreOS\u7cbe\u5fc3\u5236\u4f5c\u7684Helm Chart\uff0c\u5feb\u901f\u5b89\u88c5\u4e86Prometheus + Grafana\uff08\u5c3d\u7ba1\u9700\u8981\u8fdb\u884c\u4e00\u4e9b\u4fee\u8865\u4ee5\u9002\u5e94Azure AKS\uff0c\u4f46\u8fd9\u4e00\u70b9\u5e76\u4e0d\u5bb9\u6613\uff09\u3002\u7136\u800c\uff0c\u5bf9\u4e8eElasticsearch + Fluentd + Kibana\uff0c\u6211\u627e\u4e0d\u5230\u4e00\u4e2a\u5b8c\u6574\u7684Helm Chart\u6765\u4e00\u952e\u5b89\u88c5\uff08\u5c3d\u7ba1\u4e2a\u4eba\u6709\u516c\u5f00\u7684Helm Chart\u53ef\u7528\uff0c\u4f46\u66f4\u65b0\u7248\u672c\u7684\u8ffd\u8e2a\u4e0d\u592a\u7406\u60f3\uff09\u3002<\/p>\n<p>\u6240\u4ee5\u8fd9\u6b21\uff0c\u6211\u4eec\u51b3\u5b9a\u4fee\u6539Kubernetes\u6838\u5fc3\u4ed3\u5e93\u4e2d\u7684Elasticsearch\u9644\u52a0\u7ec4\u4ef6\u5e76\u4f7f\u7528\u5b83\u3002\u4ece\u76ee\u524d\u6765\u770b\uff0c\u8be5\u4ed3\u5e93\u5f97\u5230\u4e86\u5f88\u597d\u7684\u7ef4\u62a4\uff0c\u5e76\u4e14fluentd\u7684\u89c4\u5219\u4e5f\u76f4\u63a5\u5b58\u50a8\u5728configmap\u4e2d\uff0c\u8fd9\u4f7f\u5f97\u5b83\u6613\u4e8e\u5904\u7406\u3002<\/p>\n<h3>\u5b89\u88c5Elasticsearch<\/h3>\n<h4>\u6ce8\u518cElasticsearch\u7684StatefulSet<\/h4>\n<p>\u5c06Elasticsearch\u4f5c\u4e3aStatefulSet\u8fdb\u884c\u5b89\u88c5\u3002\u526f\u672c\u6570\u91cf\u8bbe\u5b9a\u4e3a\u6700\u5c0f\u76842\u4e2a\u3002\u6765\u81eakubernetes\/cluster\/addons\/fluentd-elasticsearch\/es-statefulset.yaml\u6587\u4ef6\u7684\u66f4\u6539\u6709\u4ee5\u4e0b\u4e24\u70b9\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">namespace\u3092kube-system\u304b\u3089monitoring\u306b\u5909\u66f4<\/ul>\n<\/li>\n<\/ul>\n<p>\u524d\u56demonitoring\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u305fGrafana\u3068\u9023\u643a\u3067\u304d\u308b\u3088\u3046\u306b\u3059\u308b\u305f\u3081<\/p>\n<p>\u30c7\u30fc\u30bf\u9818\u57df\u306f\u3001pod\u306eemptyDir\u3067\u306f\u306a\u304fPersistentVolume\u3092\u4f7f\u7528<\/p>\n<p>\u8bf7\u6839\u636e\u9700\u8981\u9002\u5f53\u8c03\u6574\u6570\u636e\u9886\u57df\u7684\u5927\u5c0f\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"p\">@@ -3,7 +3,7 @@<\/span>\r\n kind: ServiceAccount\r\n metadata:\r\n   name: elasticsearch-logging\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: elasticsearch-logging\r\n     kubernetes.io\/cluster-service: \"true\"\r\n<span class=\"p\">@@ -30,7 +30,7 @@<\/span>\r\n kind: ClusterRoleBinding\r\n apiVersion: rbac.authorization.k8s.io\/v1\r\n metadata:\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   name: elasticsearch-logging\r\n   labels:\r\n     k8s-app: elasticsearch-logging\r\n<span class=\"p\">@@ -39,7 +39,7 @@<\/span>\r\n subjects:\r\n - kind: ServiceAccount\r\n   name: elasticsearch-logging\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   apiGroup: \"\"\r\n roleRef:\r\n   kind: ClusterRole\r\n<span class=\"p\">@@ -51,7 +51,7 @@<\/span>\r\n kind: StatefulSet\r\n metadata:\r\n   name: elasticsearch-logging\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: elasticsearch-logging\r\n     version: v6.2.5\r\n<span class=\"p\">@@ -96,9 +96,6 @@<\/span>\r\n           valueFrom:\r\n             fieldRef:\r\n               fieldPath: metadata.namespace\r\n<span class=\"gd\">-      volumes:\r\n-      - name: elasticsearch-logging\r\n-        emptyDir: {}\r\n<\/span>       # Elasticsearch requires vm.max_map_count to be at least 262144.\r\n       # If your OS already sets up this number to a higher value, feel free\r\n       # to remove this init container.\r\n<span class=\"p\">@@ -108,3 +105,12 @@<\/span>\r\n         name: elasticsearch-logging-init\r\n         securityContext:\r\n           privileged: true\r\n<span class=\"gi\">+  volumeClaimTemplates:\r\n+  - metadata:\r\n+      name: elasticsearch-logging\r\n+    spec:\r\n+      accessModes: [\"ReadWriteOnce\"]\r\n+      storageClassName: managed-premium\r\n+      resources:\r\n+        requests:\r\n+          storage: 64Gi\r\n<\/span><\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/es-statefulset.yaml\r\n<\/code><\/pre>\n<p>\u6570\u5206\u949f\u540e\uff0c\u53ef\u4ee5\u786e\u8ba4Elasticsearch\u7684StatefulSet\u548cPod\u4ee5\u53caPersistentVolume\u5df2\u7ecf\u6210\u529f\u6784\u5efa\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get statefulsets <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-logging\r\nNAME                    DESIRED   CURRENT   AGE\r\nelasticsearch-logging   2         2         6m\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get pods <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-logging\r\nNAME                      READY     STATUS    RESTARTS   AGE\r\nelasticsearch-logging-0   1\/1       Running   0          7m\r\nelasticsearch-logging-1   1\/1       Running   0          4m\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get persistentvolumeclaims <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-logging\r\nNAME                                            STATUS    VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS      AGE\r\nelasticsearch-logging-elasticsearch-logging-0   Bound     pvc-a1c884f6-a36d-11e8-8990-caec6aa008cf   64Gi       RWO            managed-premium   7m\r\nelasticsearch-logging-elasticsearch-logging-1   Bound     pvc-f4494adf-a36d-11e8-8990-caec6aa008cf   64Gi       RWO            managed-premium   5m\r\n<\/code><\/pre>\n<h4>\u6ce8\u518c Elasticsearch \u7684\u670d\u52a1<\/h4>\n<p>\u540c\u6837\u5730\uff0c\u6211\u4eec\u5c06\u547d\u540d\u7a7a\u95f4\u4ecekube-system\u66f4\u6539\u4e3amonitoring\uff0c\u5e76\u6784\u5efaElasticsearch\u7684\u670d\u52a1\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"p\">@@ -2,7 +2,7 @@<\/span>\r\n kind: Service\r\n metadata:\r\n   name: elasticsearch-logging\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: elasticsearch-logging\r\n     kubernetes.io\/cluster-service: \"true\"\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/es-service.yaml\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get services <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-logging\r\nNAME                    TYPE        CLUSTER-IP     EXTERNAL-IP   PORT<span class=\"o\">(<\/span>S<span class=\"o\">)<\/span>    AGE\r\nelasticsearch-logging   ClusterIP   10.0.150.102   &lt;none&gt;        9200\/TCP   1m\r\n<\/code><\/pre>\n<h4>Elasticsearch\u7684\u914d\u7f6e<\/h4>\n<p>\u5728\u542f\u52a8StatefulSet\u65f6\uff0c\u5c06\u81ea\u52a8\u6267\u884c\u7fa4\u96c6\u5316\u64cd\u4f5c\uff0c\u5e76\u5141\u8bb8\u79fb\u52a8Shard\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl <span class=\"nb\">exec<\/span> <span class=\"nt\">-it<\/span> elasticsearch-logging-0 <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">--<\/span> curl <span class=\"nt\">-H<\/span> <span class=\"s2\">\"Content-Type: application\/json\"<\/span> <span class=\"nt\">-X<\/span> PUT http:\/\/elasticsearch-logging:9200\/_cluster\/settings <span class=\"nt\">-d<\/span> <span class=\"s1\">'{\"transient\": {\"cluster.routing.allocation.enable\":\"all\"}}'<\/span>\r\n<\/code><\/pre>\n<p>\u5728\u8fd9\u4e2a\u9636\u6bb5\uff0cElasticsearch\u53ef\u4ee5\u4f5c\u4e3a\u4e00\u4e2a\u7531\u4e24\u4e2a\u8282\u70b9\u7ec4\u6210\u7684\u96c6\u7fa4\u53ef\u7528\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl <span class=\"nb\">exec<\/span> <span class=\"nt\">-it<\/span> elasticsearch-logging-0 <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">--<\/span> curl <span class=\"nt\">-H<\/span> <span class=\"s2\">\"Content-Type: application\/json\"<\/span> http:\/\/elasticsearch-logging:9200\/_cluster\/health?pretty<span class=\"o\">=<\/span><span class=\"nb\">true<\/span>\r\n<span class=\"o\">{<\/span>\r\n  <span class=\"s2\">\"cluster_name\"<\/span> : <span class=\"s2\">\"kubernetes-logging\"<\/span>,\r\n  <span class=\"s2\">\"status\"<\/span> : <span class=\"s2\">\"green\"<\/span>,\r\n  <span class=\"s2\">\"timed_out\"<\/span> : <span class=\"nb\">false<\/span>,\r\n  <span class=\"s2\">\"number_of_nodes\"<\/span> : 2,\r\n  <span class=\"s2\">\"number_of_data_nodes\"<\/span> : 2,\r\n  <span class=\"s2\">\"active_primary_shards\"<\/span> : 0,\r\n  <span class=\"s2\">\"active_shards\"<\/span> : 0,\r\n  <span class=\"s2\">\"relocating_shards\"<\/span> : 0,\r\n  <span class=\"s2\">\"initializing_shards\"<\/span> : 0,\r\n  <span class=\"s2\">\"unassigned_shards\"<\/span> : 0,\r\n  <span class=\"s2\">\"delayed_unassigned_shards\"<\/span> : 0,\r\n  <span class=\"s2\">\"number_of_pending_tasks\"<\/span> : 0,\r\n  <span class=\"s2\">\"number_of_in_flight_fetch\"<\/span> : 0,\r\n  <span class=\"s2\">\"task_max_waiting_in_queue_millis\"<\/span> : 0,\r\n  <span class=\"s2\">\"active_shards_percent_as_number\"<\/span> : 100.0\r\n<span class=\"o\">}<\/span>\r\n<\/code><\/pre>\n<h3>\u5b89\u88c5Fluentd<\/h3>\n<h4>Fluentd\u7684configmap\u6ce8\u518c<\/h4>\n<p>\u5c06\u547d\u540d\u7a7a\u95f4\u4ecekube-system\u66f4\u6539\u4e3amonitoring\uff0c\u5e76\u6ce8\u518cFluentd\u7684configmap\u3002\u5982\u679c\u6709\u4e0d\u9700\u8981\u7684\u65e5\u5fd7\u7b49\u5185\u5bb9\uff0c\u53ef\u4ee5\u5728\u6b64\u9636\u6bb5\u8fdb\u884c\u8fc7\u6ee4\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"p\">@@ -2,7 +2,7 @@<\/span>\r\n apiVersion: v1\r\n metadata:\r\n   name: fluentd-es-config-v0.1.4\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     addonmanager.kubernetes.io\/mode: Reconcile\r\n data:\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/fluentd-es-configmap.yaml\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get configmap <span class=\"nt\">--namespace<\/span> monitoring | <span class=\"nb\">grep <\/span>fluentd\r\nfluentd-es-config-v0.1.4             6         48s\r\n<\/code><\/pre>\n<h4>\u4ee5DaemonSet\u65b9\u5f0f\u6ce8\u518cFluentd<\/h4>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/46-0.png\" alt=\"node-logging agent pattern\" \/><\/div>\n<blockquote><p>\u51fa\u5c55\uff1ahttps:\/\/kubernetes.io\/docs\/concepts\/cluster-administration\/logging\/<\/p><\/blockquote>\n<p>Fluentd\u4f5c\u4e3aDaemonSet\u542f\u52a8\uff0c\u4f46\u4e0ekubernetes\/cluster\/addons\/fluentd-elasticsearch\/fluentd-es-ds.yaml\u6587\u4ef6\u76f8\u6bd4\uff0c\u505a\u4e86\u4ee5\u4e0b\u4e09\u70b9\u4fee\u6539\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">namespace\u3092kube-system\u304b\u3089monitoring\u306b\u5909\u66f4<\/ul>\n<\/li>\n<\/ul>\n<p>priorityClassName\u306f\u5b9a\u7fa9\u3057\u306a\u3044<\/p>\n<p>2018\/08\/19\u6642\u70b9\u3067\u306f\u3001Azure AKS\u306fpriorityClass\u306e\u4f5c\u6210\u304c\u3067\u304d\u306a\u3044\u6a21\u69d8\uff08\u6b21\u306e\u3088\u3046\u306a\u30a8\u30e9\u30fc\u306b\u306a\u308b\uff09<br \/>\nno matches for kind &#8220;PriorityClass&#8221; in version &#8220;scheduling.k8s.io\/v1alpha1&#8221;<\/p>\n<p>nodeSelector\u3092\u524a\u9664<\/p>\n<p>Azure AKS\u306enode\u306b\u306f\u3001fluentd-ds-ready\u306e\u3088\u3046\u306a\u30e9\u30d9\u30eb\u306f\u4ed8\u3044\u3066\u3044\u306a\u3044\u305f\u3081<\/p>\n<pre class=\"post-pre\"><code><span class=\"p\">@@ -2,7 +2,7 @@<\/span>\r\n kind: ServiceAccount\r\n metadata:\r\n   name: fluentd-es\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: fluentd-es\r\n     kubernetes.io\/cluster-service: \"true\"\r\n<span class=\"p\">@@ -38,7 +38,7 @@<\/span>\r\n subjects:\r\n - kind: ServiceAccount\r\n   name: fluentd-es\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   apiGroup: \"\"\r\n roleRef:\r\n   kind: ClusterRole\r\n<span class=\"p\">@@ -49,7 +49,7 @@<\/span>\r\n kind: DaemonSet\r\n metadata:\r\n   name: fluentd-es-v2.2.0\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: fluentd-es\r\n     version: v2.2.0\r\n<span class=\"p\">@@ -73,7 +73,7 @@<\/span>\r\n         scheduler.alpha.kubernetes.io\/critical-pod: ''\r\n         seccomp.security.alpha.kubernetes.io\/pod: 'docker\/default'\r\n     spec:\r\n<span class=\"gd\">-      priorityClassName: system-node-critical\r\n<\/span><span class=\"gi\">+      # priorityClassName: system-node-critical\r\n<\/span>       serviceAccountName: fluentd-es\r\n       containers:\r\n       - name: fluentd-es\r\n<span class=\"p\">@@ -95,8 +95,6 @@<\/span>\r\n           readOnly: true\r\n         - name: config-volume\r\n           mountPath: \/etc\/fluent\/config.d\r\n<span class=\"gd\">-      nodeSelector:\r\n-        beta.kubernetes.io\/fluentd-ds-ready: \"true\"\r\n<\/span>       terminationGracePeriodSeconds: 30\r\n       volumes:\r\n       - name: varlog\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/fluentd-es-ds.yaml\r\n<\/code><\/pre>\n<p>\u6211\u4f1a\u68c0\u67e5\u6bcf\u4e2a\u8282\u70b9\u4e0a\u662f\u5426\u90fd\u5df2\u7ecf\u542f\u52a8\u4e86\u4e00\u4e2aFluentd\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get daemonsets <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>fluentd-es\r\nNAME                DESIRED   CURRENT   READY     UP-TO-DATE   AVAILABLE   NODE SELECTOR   AGE\r\nfluentd-es-v2.2.0   3         3         3         3            3           &lt;none&gt;          40s\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get pods <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>fluentd-es <span class=\"nt\">-o<\/span> wide\r\nNAME                      READY     STATUS    RESTARTS   AGE       IP           NODE\r\nfluentd-es-v2.2.0-5dcnm   1\/1       Running   0          1m        10.244.1.9   aks-nodepool1-14983502-2\r\nfluentd-es-v2.2.0-qrlws   1\/1       Running   0          1m        10.244.2.9   aks-nodepool1-14983502-1\r\nfluentd-es-v2.2.0-sfw8j   1\/1       Running   0          1m        10.244.0.8   aks-nodepool1-14983502-0\r\n<\/code><\/pre>\n<h3>\u5b89\u88c5Kibana<\/h3>\n<h4>Kibana\u90e8\u7f72\u7684\u6ce8\u518c<\/h4>\n<p>\u53ea\u8981Kibana\u81ea\u8eab\u91cd\u65b0\u542f\u52a8\uff0c\u5373\u4f7f\u5d29\u6e83\u4e5f\u6ca1\u6709\u95ee\u9898\uff0c\u56e0\u6b64\u6211\u4eec\u9009\u62e9\u4f7f\u75281\u4e2a\u526f\u672c\u6765\u542f\u52a8\u3002\u6211\u4eec\u5728kubernetes\/cluster\/addons\/fluentd-elasticsearch\/kibana-deployment.yaml\u4e2d\u8fdb\u884c\u4e86\u4ee5\u4e0b\u4e24\u4e2a\u66f4\u6539\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">namespace\u3092kube-system\u304b\u3089monitoring\u306b\u5909\u66f4<\/ul>\n<\/li>\n<\/ul>\n<p>SERVER_BASEPATH\u74b0\u5883\u5909\u6570\u3092\u524a\u9664<\/p>\n<p>proxy\u3067\u306f\u306a\u304fport-forward\u3067\u63a5\u7d9a\u3059\u308b\u305f\u3081<\/p>\n<pre class=\"post-pre\"><code><span class=\"p\">@@ -2,7 +2,7 @@<\/span>\r\n kind: Deployment\r\n metadata:\r\n   name: kibana-logging\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: kibana-logging\r\n     kubernetes.io\/cluster-service: \"true\"\r\n<span class=\"p\">@@ -31,8 +31,6 @@<\/span>\r\n         env:\r\n           - name: ELASTICSEARCH_URL\r\n             value: http:\/\/elasticsearch-logging:9200\r\n<span class=\"gd\">-          - name: SERVER_BASEPATH\r\n-            value: \/api\/v1\/namespaces\/kube-system\/services\/kibana-logging\/proxy\r\n<\/span>         ports:\r\n         - containerPort: 5601\r\n           name: ui\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/kibana-deployment.yaml\r\n<\/code><\/pre>\n<p>\u6211\u8981\u786e\u8ba4\u53ea\u6709\u4e00\u4e2a Kibana \u7684 pod \u88ab\u542f\u52a8\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get deployments <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>kibana-logging\r\nNAME             DESIRED   CURRENT   UP-TO-DATE   AVAILABLE   AGE\r\nkibana-logging   1         1         1            0           1m\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get pods <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>kibana-logging\r\nNAME                              READY     STATUS    RESTARTS   AGE\r\nkibana-logging-7444956bf8-55dd6   1\/1       Running   0          1m\r\n<\/code><\/pre>\n<h4>Kibana\u7684\u670d\u52a1\u6ce8\u518c<\/h4>\n<p>\u6211\u9700\u8981\u5c06namespace\u4ecekube-system\u66f4\u6539\u4e3amonitoring\uff0c\u5e76\u6784\u5efaKibana\u7684Service\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"p\">@@ -2,7 +2,7 @@<\/span>\r\n kind: Service\r\n metadata:\r\n   name: kibana-logging\r\n<span class=\"gd\">-  namespace: kube-system\r\n<\/span><span class=\"gi\">+  namespace: monitoring\r\n<\/span>   labels:\r\n     k8s-app: kibana-logging\r\n     kubernetes.io\/cluster-service: \"true\"\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/kibana-service.yaml\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get services <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>kibana-logging\r\nNAME             TYPE        CLUSTER-IP   EXTERNAL-IP   PORT<span class=\"o\">(<\/span>S<span class=\"o\">)<\/span>    AGE\r\nkibana-logging   ClusterIP   10.0.39.78   &lt;none&gt;        5601\/TCP   12s\r\n<\/code><\/pre>\n<h2>\u5b89\u88c5 Curator \u7684 CronJob<\/h2>\n<p>\u5230\u76ee\u524d\u4e3a\u6b62\uff0c\u6211\u4eec\u5df2\u7ecf\u5b8c\u6210\u4e86Elasticsearch + Fluentd + Kibana\u7684\u5b89\u88c5\uff0c\u4f46\u662fPersistentVolume\u7684\u5927\u5c0f\u662f\u6709\u9650\u7684\uff0c\u800c\u4e14\u9700\u8981\u5907\u4efd\u548c\u5220\u9664\u4e0d\u518d\u9700\u8981\u7684\u65e5\u5fd7\u3002\u56e0\u6b64\uff0c\u73b0\u5728\u8f6e\u5230Curator\u767b\u573a\u4e86\u3002<\/p>\n<p>\u8fd9\u6b21\u5c06\u628a\u5220\u9664\u4e24\u5929\u524d\u6216\u66f4\u65e9\u7684\u65e5\u5fd7\u4f5c\u4e3a\u6837\u672c\u6ce8\u518c\u8fdb\u884c\u64cd\u4f5c\u3002<\/p>\n<p>\u9996\u5148\uff0c\u6211\u4eec\u5c06Curator\u7684\u8bbe\u7f6e\u6ce8\u518c\u4e3aconfigmap\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"na\">apiVersion<\/span><span class=\"pi\">:<\/span> <span class=\"s\">v1<\/span>\r\n<span class=\"na\">kind<\/span><span class=\"pi\">:<\/span> <span class=\"s\">ConfigMap<\/span>\r\n<span class=\"na\">metadata<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">curator-config<\/span>\r\n  <span class=\"na\">namespace<\/span><span class=\"pi\">:<\/span> <span class=\"s\">monitoring<\/span>\r\n<span class=\"na\">data<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"s\">action_file.yml<\/span><span class=\"pi\">:<\/span> <span class=\"pi\">|-<\/span>\r\n    <span class=\"s\">---<\/span>\r\n    <span class=\"s\">actions:<\/span>\r\n      <span class=\"s\">1:<\/span>\r\n        <span class=\"s\">action: delete_indices<\/span>\r\n        <span class=\"s\">description: \"Clean up ES by deleting old indices\"<\/span>\r\n        <span class=\"s\">options:<\/span>\r\n          <span class=\"s\">timeout_override:<\/span>\r\n          <span class=\"s\">continue_if_exception: False<\/span>\r\n          <span class=\"s\">disable_action: False<\/span>\r\n          <span class=\"s\">ignore_empty_list: True<\/span>\r\n        <span class=\"s\">filters:<\/span>\r\n        <span class=\"s\">- filtertype: age<\/span>\r\n          <span class=\"s\">source: name<\/span>\r\n          <span class=\"s\">direction: older<\/span>\r\n          <span class=\"s\">timestring: '%Y.%m.%d'<\/span>\r\n          <span class=\"s\">unit: days<\/span>\r\n          <span class=\"s\">unit_count: 2<\/span>\r\n          <span class=\"s\">field:<\/span>\r\n          <span class=\"s\">stats_result:<\/span>\r\n          <span class=\"s\">epoch:<\/span>\r\n          <span class=\"s\">exclude: False<\/span>\r\n  <span class=\"s\">config.yml<\/span><span class=\"pi\">:<\/span> <span class=\"pi\">|-<\/span>\r\n    <span class=\"s\">---<\/span>\r\n    <span class=\"s\">client:<\/span>\r\n      <span class=\"s\">hosts:<\/span>\r\n        <span class=\"s\">- elasticsearch-logging<\/span>\r\n      <span class=\"s\">port: 9200<\/span>\r\n      <span class=\"s\">url_prefix:<\/span>\r\n      <span class=\"s\">use_ssl: False<\/span>\r\n      <span class=\"s\">certificate:<\/span>\r\n      <span class=\"s\">client_cert:<\/span>\r\n      <span class=\"s\">client_key:<\/span>\r\n      <span class=\"s\">ssl_no_validate: False<\/span>\r\n      <span class=\"s\">http_auth:<\/span>\r\n      <span class=\"s\">timeout: 30<\/span>\r\n      <span class=\"s\">master_only: False<\/span>\r\n    <span class=\"s\">logging:<\/span>\r\n      <span class=\"s\">loglevel: INFO<\/span>\r\n      <span class=\"s\">logfile:<\/span>\r\n      <span class=\"s\">logformat: default<\/span>\r\n      <span class=\"s\">blacklist: ['elasticsearch', 'urllib3']<\/span>\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/curator-configmap.yaml\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get configmap <span class=\"nt\">--namespace<\/span> monitoring | <span class=\"nb\">grep <\/span>curator\r\ncurator-config                       2         20s\r\n<\/code><\/pre>\n<p>\u63a5\u4e0b\u6765\uff0c\u60a8\u9700\u8981\u6839\u636e\u6b64\u8bbe\u7f6e\u5c06Curator\u4f5c\u4e3aJob\u5728CronJob\u4e2d\u6ce8\u518c\u3002\u4e3a\u4e86\u8bbe\u7f6eUTC\u542f\u52a8\u65f6\u95f4\u8868\uff0c\u60a8\u53ef\u4ee5\u6307\u5b9a\u4e3a0 18 * * *\uff0c\u8fd9\u6837Curator\u7684Job\u5c31\u4f1a\u6bcf\u5929\u5728\u65e5\u672c\u65f6\u95f4\u7684\u51cc\u66683\u70b9\u8fd0\u884c\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"na\">apiVersion<\/span><span class=\"pi\">:<\/span> <span class=\"s\">batch\/v1beta1<\/span>\r\n<span class=\"na\">kind<\/span><span class=\"pi\">:<\/span> <span class=\"s\">CronJob<\/span>\r\n<span class=\"na\">metadata<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">elasticsearch-curator<\/span>\r\n  <span class=\"na\">namespace<\/span><span class=\"pi\">:<\/span> <span class=\"s\">monitoring<\/span>\r\n  <span class=\"na\">labels<\/span><span class=\"pi\">:<\/span>\r\n    <span class=\"na\">k8s-app<\/span><span class=\"pi\">:<\/span> <span class=\"s\">elasticsearch-curator<\/span>\r\n<span class=\"na\">spec<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">schedule<\/span><span class=\"pi\">:<\/span> <span class=\"s2\">\"<\/span><span class=\"s\">0<\/span> <span class=\"s\">18<\/span> <span class=\"s\">*<\/span> <span class=\"s\">*<\/span> <span class=\"s\">*\"<\/span>\r\n  <span class=\"na\">successfulJobsHistoryLimit<\/span><span class=\"pi\">:<\/span> <span class=\"m\">1<\/span>\r\n  <span class=\"na\">failedJobsHistoryLimit<\/span><span class=\"pi\">:<\/span> <span class=\"m\">3<\/span>\r\n  <span class=\"na\">concurrencyPolicy<\/span><span class=\"pi\">:<\/span> <span class=\"s\">Forbid<\/span>\r\n  <span class=\"na\">startingDeadlineSeconds<\/span><span class=\"pi\">:<\/span> <span class=\"m\">120<\/span>\r\n  <span class=\"na\">jobTemplate<\/span><span class=\"pi\">:<\/span>\r\n    <span class=\"na\">spec<\/span><span class=\"pi\">:<\/span>\r\n      <span class=\"na\">template<\/span><span class=\"pi\">:<\/span>\r\n        <span class=\"na\">spec<\/span><span class=\"pi\">:<\/span>\r\n          <span class=\"na\">containers<\/span><span class=\"pi\">:<\/span>\r\n          <span class=\"pi\">-<\/span> <span class=\"na\">image<\/span><span class=\"pi\">:<\/span> <span class=\"s\">bobrik\/curator:5.5.4<\/span>\r\n            <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">curator<\/span>\r\n            <span class=\"na\">args<\/span><span class=\"pi\">:<\/span> <span class=\"pi\">[<\/span><span class=\"s2\">\"<\/span><span class=\"s\">--config\"<\/span><span class=\"pi\">,<\/span> <span class=\"s2\">\"<\/span><span class=\"s\">\/etc\/config\/config.yml\"<\/span><span class=\"pi\">,<\/span> <span class=\"s2\">\"<\/span><span class=\"s\">\/etc\/config\/action_file.yml\"<\/span><span class=\"pi\">]<\/span>\r\n            <span class=\"na\">volumeMounts<\/span><span class=\"pi\">:<\/span>\r\n            <span class=\"pi\">-<\/span> <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">config<\/span>\r\n              <span class=\"na\">mountPath<\/span><span class=\"pi\">:<\/span> <span class=\"s\">\/etc\/config<\/span>\r\n          <span class=\"na\">volumes<\/span><span class=\"pi\">:<\/span>\r\n          <span class=\"pi\">-<\/span> <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">config<\/span>\r\n            <span class=\"na\">configMap<\/span><span class=\"pi\">:<\/span>\r\n              <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">curator-config<\/span>\r\n          <span class=\"na\">restartPolicy<\/span><span class=\"pi\">:<\/span> <span class=\"s\">OnFailure<\/span>\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> logging\/curator-cronjob.yaml\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get cronjobs <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-curator\r\nNAME                    SCHEDULE     SUSPEND   ACTIVE    LAST SCHEDULE   AGE\r\nelasticsearch-curator   0 18 <span class=\"k\">*<\/span> <span class=\"k\">*<\/span> <span class=\"k\">*<\/span>   False     0         &lt;none&gt;          45s\r\n<\/code><\/pre>\n<p>\u7b2c\u4e8c\u5929\u786e\u8ba4\u540e\uff0c\u53d1\u73b0CronJob\u88ab\u6267\u884c\uff0c\u5e76\u4e14\u5728\u65e5\u672c\u65f6\u95f4\u7684\u51cc\u66683\u70b9\u6267\u884c\u4e86\u4efb\u52a1\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get cronjobs <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-curator\r\nNAME                    SCHEDULE     SUSPEND   ACTIVE    LAST SCHEDULE   AGE\r\nelasticsearch-curator   0 18 <span class=\"k\">*<\/span> <span class=\"k\">*<\/span> <span class=\"k\">*<\/span>   False     0         4h              16h\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl describe <span class=\"nb\">jobs <\/span>elasticsearch-curator-1534701600 <span class=\"nt\">--namespace<\/span> monitoring\r\nName:           elasticsearch-curator-1534701600\r\nNamespace:      monitoring\r\n<span class=\"c\">#...\uff08\u7701\u7565)...<\/span>\r\nControlled By:  CronJob\/elasticsearch-curator\r\nParallelism:    1\r\nCompletions:    1\r\nStart Time:     Mon, 20 Aug 2018 03:00:08 +0900\r\nPods Statuses:  0 Running \/ 1 Succeeded \/ 0 Failed\r\n<span class=\"c\">#...\uff08\u7701\u7565)...<\/span>\r\n<\/code><\/pre>\n<h1>\u8bf7\u9a8c\u8bc1Elasticsearch + Fluentd + Kibana\u7684\u8fd0\u884c\u4e0e\u4e92\u64cd\u4f5c\u6027\u3002<\/h1>\n<p>\u6211\u4eec\u6765\u786e\u8ba4\u4e00\u4e0b\u65e5\u5fd7\u662f\u5426\u5df2\u7ecf\u88ab\u6c47\u603b\u5230Elasticsearch\u4e2d\uff0c\u5728Kibana\u4e0a\u8fdb\u884c\u68c0\u67e5\u3002<br \/>\n\u5c06Kibana\u76845601\u7aef\u53e3\u8f6c\u53d1\uff0c\u5e76\u5728\u6d4f\u89c8\u5668\u4e2d\u8bbf\u95ee http:\/\/localhost:5601\/ \u6765\u663e\u793a\u4eea\u8868\u76d8\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl port-forward <span class=\"si\">$(<\/span>kubectl get pod <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>kibana-logging <span class=\"nt\">-o<\/span> template <span class=\"nt\">--template<\/span> <span class=\"s2\">\"{{(index .items 0).metadata.name}}\"<\/span><span class=\"si\">)<\/span> <span class=\"nt\">--namespace<\/span> monitoring 5601:5601\r\n<\/code><\/pre>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/86-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 16.00.02.png\" \/><\/div>\n<p>\u4ece\u201c\u7d22\u5f15\u6a21\u5f0f\u201d\u7ba1\u7406\u4e2d\uff0c\u9009\u62e9logstash-*\u4f5c\u4e3a\u7d22\u5f15\u6a21\u5f0f\uff0c\u6307\u5b9a@timestamp\u4e3a\u65f6\u95f4\u8fc7\u6ee4\u5b57\u6bb5\uff0c\u5e76\u521b\u5efa\u7d22\u5f15\u3002<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/88-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 16.03.12.png\" \/><\/div>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/89-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 16.07.02.png\" \/><\/div>\n<h1>\u4f7f\u7528Elasticsearch + Grafana\u8fdb\u884c\u65e5\u5fd7\u62a5\u8b66\u901a\u77e5\u3002<\/h1>\n<p>\u8ba9\u6211\u4eec\u6700\u540e\u5c1d\u8bd5\u4e00\u4e0b\u4f7f\u7528Elasticsearch + Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u901a\u77e5\u3002<\/p>\n<p>\u7136\u800c\uff0c\u5c06Elasticsearch\u4f5c\u4e3a\u6570\u636e\u6e90\u8fdb\u884c\u8b66\u62a5\u662f\u4ece\u6700\u65b0\u7684Grafana 5.2\u5f00\u59cb\u5f15\u5165\u7684\u65b0\u529f\u80fd\u3002\u5bf9\u4e8e\u65e9\u4e8e5.2\u7248\u672c\u7684Grafana\u6765\u8bf4\uff0c\u53ef\u4ee5\u6536\u96c6\u5e76\u53ef\u89c6\u5316Elasticsaerch\u7684\u65e5\u5fd7\uff0c\u4f46\u65e0\u6cd5\u8bbe\u7f6e\u8b66\u62a5\uff0c\u6240\u4ee5\u9700\u8981\u6ce8\u610f\u3002<\/p>\n<h2>\u53ef\u4ee5\u6ce8\u518c\u4e00\u4e2a\u53ef\u4ee5\u968f\u610f\u8f93\u51fa\u9519\u8bef\u65e5\u5fd7\u7684Pod\u3002<\/h2>\n<p>\u5c06\u4e00\u4e2a\u6d4b\u8bd5\u7528\u7684REST API\u6ce8\u518c\u4e3aPod\uff0c\u7528\u4e8e\u5f53\u8bbf\u95ee\/error\/\u8def\u5f84\u65f6\u8f93\u51fa\u9519\u8bef\u65e5\u5fd7\u8fdb\u884c\u9a8c\u8bc1\u3002\u6709\u5173\u8be5Pod\u7684\u8be6\u7ec6\u4fe1\u606f\uff0c\u8bf7\u53c2\u9605nmatsui\/kubernetes-monitoring\/test-logging-api\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl apply <span class=\"nt\">-f<\/span> test-pod\/test-pod.yaml\r\n<\/code><\/pre>\n<p>\u786e\u8ba4\u6b63\u5728\u8fd0\u884c\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get pods <span class=\"nt\">-l<\/span> <span class=\"nv\">app<\/span><span class=\"o\">=<\/span>test-pod\r\nNAME                        READY     STATUS    RESTARTS   AGE\r\ntest-pod-7d9c9b85f9-mktl5   1\/1       Running   0          30s\r\n<\/code><\/pre>\n<p>\u8ba9\u6211\u4eec\u8f93\u51fa\u65e5\u5fd7\u3002\u5c06\u6b64Pod\u76843030\u7aef\u53e3\u8f6c\u53d1\uff0c\u5e76\u540c\u65f6\u5728\u53e6\u4e00\u4e2a\u7ec8\u7aef\u4e0a\u8ddf\u8e2a\u6b64Pod\u7684\u65e5\u5fd7\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl port-forward <span class=\"si\">$(<\/span>kubectl get pod <span class=\"nt\">-l<\/span> <span class=\"nv\">app<\/span><span class=\"o\">=<\/span>test-pod <span class=\"nt\">-o<\/span> template <span class=\"nt\">--template<\/span> <span class=\"s2\">\"{{(index .items 0).metadata.name}}\"<\/span><span class=\"si\">)<\/span> 3030:3030\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl logs <span class=\"nt\">-f<\/span> <span class=\"si\">$(<\/span>kubectl get pod <span class=\"nt\">-l<\/span> <span class=\"nv\">app<\/span><span class=\"o\">=<\/span>test-pod <span class=\"nt\">-o<\/span> template <span class=\"nt\">--template<\/span> <span class=\"s2\">\"{{(index .items 0).metadata.name}}\"<\/span><span class=\"si\">)<\/span>\r\n<\/code><\/pre>\n<p>\u8ba9\u6211\u4eec\u4f7f\u7528curl\u4ee5GET\u7684\u65b9\u5f0f\u8bbf\u95eehttp:\/\/loalhost:3030\/\u3002\u60a8\u5c06\u80fd\u591f\u786e\u8ba4\u4e0b\u65b9\u7c7b\u4f3cDEBUG\u65e5\u5fd7\u7684\u4e00\u884c\u8f93\u51fa\u3002<\/p>\n<pre class=\"post-pre\"><code>[2018-08-19T08:43:26.595] [DEBUG] app - request path: \/\r\n<\/code><\/pre>\n<h2>Grafana\u7684\u914d\u7f6e<\/h2>\n<h3>\u5c06Elasticsearch\u4f5c\u4e3aDataSource\u6dfb\u52a0\u8fdb\u6765\u3002<\/h3>\n<p>\u786e\u8ba4Elasticsearch Service\u7684\u540d\u79f0\u548c\u7aef\u53e3\uff0c\u7136\u540e\u5c06Elasticsearch\u4f5c\u4e3aDataSource\u6dfb\u52a0\u5230Grafana\u4e2d\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl get services <span class=\"nt\">--namespace<\/span> monitoring <span class=\"nt\">-l<\/span> k8s-app<span class=\"o\">=<\/span>elasticsearch-logging\r\nNAME                    TYPE        CLUSTER-IP     EXTERNAL-IP   PORT<span class=\"o\">(<\/span>S<span class=\"o\">)<\/span>    AGE\r\nelasticsearch-logging   ClusterIP   10.0.150.102   &lt;none&gt;        9200\/TCP   3h\r\n<\/code><\/pre>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">name: elasticsearch<\/ul>\n<\/li>\n<\/ul>\n<p>Type: Elasticsearch<\/p>\n<p>URL: http:\/\/elasticsearch-logging:9200\/<\/p>\n<p>Access: Server(Default)<\/p>\n<p>Index name: logstash-*<\/p>\n<p>Time field nama: @timestamp<\/p>\n<p>Version: 5.6+<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/108-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 17.22.10.png\" \/><\/div>\n<h3>\u5bfc\u5165 Elasticsearch \u7684\u4eea\u8868\u76d8<\/h3>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/110-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 17.51.11.png\" \/><\/div>\n<h3>\u5728\u901a\u77e5\u9891\u9053\u4e2d\u6dfb\u52a0 Slack<\/h3>\n<p>Grafana\u81ea\u5e26\u4e86\u5411Slack\u53d1\u9001\u8b66\u62a5\u901a\u77e5\u7684\u529f\u80fd\u3002<br \/>\n\u8bf7\u901a\u8fc7Alerting -&gt; Notification channels\u6dfb\u52a0\u65b0\u7684Slack\u9891\u9053\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Name: slack<\/ul>\n<\/li>\n<\/ul>\n<p>Type: Slack<\/p>\n<p>Url: Slack\u306eWebhook URL<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/114-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 18.21.00.png\" \/><\/div>\n<p>\u8bf7\u70b9\u51fb\u201c\u53d1\u9001\u6d4b\u8bd5\u201d\u6309\u94ae\uff0c\u786e\u4fdd\u201c[Alerting]\u6d4b\u8bd5\u901a\u77e5\u201d\u6d88\u606f\u5df2\u7ecf\u5230\u8fbeSlack\u9891\u9053\u3002<\/p>\n<h2>\u6dfb\u52a0\u4e00\u4e2a\u9762\u677f\u6765\u76d1\u6d4btest-pod\u5728Grafana\u4e2d\u7684[ERROR]\u3002<\/h2>\n<p>\u5728Elasticsearch\u4eea\u8868\u677f\u4e0a\uff0c\u5982\u679ctest-pod\u8f93\u51fa[ERROR]\u65e5\u5fd7\uff0c\u5219\u6dfb\u52a0\u4e00\u4e2a\u7528\u4e8e\u68c0\u6d4b\u7684\u9762\u677f\u3002<br \/>\n\u70b9\u51fb\u9876\u90e8\u7684\u201c\u6dfb\u52a0\u9762\u677f\u201d\u56fe\u6807\uff0c\u6dfb\u52a0\u4e00\u4e2a\u56fe\u8868\uff0c\u7136\u540e\u70b9\u51fb\u751f\u6210\u7684\u56fe\u8868\u7684\u201c\u7f16\u8f91\u201d\u5e76\u8fdb\u884c\u4ee5\u4e0b\u4fee\u6539\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">General<\/ul>\n<\/li>\n<\/ul>\n<p>Title: test-pod error<\/p>\n<p>Metrics<\/p>\n<p>DataSource: elasticsearch<\/p>\n<p>A<\/p>\n<p>Query: kubernetes.container_name:&#8221;test-pod&#8221; AND log:&#8221;[ERROR]&#8221;<\/p>\n<p>Metric: Count<\/p>\n<p>Axis<\/p>\n<p>LeftY<\/p>\n<p>Y-Min: 0<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/119-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 18.01.37.png\" \/><\/div>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>curl <span class=\"nt\">-i<\/span> http:\/\/localhost:3030\/error\/\r\nHTTP\/1.1 500 Internal Server Error\r\nX-Powered-By: Express\r\nContent-Type: application\/json<span class=\"p\">;<\/span> <span class=\"nv\">charset<\/span><span class=\"o\">=<\/span>utf-8\r\nContent-Length: 27\r\nETag: W\/<span class=\"s2\">\"1b-BKZcJDCXkpfhBOSVMNakKtV\/a+s\"<\/span>\r\nDate: Sun, 19 Aug 2018 09:03:32 GMT\r\nConnection: keep-alive\r\n\r\n<span class=\"o\">{<\/span><span class=\"s2\">\"result\"<\/span>:<span class=\"s2\">\"Error: error!!\"<\/span><span class=\"o\">}<\/span>\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>kubectl logs <span class=\"nt\">-f<\/span> <span class=\"si\">$(<\/span>kubectl get pod <span class=\"nt\">-l<\/span> <span class=\"nv\">app<\/span><span class=\"o\">=<\/span>test-pod <span class=\"nt\">-o<\/span> template <span class=\"nt\">--template<\/span> <span class=\"s2\">\"{{(index .items 0).metadata.name}}\"<\/span><span class=\"si\">)<\/span>\r\n<span class=\"o\">[<\/span>2018-08-19T08:37:01.080] <span class=\"o\">[<\/span>INFO] app - Server running on port 3030\r\n<span class=\"o\">[<\/span>2018-08-19T08:43:26.595] <span class=\"o\">[<\/span>DEBUG] app - request path: \/\r\n<span class=\"o\">[<\/span>2018-08-19T09:03:32.730] <span class=\"o\">[<\/span>ERROR] app - Error: error!!\r\n<\/code><\/pre>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/122-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 18.05.13.png\" \/><\/div>\n<p>\u4e0d\u932f\u554a\uff01\u770b\u5230\u4e86\uff0cPod\u7684\u65e5\u8a8c\u88abElasticsearch\u6536\u96c6\u8d77\u4f86\uff0c\u4e26\u901a\u904eGrafana\u9032\u884c\u4e86\u7be9\u9078\u548c\u53ef\u8996\u5316\uff01<\/p>\n<h2>\u65b0\u589e\u4e00\u4e2aAlert\uff0c\u7528\u4e8e\u5728\u68c0\u6d4b\u5230test-pod\u7684[ERROR]\u65f6\u5411Slack\u53d1\u9001\u901a\u77e5\u3002<\/h2>\n<p>\u73b0\u5728\u8ba9\u6211\u4eec\u5411\u6b64\u9762\u677f\u6dfb\u52a0\u8b66\u62a5\u89c4\u5219\u3002\u8bf7\u70b9\u51fb\u201cAlert\u201d\u9009\u9879\u5361\u4e0a\u7684\u201c\u521b\u5efa\u8b66\u62a5\u201d\u6309\u94ae\uff0c\u5e76\u6dfb\u52a0\u4e00\u4e2a\u8b66\u62a5\uff0c\u7136\u540e\u8f93\u5165\u4ee5\u4e0b\u4fe1\u606f\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Alert Config<\/ul>\n<\/li>\n<\/ul>\n<p>Name: test-pod error alert<\/p>\n<p>Evaluate Every: 10s<\/p>\n<p>Conditions<\/p>\n<p>WHEN: sum()<\/p>\n<p>OF: query(A, 1m, now)<\/p>\n<p>IS ABOVE: 0<\/p>\n<p>Notifications<\/p>\n<p>send to: slack<\/p>\n<p>Message: test-pod raise a ERROR. Please check this pod!<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/127-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 19.08.01.png\" \/><\/div>\n<p>\u8ba9\u6211\u4eec\u5b9e\u9645\u4ea7\u751f\u4e00\u4e2a\u9519\u8bef\u3002\u4e0e\u4e4b\u524d\u4e00\u6837\uff0c\u4f7f\u7528curl\u53d1\u9001GET\u8bf7\u6c42\u5230 http:\/\/localhost:3030\/error\/ \u5e76\u5f15\u53d1\u9519\u8bef\u3002<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/129-1.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 19.10.16.png\" \/><\/div>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/130-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 19.11.26.png\" \/><\/div>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/131-0.png\" alt=\"\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8 2018-08-19 19.15.13.png\" \/><\/div>\n<h1>\u6700\u5f8c : \u6700\u540e\u4e00\u4e2a<\/h1>\n<p>\u56e0\u6b64\uff0c\u5728Azure AKS\u4e0a\u69cb\u5efaElasticsearch + Fluentd + Kibana + Curaotr\u7684\u74b0\u5883\uff0c\u4e26\u9032\u884c\u65e5\u8a8c\u96c6\u5408\uff0c\u6b64\u5916\u9084\u8207Grafana\u9032\u884c\u9023\u63a5\uff0c\u9019\u6a23\u4e00\u4f86\uff0c\u7576\u7279\u5b9aPod\u4e2d\u8f38\u51fa\u7684\u65e5\u8a8c\u4e2d\u5305\u542b\u7279\u5b9a\u5b57\u7b26\u6642\uff0c\u53ef\u4ee5\u5c07\u901a\u77e5\u767c\u9001\u81f3Slack\u3002<\/p>\n<p>\u5982\u679c\u60a8\u5e0c\u671b\u5728\u590d\u6742\u6761\u4ef6\u800c\u4e0d\u4ec5\u4ec5\u662f\u5b57\u7b26\u4e32\u68c0\u67e5\u65f6\u89e6\u53d1\u8b66\u62a5\uff0c\u53ef\u80fd\u6700\u597d\u5f15\u5165ElastAlert\uff0c\u4f46\u5982\u679c\u53ea\u662f\u7b80\u5355\u7684\u8b66\u62a5\u6761\u4ef6\uff0c\u6211\u8ba4\u4e3aGrafana\u5c31\u8db3\u591f\u4e86\u3002<\/p>\n<p>\u8bf7\u5927\u5bb6\u4eab\u53d7\u7f8e\u597d\u7684Kubernetes\u751f\u6d3b\uff01<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u9996\u5148 \u8fd9\u662f\u5173\u4e8e\u5728Microsoft Azure AKS\u4e0a\u642d\u5efa\u57fa\u4e8ePrometheus\u548cGrafana\u7684\u8d44\u6e90\u76d1\u63a7 [&hellip;]<\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-40886","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09 - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/\u5728aks\u4e0a\u90e8\u7f72prometheusgrafana\u548celasticsearchfluentdkibana\uff0c\u4ee5grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09\" \/>\n<meta property=\"og:description\" content=\"\u9996\u5148 \u8fd9\u662f\u5173\u4e8e\u5728Microsoft Azure AKS\u4e0a\u642d\u5efa\u57fa\u4e8ePrometheus\u548cGrafana\u7684\u8d44\u6e90\u76d1\u63a7 [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/\u5728aks\u4e0a\u90e8\u7f72prometheusgrafana\u548celasticsearchfluentdkibana\uff0c\u4ee5grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-04-12T18:01:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-29T13:59:37+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/46-0.png\" \/>\n<meta name=\"author\" content=\"\u96c5, \u609f\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u96c5, \u609f\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/\",\"name\":\"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09 - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-04-12T18:01:19+00:00\",\"dateModified\":\"2024-04-29T13:59:37+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/f044a4b7fa4ee2701702942002419ca6\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.silicloud.com\/zh\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/f044a4b7fa4ee2701702942002419ca6\",\"name\":\"\u96c5, \u609f\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e71a913e914f1aad1efc391f92084294bac54bc782acd289638580134cf667a6?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e71a913e914f1aad1efc391f92084294bac54bc782acd289638580134cf667a6?s=96&d=mm&r=g\",\"caption\":\"\u96c5, \u609f\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/yawu\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09 - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/\u5728aks\u4e0a\u90e8\u7f72prometheusgrafana\u548celasticsearchfluentdkibana\uff0c\u4ee5grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\/","og_locale":"zh_CN","og_type":"article","og_title":"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09","og_description":"\u9996\u5148 \u8fd9\u662f\u5173\u4e8e\u5728Microsoft Azure AKS\u4e0a\u642d\u5efa\u57fa\u4e8ePrometheus\u548cGrafana\u7684\u8d44\u6e90\u76d1\u63a7 [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/\u5728aks\u4e0a\u90e8\u7f72prometheusgrafana\u548celasticsearchfluentdkibana\uff0c\u4ee5grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-04-12T18:01:19+00:00","article_modified_time":"2024-04-29T13:59:37+00:00","og_image":[{"url":"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d437137434c4406c9c267\/46-0.png"}],"author":"\u96c5, \u609f","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u96c5, \u609f","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"8 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/","name":"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09 - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-04-12T18:01:19+00:00","dateModified":"2024-04-29T13:59:37+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/f044a4b7fa4ee2701702942002419ca6"},"breadcrumb":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.silicloud.com\/zh\/blog\/"},{"@type":"ListItem","position":2,"name":"\u5728AKS\u4e0a\u90e8\u7f72Prometheus+Grafana\u548cElasticsearch+Fluentd+Kibana\uff0c\u4ee5Grafana\u8fdb\u884c\u65e5\u5fd7\u8b66\u62a5\u7684\u6b65\u9aa4\uff082\/2\uff09"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/f044a4b7fa4ee2701702942002419ca6","name":"\u96c5, \u609f","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e71a913e914f1aad1efc391f92084294bac54bc782acd289638580134cf667a6?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e71a913e914f1aad1efc391f92084294bac54bc782acd289638580134cf667a6?s=96&d=mm&r=g","caption":"\u96c5, \u609f"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/yawu\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8aks%e4%b8%8a%e9%83%a8%e7%bd%b2prometheusgrafana%e5%92%8celasticsearchfluentdkibana%ef%bc%8c%e4%bb%a5grafana%e8%bf%9b%e8%a1%8c%e6%97%a5%e5%bf%97%e8%ad%a6%e6%8a%a5%e7%9a%84%e6%ad%a5%e9%aa%a4\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/40886","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=40886"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/40886\/revisions"}],"predecessor-version":[{"id":87887,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/40886\/revisions\/87887"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=40886"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=40886"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=40886"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}