{"id":46815,"date":"2023-10-13T15:02:31","date_gmt":"2023-12-28T05:34:39","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/"},"modified":"2024-05-04T04:02:43","modified_gmt":"2024-05-03T20:02:43","slug":"%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/","title":{"rendered":"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd"},"content":{"rendered":"<h1>\u76ee\u6807\u4e0e\u6982\u8ff0 y\u01d4<\/h1>\n<p>\u8ba9\u6211\u4eec\u4ece\u5927\u5b66\u7684\u673a\u68b0\u81c2\u4e2d\u6536\u96c6\u6570\u636e\u5427\uff01\u56e0\u6b64\uff0c\u6211\u4eec\u8003\u8651\u4e86\u4e00\u79cd\u8bd5\u9a8c\u6027\u7684\u5b9e\u73b0\u65b9\u6848\uff0c\u901a\u8fc7\u5728\u673a\u5668\u4eba\u4e0a\u5b89\u88c5Raspberry Pi\u5e76\u4f7f\u7528MQTT\u53d1\u9001\u6570\u636e\uff0c\u7136\u540e\u5c06\u6570\u636e\u4fdd\u5b58\u5230\u6570\u636e\u6e56\u4e2d\u3002<\/p>\n<h3>\u5fc5\u987b\u5411Kafka\u53d1\u9001\u6570\u636e<\/h3>\n<p>\u5728\u786e\u8ba4\u670d\u52a1\u5668\u73af\u5883\u540e\uff0c\u5f97\u77e5\u6570\u636e\u662f\u7531Kubernetes\u4e0a\u7684Kafka\u8fdb\u884c\u7ba1\u7406\u3002\u56e0\u6b64\uff0c\u6211\u4eec\u51b3\u5b9a\u4f7f\u7528\u5f00\u6e90\u5de5\u5177Fluentd\u521b\u5efa\u8fde\u63a5\u5668\uff0c\u4ee5\u5c06MQTT\u548cKafka\u8fdb\u884c\u8fde\u63a5\u3002\u867d\u7136\u6211\u4eec\u4e5f\u8003\u8651\u5c06MQTT Broker\u90e8\u7f72\u5728\u8fb9\u7f18\u8bbe\u5907\u4e2d\uff0c\u4f46\u4e3a\u4e86\u5c3d\u91cf\u51cf\u5c11\u8d1f\u8377\uff0c\u6211\u4eec\u4e5f\u5c06\u5176\u90e8\u7f72\u5728Kubernetes\u4e2d\u3002\u6570\u636e\u5c06\u901a\u8fc7\u8bbe\u5907 =&gt; MQTT Broker =&gt; Fluentd =&gt; Kafka \u7684\u6d41\u7a0b\u8fdb\u884c\u4f20\u8f93\u3002<\/p>\n<h3>\u8fd9\u7bc7\u6587\u7ae0\u7684\u5185\u5bb9<\/h3>\n<p>\u6211\u5c06\u6309\u7167\u4ee5\u4e0b\u987a\u5e8f\u89e3\u91ca\u4f7f\u7528Minikube\u5728\u672c\u5730\u6240\u5b8c\u6210\u7684\u5185\u5bb9\u3002<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\u90e8\u7f72MQTT-Broker<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\u6dfb\u52a0Fluentd\u63d2\u4ef6\u5e76\u521b\u5efaDocker\u955c\u50cf<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\u90e8\u7f72Fluentd<\/ol>\n<h1>\u5f00\u53d1\u73af\u5883<\/h1>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">macOS Big Sur, version 11.2.1<\/ul>\n<\/li>\n<\/ul>\n<p>Docker, version 20.10.5<\/p>\n<p>minikube, v1.18.1<\/p>\n<p>eclipse-mosquitto, v 2.0.9<\/p>\n<p>fluentd-kubernetes-daemonset, v1.12.0-debian-kafka2-1.2<br \/>\nFluent::Plugin::Mqtt::IO<br \/>\nfluent-plugin-kafka<\/p>\n<h1>\u4e8b\u524d\u51c6\u5907<\/h1>\n<p>\u6211\u4f7f\u7528minikube\u4f5c\u4e3aKubernetes\u7684\u672c\u5730\u5f00\u53d1\u73af\u5883\u3002minikube\u5728\u865a\u62df\u673a\u7ba1\u7406\u5668\u5982Docker\u6216Virtual Box\u4e0a\u8fd0\u884c\u3002\u8fd9\u6b21\u6211\u4f7f\u7528\u4e86Docker\u3002<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>Docker\u5b89\u88c5<\/ol>\n<\/li>\n<\/ol>\n<p>minikube\u5b89\u88c5<\/p>\n<p>\u6839\u636e\u6bcf\u4e2a\u9875\u9762\u7684\u6307\u793a\u8fdb\u884c\u64cd\u4f5c\u3002\u4e3a\u4e86\u8fdb\u884c\u64cd\u4f5c\u786e\u8ba4\uff0c\u5efa\u8bae\u4e8b\u5148\u5728\u672c\u5730\u5b89\u88c5mosquitto client\u3002<\/p>\n<h1>MQTT-Broker\u7684\u90e8\u7f72<\/h1>\n<p>\u4ece\u8fd9\u91cc\u5f00\u59cb\u8fdb\u5165\u6b63\u9898\u3002<br \/>\n\u4f7f\u7528eclipse-mosquitto\u5728minikube\u4e0a\u90e8\u7f72\u4e86\u4ee3\u7406\u3002\u7531\u4e8e\u6211\u4eec\u76f4\u63a5\u4f7f\u7528docker\u955c\u50cf\uff0c\u6240\u4ee5\u4ece\u521b\u5efayaml\u6587\u4ef6\u5f00\u59cb\u3002\u9996\u5148\uff0c\u4e3a\u4e86\u7f16\u8f91\u9ed8\u8ba4\u7684mosquitto.conf\u6587\u4ef6\uff0c\u6211\u4eec\u521b\u5efa\u4e86ConfigMap\u3002<\/p>\n<h3>\u521b\u5efaConfigMap<\/h3>\n<p>ConfigMap\u662f\u5904\u7406\u914d\u7f6e\u4fe1\u606f\u7684\u8d44\u6e90\u3002\u5c06\u6bcf\u4e2a\u5e94\u7528\u7a0b\u5e8f\u7684\u914d\u7f6e\u4f5c\u4e3aConfigMap\u4fdd\u5b58\u5728Kubernetes\u4e2d\uff0c\u53ef\u4ee5\u5728\u5bb9\u5668\u90e8\u7f72\u65f6\u4f7f\u7528\u5b83\u6765\u521b\u5efa\u914d\u7f6e\u6587\u4ef6\u3002\u5982\u679c\u624b\u5934\u6709mosquitto.conf\u6587\u4ef6\uff0c\u5219\u53ef\u4ee5\u4f7f\u7528kubectl create configmap &#8211;from-file=\u547d\u4ee4\u8fdb\u884c\u521b\u5efa\u3002\u5f53\u4eceyaml\u6587\u4ef6\u521b\u5efa\u65f6\uff0c\u53ef\u4ee5\u4f7f\u7528\u5982\u4e0b\u63cf\u8ff0\u3002<\/p>\n<pre class=\"post-pre\"><code>apiVersion: v1\r\nkind: ConfigMap\r\nmetadata:\r\n  name: mosquitto-config-file\r\ndata:\r\n  mosquitto.conf: |\r\n    listener 1883\r\n    allow_anonymous false\r\n    password_file \/mosquitto\/secret\/passwd\r\n<\/code><\/pre>\n<p>\u4e0b\u9762\u7684\u63cf\u8ff0\u5728data\u6807\u7b7e\u4e0b\u8bf4\u660e\u4e86mosquitto.conf\u6587\u4ef6\u7684\u5185\u5bb9\u5c06\u6620\u5c04\u5230\u540e\u7eed\u7684\u6587\u672c\u4e2d\uff08\u4ee5\u4fdd\u6301\u6362\u884c\uff09\u3002\u7531\u4e8e\u8bbe\u7f6e\u4e86allow_anonymous false\uff0c\u56e0\u6b64\u8fde\u63a5\u5230\u4ee3\u7406\u7684\u7528\u6237\u540d\u548c\u5bc6\u7801\u662f\u5fc5\u9700\u7684\u3002\u5bc6\u7801\u6587\u4ef6\u7684\u4fdd\u5b58\u4f4d\u7f6e\u8bbe\u7f6e\u4e3apassword_file \/mosquitto\/secret\/passwd\u3002<\/p>\n<p>\u672c\u4f86\u61c9\u8a72\u4f7f\u7528Secret\u4f86\u5275\u5efa\u5bc6\u78bc\u6587\u4ef6\u7684\u6620\u5c04\uff0c\u4f46\u7531\u65bc\u90e8\u7f72\u6642\u7121\u6cd5\u89e3\u6c7a\u932f\u8aa4\uff0c\u4e14\u5c0dkafka\u7684\u8a2a\u554f\u9700\u8981\u4f7f\u7528ssl\uff0c\u56e0\u6b64\u6211\u66ab\u6642\u4f7f\u7528configmap\u4f86\u5275\u5efa\u3002\u6211\u53c3\u8003\u4e86\u9019\u500b\u7db2\u7ad9\u4e0a\u6709\u95dcmosquitto\u5bc6\u78bc\u52a0\u5bc6\u7684\u65b9\u6cd5\u3002<\/p>\n<h3>\u521b\u5efa\u90e8\u7f72<\/h3>\n<p>\u8bf7\u5c06\u4ee5\u4e0b\u63cf\u8ff0\u6dfb\u52a0\u5230yaml\u6587\u4ef6\u4e2d\uff08\u5982\u679c\u4e0econfigmap\u6587\u4ef6\u4f4d\u4e8e\u540c\u4e00\u6587\u4ef6\u4e2d\uff0c\u8bf7\u4e0d\u8981\u5fd8\u8bb0\u6dfb\u52a0\u5206\u9694\u7b26&#8212;\uff01\uff09<\/p>\n<pre class=\"post-pre\"><code>apiVersion: apps\/v1 \r\nkind: Deployment\r\nmetadata:\r\n  name: mqtt-broker\r\nspec:\r\n  selector:\r\n    matchLabels:\r\n      app: mqtt-broker\r\n  replicas: 1 # \u30ec\u30d7\u30ea\u30ab\u306e\u6570\u306e\u6307\u5b9a\r\n  template:\r\n    metadata:\r\n      labels:\r\n        app: mqtt-broker\r\n    spec:\r\n      containers:\r\n        - name: mosquitto\r\n          image: eclipse-mosquitto #\u30ec\u30b8\u30b9\u30c8\u30ea\u306e\u30db\u30b9\u30c8\u540d\u3092\u6307\u5b9a\u3057\u306a\u3044\u5834\u5408\u306f\u3001Kubernetes\u306fDocker\u30d1\u30d6\u30ea\u30c3\u30af\u30ec\u30b8\u30b9\u30c8\u30ea\u3092\u610f\u5473\u3057\u3066\u3044\u308b\u3068\u898b\u306a\u3057\u307e\u3059\u3002\r\n          ports:\r\n            - containerPort: 1883\r\n          volumeMounts: #\u3000\u30de\u30a6\u30f3\u30c8\u5148\u306e\u6307\u5b9a\r\n            - name: mosquitto-config\r\n              mountPath: \/mosquitto\/config\r\n            - name: mosquitto-passwd\r\n              mountPath: \/mosquitto\/secret\r\n              readOnly: true\r\n      volumes: # \u30de\u30c3\u30d7\u306e\u30bd\u30fc\u30b9\u3092\u6307\u5b9a\r\n        - name: mosquitto-config\r\n          configMap:\r\n            name: mosquitto-config-file  #ConfigMap\u306e\u540d\u524d\u3092\u6307\u5b9a\r\n        - name: mosquitto-passwd\r\n          configMap:\r\n            name: mqtt-passwd\r\n<\/code><\/pre>\n<p>\u6211\u4f1a\u6307\u5b9aDocker\u955c\u50cf\u7684\u83b7\u53d6\u4ed3\u5e93\u548c\u8bbe\u7f6e\u7684\u6620\u5c04\u76ee\u6807\u3002\u8fd9\u6837\u4e00\u6765\uff0c\u5f53\u90e8\u7f72\u65f6\uff0c\u5c06\u521b\u5efa\u4e00\u4e2a\u65b0\u7684Pod\uff0c\u5e76\u5728\u5176\u4e2d\u8fd0\u884c\u5bb9\u5668\u3002<\/p>\n<h3>\u521b\u5efaService<\/h3>\n<p>\u63a5\u4e0b\u6765\uff0c\u5c06\u8bbe\u5907\u4ee5\u53caFluentd\u4e0e\u8be5Pod\u8fdb\u884c\u901a\u4fe1\u7684\u670d\u52a1\u63cf\u8ff0\u4e5f\u6dfb\u52a0\u5230yaml\u4e2d\u3002\u5c3d\u7ba1\u4f7f\u7528kubectl expose\u547d\u4ee4\u4e5f\u53ef\u4ee5\u5b9e\u73b0\uff0c\u4f46\u5728\u4e0b\u6b21\u90e8\u7f72\u65f6\u5982\u679c\u670d\u52a1\u540d\u79f0\u4e0d\u540c\u4f1a\u9020\u6210\u56f0\u6270\uff0c\u6240\u4ee5\u6211\u9009\u62e9\u5c06\u5176\u5199\u5165yaml\u6587\u4ef6\u4e2d\u3002<\/p>\n<pre class=\"post-pre\"><code>apiVersion: v1\r\nkind: Service\r\nmetadata:\r\n  name: mosquitto-service\r\n  labels:\r\n    name: mosquitto\r\nspec:\r\n  selector:\r\n    app: mqtt-broker\r\n  ports:\r\n  - port: 1883\r\n    name: mosquitto-port\r\n    protocol: TCP\r\n<\/code><\/pre>\n<h3>\u90e8\u7f72<\/h3>\n<p>\u8fd9\u6837yaml\u7684\u63cf\u8ff0\u5c31\u5b8c\u6210\u4e86\u3002\u6574\u4f53\u6765\u8bf4\u662f\u8fd9\u79cd\u611f\u89c9\u3002<\/p>\n<pre class=\"post-pre\"><code># mosquitto.yaml\r\napiVersion: v1\r\nkind: ConfigMap\r\nmetadata:\r\n  name: mosquitto-config-file\r\ndata:\r\n  mosquitto.conf: |\r\n    listener 1883\r\n    allow_anonymous false\r\n    password_file \/mosquitto\/secret\/passwd\r\n#---\r\n## \u3053\u306e\u90e8\u5206\u306f\u30d1\u30b9\u30ef\u30fc\u30c9\u30d5\u30a1\u30a4\u30eb\u7528\u306e\u30de\u30c3\u30d7\u3067\u3059\u3002\u8a18\u8ff0\u305b\u305a\u306b\u30b3\u30de\u30f3\u30c9\u3067secret\u3092\u4f5c\u6210\u3059\u308b\u304b\u3001\u5225\u30d5\u30a1\u30a4\u30eb\u304b\u3089apply\u3059\u308b\u3053\u3068\u3092\u304a\u3059\u3059\u3081\u3057\u307e\u3059\r\n#apiVersion: v1\r\n#kind: ConfigMap\r\n#metadata:\r\n#  name: mqtt-passwd\r\n#data:\r\n#  passwd: |\r\n#    &lt;your-mosquitto-username&gt;:&lt;generated-password&gt;   \r\n---\r\napiVersion: apps\/v1\r\nkind: Deployment\r\nmetadata:\r\n  name: mqtt-broker\r\nspec:\r\n  selector:\r\n    matchLabels:\r\n      app: mqtt-broker\r\n  replicas: 1 \r\n  template:\r\n    metadata:\r\n      labels:\r\n        app: mqtt-broker\r\n    spec:\r\n      containers:\r\n        - name: mosquitto\r\n          image: eclipse-mosquitto\r\n          ports:\r\n            - containerPort: 1883\r\n          volumeMounts:\r\n            - name: mosquitto-config\r\n              mountPath: \/mosquitto\/config\r\n            - name: mosquitto-passwd\r\n              mountPath: \/mosquitto\/secret\r\n              readOnly: true\r\n      volumes:\r\n        - name: mosquitto-config\r\n          configMap:\r\n            name: mosquitto-config-file\r\n        - name: mosquitto-passwd\r\n          configMap:\r\n            name: mqtt-passwd\r\n---\r\napiVersion: v1\r\nkind: Service\r\nmetadata:\r\n  name: mosquitto-service\r\n  labels:\r\n    name: mosquitto\r\nspec:\r\n  selector:\r\n    app: mqtt-broker\r\n  ports:\r\n  - port: 1883\r\n    name: mosquitto-port\r\n    protocol: TCP\r\n<\/code><\/pre>\n<p>\u542f\u52a8Docker\u540e\uff0c\u4f7f\u7528minikube start\u547d\u4ee4\u542f\u52a8\u96c6\u7fa4\uff0c\u7136\u540e\u4f7f\u7528kubectl apply -f\u547d\u4ee4\u5c06\u6b64yaml\u6587\u4ef6\u90e8\u7f72\u3002\u53ef\u4ee5\u4f7f\u7528minikube dashboard\u547d\u4ee4\u542f\u52a8\u4eea\u8868\u677f\u6765\u786e\u8ba4\u90e8\u7f72\u662f\u5426\u6210\u529f\u3002\u9700\u8981\u6ce8\u610f\u7684\u662f\uff0c\u521b\u5efa\u7684\u670d\u52a1\u6ca1\u6709\u5916\u90e8\u8bbf\u95ee\u7aef\u53e3\u3002\u5728\u6295\u7a3f\u4e3b\u7684\u672c\u5730\u73af\u5883\u4e2d\uff0c\u65e0\u6cd5\u901a\u8fc7NodePort\u8fdb\u884c\u8bbf\u95ee\uff0c\u56e0\u6b64\u8fdb\u884c\u4e86\u7aef\u53e3\u8f6c\u53d1\u3002\u4f7f\u7528kubectl port-forward svc\/mosquitto-service 1883:1883\u547d\u4ee4\u5728\u672c\u5730\u7aef\u53e3\u548c\u8fdc\u7a0b\u7aef\u53e3\u4e4b\u95f4\u5efa\u7acb\u4e86\u96a7\u9053\u3002\u73b0\u5728\u53ef\u4ee5\u901a\u8fc7localhost:1883\u8bbf\u95ee\u4ee3\u7406\u670d\u52a1\u5668\u4e86\u3002<\/p>\n<p>\u5728\u5b9e\u9645\u73af\u5883\u4e2d\uff0c\u6211\u8ba4\u4e3a\u4f1a\u4f7f\u7528LoadBalancer\u6216\u8005NodePort\u6765\u63d0\u4f9b\u5916\u90e8IP\u3002<\/p>\n<h1>Fluentd\u7684\u90e8\u7f72<\/h1>\n<p>\u63a5\u4e0b\u6765\u662fFluentd\u7684\u767b\u573a\u3002\u6709\u8bb8\u591a\u9488\u5bf9Fluentd\u5f00\u53d1\u7684\u63d2\u4ef6\uff0c\u5e76\u4e14\u5b89\u88c5\u4e5f\u975e\u5e38\u7b80\u5355\u3002<\/p>\n<p>\uff08\u987a\u4fbf\u8bf4\u4e00\u4e0b\uff0c\u5728\u4f7f\u7528Raspberry Pi\u5b89\u88c5Fluentd\u65f6\uff0c\u6211\u5c1d\u8bd5\u4f7f\u7528fluentd-gem install\u6765\u66ff\u4ee3bundle\u548cGemfile\uff0c\u7ed3\u679c\u9047\u5230\u4e86\u9519\u8bef\u3002\u5e0c\u671b\u8fd9\u5bf9\u4f60\u6709\u6240\u5e2e\u52a9\u3002\u53e6\u5916\uff0c\u5982\u679c\u8981\u5728Mac\u4e0a\u5b89\u88c5td-agent\u5e76\u6dfb\u52a0\u63d2\u4ef6\uff0c\u901a\u5e38\u7684fluentd-gem\u662f\u65e0\u6cd5\u5b89\u88c5\u7684\u3002\u4f3c\u4e4e\u9700\u8981\u4f7f\u7528\/opt\/td-agent\/embedded\/bin\/fluent-gem install \u6765\u5b89\u88c5\u63d2\u4ef6\u3002\uff09<\/p>\n<h3>\u5728Fluentd\u4e2d\u6dfb\u52a0MQTT\u63d2\u4ef6<\/h3>\n<p>\u6211\u4e0b\u8f7d\u5e76\u7f16\u8f91\u4e86 fluentd-kubernetes-daemonset \u7684 debian-kafka2-fluent\u3002\u521b\u5efa Fluentd Docker \u955c\u50cf\u7684\u6b65\u9aa4\u5982\u4e0b\u6240\u793a\u3002<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\u5c06fluent-plugin-mqtt-io\u6dfb\u52a0\u5230Gemfile\u4e2d\u3002<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\u7136\u540e\u4f7f\u7528docker build -t : .\u521b\u5efa\u6620\u50cf\uff0c\u5e76\u4f7f\u7528docker image push \u5c06\u5176\u63a8\u9001\u5230Docker Hub\u3002<\/ol>\n<p>\u4e0b\u4e00\u6b65\u662f\u7f16\u8f91fluent.conf\u6587\u4ef6\u3002\u5728\u6807\u7b7e\u5185\uff0c\u6dfb\u52a0\u4ece\u4e4b\u524d\u521b\u5efa\u7684mosquitto-service\u8bfb\u53d6\u6570\u636e\u7684\u914d\u7f6e\u3002\u4ee5\u4e0b\u662f\u6dfb\u52a0\u7684\u793a\u4f8b\u90e8\u5206\u3002<\/p>\n<pre class=\"post-pre\"><code>&lt;source&gt;\r\n  @type mqtt\r\n  host \"#{ENV['FLUENT_MQTT_BROKER_HOST'] || 'mosquitto-service'}\"\r\n  port \"#{ENV['FLUENT_MQTT_BROKER_PORT'] || '1883'}\"\r\n  topic \"#{ENV['FLUENT_MQTT_SUB_TOPIC'] || 'topic'}\"\r\n  &lt;security&gt;\r\n     username \"#{ENV['FLUENT_MQTT_USER'] || 'user'}\"\r\n     password \"#{ENV['FLUENT_MQTT_PASSWORD'] || 'password'}\"\r\n  &lt;\/security&gt;\r\n  &lt;parse&gt;\r\n    @type \"#{ENV['FLUENT_MQTT_INPUT_FORMAT_TYPE'] || 'json'}\"\r\n  &lt;\/parse&gt;\r\n&lt;\/source&gt;\r\n<\/code><\/pre>\n<p>\u9664\u4e86\u5730\u5740\u4fe1\u606f\u5916\uff0c\u60a8\u8fd8\u53ef\u4ee5\u6307\u5b9a\u8981\u8ba2\u9605\u7684\u4e3b\u9898\u548c\u8f93\u5165\u7c7b\u578b\u3002\u6709\u5173\u5176\u4ed6\u8bbe\u7f6e\uff0c\u8bf7\u53c2\u9605Fluent::Plugin::Mqtt::IO\u3002<\/p>\n<h3>Kafka\u63d2\u4ef6\u7684\u8bbe\u7f6e<\/h3>\n<p>\u672c\u6b21\u4f7f\u7528\u7684\u4ed3\u5e93Dockerfile\u5df2\u7ecf\u9884\u5148\u8bbe\u7f6e\u4e86Kafka\u63d2\u4ef6\u7684\u5b89\u88c5\u3002\uff08\u5982\u679c\u4ec5\u5728Docker\u73af\u5883\u4e2d\u4f7f\u7528\uff0c\u53ef\u4ee5\u5728Fluentd\u7684Docker Hub\u4e0a\u627e\u5230\u81ea\u5b9a\u4e49\u65b9\u6cd5\u7684\u8bf4\u660e\u3002\uff09\u540c\u65f6\uff0c\u73af\u5883\u53d8\u91cf\u4e5f\u53ef\u4ee5\u901a\u8fc7yaml\u6587\u4ef6\u8fdb\u884c\u914d\u7f6e\u3002\u5728\u8fd9\u91cc\uff0c\u6211\u4eec\u8fd8\u6dfb\u52a0\u4e86\u7528\u4e8e\u4e0eKafka\u8fdb\u884c\u901a\u4fe1\u7684TLS\/SSL\u914d\u7f6e\u3002<\/p>\n<p>\u4e3a\u4e86\u8fdb\u884c\u5ba2\u6237\u7aef\u8ba4\u8bc1\uff0c\u6211\u4eec\u51c6\u5907\u4e86\u6839\u8bc1\u4e66\u3001\u5ba2\u6237\u7aef\u8bc1\u4e66\u548c\u5ba2\u6237\u7aef\u5bc6\u94a5\u3002\u8fd9\u6b21\u6211\u4eec\u4f7f\u7528kubectl create secret generic &#8211;from-file=ca_cert.pem &#8211;from-file=client_cert.pem &#8211;from-file=client_key.pem\u521b\u5efa\u4e86\u4e00\u4e2a\u5bc6\u94a5\u3002<\/p>\n<p>\u4e0b\u4e00\u6b65\u662f\u5728\u5305\u542b@type kafka2\u7684\u6807\u7b7e\u90e8\u5206\u4e2d\u7684fluent.conf\u4e2d\u3002<\/p>\n<pre class=\"post-pre\"><code>ssl_ca_cert \/fluentd\/ssl\/ca_cert.pem\r\nssl_client_cert \/fluentd\/ssl\/client_cert.pem\r\nssl_client_cert_key \/fluentd\/ssl\/client_cert_key.pem\r\n<\/code><\/pre>\n<p>\u5728Kafka\u4e2d\u6dfb\u52a0\u4e00\u884c\u4ee5\u542f\u7528\u5ba2\u6237\u7aef\u8ba4\u8bc1\u3002\uff08\u8bf7\u786e\u4fdd\u5728Kafka\u7aef\u6dfb\u52a0\u4e86\u5ba2\u6237\u7aef\u8bc1\u4e66\u7684\u6839\u8bc1\u4e66\uff0c\u4ee5\u4fbf\u8fdb\u884c\u8ba4\u8bc1\uff09<\/p>\n<p>\u53c2\u8003Fluentd-Kafka\u7528\u7684yaml\u6587\u4ef6\u65f6\uff0c\u6211\u521b\u5efa\u4e86\u4e00\u4e2a\u6587\u4ef6\uff0c\u53c2\u8003\u4e86fluentd-kubernetes-daemonset\u9875\u9762\u4e0a\u7684\u6587\u4ef6\u3002\u5728secret\u7684volumes\u8bbe\u5b9a\u4e2d\uff0c\u6211\u4f7f\u7528\u4e86name\u800c\u4e0d\u662fsecretName\uff0c\u4f46\u5728\u63a7\u5236\u53f0\u4e0a\u6536\u5230\u4e86\u8b66\u544a\u3002<\/p>\n<pre class=\"post-pre\"><code>volumes:\r\n- name: fluentd-config\r\n        configMap:\r\n            name: fluent-conf\r\n- name: fluentd-kafka-tls\r\n        secret:\r\n            secretName: tls-secret\r\n<\/code><\/pre>\n<p>\u4e00\u4e0b\u5b50\u8a2d\u5b9a\u5b8c\u6210\u4e86\u3002\u4e4b\u5f8c\u53ef\u4ee5\u4f7f\u7528kubectl apply -f\u547d\u4ee4\u90e8\u7f72\u4e26\u9032\u884c\u64cd\u4f5c\u78ba\u8a8d\u3002<\/p>\n<h3>\u786e\u8ba4\u52a8\u4f5c<\/h3>\n<p>\u6211\u4ece\u672c\u5730\u7684Mosquitto\u8fdb\u884c\u4e86\u53d1\u5e03\u3002\u5173\u4e8e\u4eceMosquitto\u53d1\u9001\u6570\u636e\u5230Fluentd\uff0c\u6211\u5728fluentd.conf\u6587\u4ef6\u4e2d\u7684Kafka \u6807\u7b7e\u4e2d\u5c06\u5176\u66ff\u6362\u4e3a@stdout\u5e76\u8fdb\u884c\u4e86\u90e8\u7f72\uff0c\u7136\u540e\u901a\u8fc7\u7ec8\u7aef\u6216\u4eea\u8868\u677f\u8fdb\u884c\u4e86\u65e5\u5fd7\u786e\u8ba4\u3002\u7531\u4e8eKafka\u7684\u8f93\u51fa\u5df2\u7ecf\u6709Grafana\u4e86\uff0c\u6240\u4ee5\u5982\u679c\u6ca1\u6709\u7684\u8bdd\uff0c\u60a8\u53ef\u4ee5\u4f7f\u7528Kafka-Consumer\u7b49\u5de5\u5177\u6765\u786e\u8ba4\u65e5\u5fd7\u3002<\/p>\n<p>\u8fd9\u6b21\u5b9e\u65bd\u7684\u5185\u5bb9\u5c31\u662f\u4ee5\u4e0a\u4e86\u3002<\/p>\n<p>\u6211\u8a08\u5283\u5728\u4e0d\u4e45\u7684\u5c07\u4f86\u5be6\u73feKafka =&gt; Telegraf \/ Fluentd =&gt; InfluxDB\u7684\u8def\u7531\uff0c\u5e0c\u671b\u80fd\u5728\u90a3\u65b9\u9762\u9032\u884c\u767c\u4f48\u3002<\/p>\n<h1>\u5176\u4ed6\u6240\u53c2\u8003\u7684<\/h1>\n<p>Kubernetes \u6587\u6863<br \/>\nKubernetes Fluentd<br \/>\nKubernetes \u914d\u7f6e\u6620\u5c04\u548c\u5bc6\u94a5\u4f5c\u4e3a Kubernetes \u5377 | \u6f14\u793a \uff08YouTube\uff09<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u76ee\u6807\u4e0e\u6982\u8ff0 y\u01d4 \u8ba9\u6211\u4eec\u4ece\u5927\u5b66\u7684\u673a\u68b0\u81c2\u4e2d\u6536\u96c6\u6570\u636e\u5427\uff01\u56e0\u6b64\uff0c\u6211\u4eec\u8003\u8651\u4e86\u4e00\u79cd\u8bd5\u9a8c\u6027\u7684\u5b9e\u73b0\u65b9\u6848\uff0c\u901a\u8fc7\u5728\u673a\u5668\u4eba\u4e0a\u5b89\u88c5R [&hellip;]<\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-46815","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72mqtt-broker\u548cfluentd\u3002\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd\" \/>\n<meta property=\"og:description\" content=\"\u76ee\u6807\u4e0e\u6982\u8ff0 y\u01d4 \u8ba9\u6211\u4eec\u4ece\u5927\u5b66\u7684\u673a\u68b0\u81c2\u4e2d\u6536\u96c6\u6570\u636e\u5427\uff01\u56e0\u6b64\uff0c\u6211\u4eec\u8003\u8651\u4e86\u4e00\u79cd\u8bd5\u9a8c\u6027\u7684\u5b9e\u73b0\u65b9\u6848\uff0c\u901a\u8fc7\u5728\u673a\u5668\u4eba\u4e0a\u5b89\u88c5R [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72mqtt-broker\u548cfluentd\u3002\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-12-28T05:34:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-03T20:02:43+00:00\" \/>\n<meta name=\"author\" content=\"\u9038, \u79d1\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u9038, \u79d1\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/\",\"name\":\"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-12-28T05:34:39+00:00\",\"dateModified\":\"2024-05-03T20:02:43+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.silicloud.com\/zh\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487\",\"name\":\"\u9038, \u79d1\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g\",\"caption\":\"\u9038, \u79d1\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/keyi\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72mqtt-broker\u548cfluentd\u3002\/","og_locale":"zh_CN","og_type":"article","og_title":"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd","og_description":"\u76ee\u6807\u4e0e\u6982\u8ff0 y\u01d4 \u8ba9\u6211\u4eec\u4ece\u5927\u5b66\u7684\u673a\u68b0\u81c2\u4e2d\u6536\u96c6\u6570\u636e\u5427\uff01\u56e0\u6b64\uff0c\u6211\u4eec\u8003\u8651\u4e86\u4e00\u79cd\u8bd5\u9a8c\u6027\u7684\u5b9e\u73b0\u65b9\u6848\uff0c\u901a\u8fc7\u5728\u673a\u5668\u4eba\u4e0a\u5b89\u88c5R [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72mqtt-broker\u548cfluentd\u3002\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-12-28T05:34:39+00:00","article_modified_time":"2024-05-03T20:02:43+00:00","author":"\u9038, \u79d1","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u9038, \u79d1","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"3 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/","name":"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-12-28T05:34:39+00:00","dateModified":"2024-05-03T20:02:43+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487"},"breadcrumb":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.silicloud.com\/zh\/blog\/"},{"@type":"ListItem","position":2,"name":"\u6211\u5c1d\u8bd5\u5728minikube\u4e0a\u90e8\u7f72MQTT-Broker\u548cFluentd"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487","name":"\u9038, \u79d1","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g","caption":"\u9038, \u79d1"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/keyi\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e5%b0%9d%e8%af%95%e5%9c%a8minikube%e4%b8%8a%e9%83%a8%e7%bd%b2mqtt-broker%e5%92%8cfluentd%e3%80%82\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46815","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=46815"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46815\/revisions"}],"predecessor-version":[{"id":95998,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46815\/revisions\/95998"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=46815"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=46815"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=46815"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}