{"id":46736,"date":"2023-08-14T03:37:09","date_gmt":"2023-10-19T09:32:32","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/"},"modified":"2024-04-30T18:27:14","modified_gmt":"2024-04-30T10:27:14","slug":"46736-2","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/","title":{"rendered":""},"content":{"rendered":"<p>\u5206\u6563\u30e1\u30c3\u30bb\u30fc\u30b8\u30ad\u30e5\u30fckafka\u305d\u306e\u3082\u306e\u306b\u3064\u3044\u3066\u306f\u3053\u3053\u306e\u89e3\u8aac\u304c\u8a73\u3057\u3044\u3002<br \/>\n\u3042\u3068\u306f\u3053\u308c\u3068\u304b\u3002<br \/>\nAWS\u306eAmazonMSK\u306e\u3088\u3046\u306a\u30d5\u30eb\u30de\u30cd\u30fc\u30b8\u30c9\u304c\u697d\u305d\u3046\u3060\u304c\u3001\u307e\u305a\u306fWindows\u4e0a\u3067\u3069\u3093\u306a\u611f\u3058\u304b\u8a66\u3057\u3066\u307f\u308b\u3002<br \/>\n\u74b0\u5883\u306f\u5c11\u3057\u53e4\u3044Windows Server 2012<br \/>\nnode.js\u306f16.x<\/p>\n<h1>kafka\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h1>\n<p>\u3053\u3053\u3068\u304b\u3053\u3053\u3092\u898b\u306a\u304c\u3089\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">\u3068\u308a\u3042\u3048\u305ahttps:\/\/kafka.apache.org\/downloads\u304b\u3089\u30d0\u30a4\u30ca\u30ea\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">7zip\u3067\u89e3\u51cd\u3057\u3066\u9069\u5f53\u306a\u30d5\u30a9\u30eb\u30c0\u306b\u914d\u7f6e<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">zookeeper\u306f\u7d44\u307f\u8fbc\u307f\u3092\u5229\u7528\u3059\u308b\u306e\u3067\u3001bin\\windows\\zookeeper-server-start.bat config\\zookeeper.properties\u3067\u8d77\u52d5<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\u5225\u306e\u30d7\u30ed\u30f3\u30d7\u30c8\u3092\u7acb\u3061\u4e0a\u3052\u3066bin\\windows\\kafka-server-start.bat config\/server.properties<\/ul>\n<p>\u8d77\u52d5\u3057\u3066\u307f\u308b\u3068java.nio.file.AccessDeniedException\u306e\u30a8\u30e9\u30fc<br \/>\nconfig\u4e0b\u306b\u3042\u308blog.dirs\u95a2\u4fc2\u3092\u5168\u3066log.dirs=G:\\tmp\\kraft-combined-logs\u306e\u3088\u3046\u306bWindows\u5f62\u5f0f\u306e\u30d1\u30b9\u306b\u5909\u66f4\u3059\u308b\u3068<br \/>\njava.nio.file.InvalidPathException: Illegal char &lt; &gt; at index 2: G: mpkafka-logs\\meta.properties.tmp<br \/>\n\u3068\u306a\u3063\u305f\u306e\u3067\u3001\\\u3092\\\u3067\u30a8\u30b9\u30b1\u30fc\u30d7\u3057\u3066\u307f\u308b\u304c\u3084\u306f\u308aAccessDeniedException\u30a8\u30e9\u30fc\u3002<br \/>\n\u30d5\u30a9\u30eb\u30c0\u306e\u6a29\u9650\u306e\u554f\u984c\u3067\u3082\u306a\u3044\u3002<br \/>\n\u8abf\u3079\u3066\u307f\u308b\u3068\u5358\u7d14\u306b2.12-3.0.0\u306e\u554f\u984c\u306e\u3088\u3046\u306a\u306e\u3067\u53e4\u3044\u30d0\u30fc\u30b8\u30e7\u30f3\u306ekafka_2.12-2.8.1\u306b\u5909\u66f4\u3059\u308b\u3068\u8a2d\u5b9a\u3092\u5909\u66f4\u3057\u306a\u304f\u3066\u3082\u52d5\u3044\u305f\u3002<\/p>\n<p>\u3055\u3089\u306b\u5225\u306e\u30b3\u30f3\u30bd\u30fc\u30eb\u3092\u958b\u3044\u3066\u30c8\u30d4\u30c3\u30af\u3092\u4f5c\u6210\u3057\u3066\u78ba\u8a8d<br \/>\ntopc\u540d(test)\u304c\u51fa\u3066\u304f\u308b\u306f\u305a\u3002<br \/>\npartitions\u306f\u3068\u308a\u3042\u3048\u305a1\u3067\u8a66\u305b\u3070\u3088\u3044\u304c\u3001consumer\u304c\u8907\u6570\u306e\u5834\u5408\u306f\u305d\u308c\u4ee5\u4e0a\u306epartitions\u304c\u5b58\u5728\u3057\u3066\u3044\u308b\u5fc5\u8981\u3042\u308a\u3002<\/p>\n<pre class=\"post-pre\"><code>bin\\windows\\kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test\r\nbin\\windows\\kafka-topics.bat --list --zookeeper localhost:2181\r\n<\/code><\/pre>\n<p>\u306a\u304a\u3001\u524a\u9664\u306f<br \/>\nbin\\windows\\kafka-topics.bat &#8211;delete &#8211;zookeeper localhost:2181 &#8211;topic test<\/p>\n<h1>\u30e1\u30c3\u30bb\u30fc\u30b8\u9001\u53d7\u4fe1\uff08kafka-node\uff09<\/h1>\n<p>\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u6570\u3092\u898b\u308b\u3068kafkajs\u3084node-rdkafka\u3088\u308akafuka-nod\u306e\u65b9\u304c\u512a\u52e2\u3067\u3001<br \/>\n\u30b5\u30f3\u30d7\u30eb\u3082\u591a\u305d\u3046\u306a\u306e\u3067kafka-node\u3092\u5229\u7528\u3059\u308b\u3002<\/p>\n<p>\u3053\u3053\u3068\u304b\u3067node.js\u304b\u3089\u306e\u30a2\u30af\u30bb\u30b9\u65b9\u6cd5\u304c\u66f8\u3044\u3066\u3042\u308b\u3002<\/p>\n<p>npm install kafka-node<\/p>\n<p>\u30b5\u30f3\u30d7\u30eb\u3068\u306f\u5c11\u3057\u5909\u3048\u3066\u3001express\u3067GET\u3067\u6295\u3052\u305f\u3082\u306e\u3092\u9069\u5f53\u306b\u76f4\u63a5kafka\u306b\u6295\u3052\u3066\u307f\u308b<\/p>\n<pre class=\"post-pre\"><code><span class=\"dl\">'<\/span><span class=\"s1\">use strict<\/span><span class=\"dl\">'<\/span><span class=\"p\">;<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">kafka<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">require<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">kafka-node<\/span><span class=\"dl\">\"<\/span><span class=\"p\">);<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">express<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">require<\/span><span class=\"p\">(<\/span><span class=\"dl\">'<\/span><span class=\"s1\">express<\/span><span class=\"dl\">'<\/span><span class=\"p\">);<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">app<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">express<\/span><span class=\"p\">();<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">port<\/span> <span class=\"o\">=<\/span> <span class=\"mi\">3000<\/span><span class=\"p\">;<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">Producer<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">kafka<\/span><span class=\"p\">.<\/span><span class=\"nx\">HighLevelProducer<\/span><span class=\"p\">;<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">Consumer<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">kafka<\/span><span class=\"p\">.<\/span><span class=\"nx\">Consumer<\/span><span class=\"p\">;<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">client<\/span> <span class=\"o\">=<\/span> <span class=\"k\">new<\/span> <span class=\"nx\">kafka<\/span><span class=\"p\">.<\/span><span class=\"nx\">KafkaClient<\/span><span class=\"p\">({<\/span>\r\n    <span class=\"na\">kafkaHost<\/span><span class=\"p\">:<\/span> <span class=\"dl\">\"<\/span><span class=\"s2\">localhost:9092<\/span><span class=\"dl\">\"<\/span>\r\n<span class=\"p\">});<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">producer<\/span> <span class=\"o\">=<\/span> <span class=\"k\">new<\/span> <span class=\"nx\">Producer<\/span><span class=\"p\">(<\/span><span class=\"nx\">client<\/span><span class=\"p\">,<\/span> <span class=\"p\">{<\/span>\r\n    <span class=\"c1\">\/\/ Partitioner type (default = 0, random = 1, cyclic = 2, keyed = 3, custom = 4), default 0<\/span>\r\n    <span class=\"na\">partitionerType<\/span><span class=\"p\">:<\/span> <span class=\"mi\">1<\/span>\r\n<span class=\"p\">});<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">consumer<\/span> <span class=\"o\">=<\/span> <span class=\"k\">new<\/span> <span class=\"nx\">Consumer<\/span><span class=\"p\">(<\/span>\r\n    <span class=\"nx\">client<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"p\">[{<\/span><span class=\"na\">topic<\/span><span class=\"p\">:<\/span> <span class=\"dl\">\"<\/span><span class=\"s2\">test<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span> <span class=\"na\">partision<\/span><span class=\"p\">:<\/span><span class=\"mi\">0<\/span><span class=\"p\">}],<\/span>\r\n    <span class=\"p\">{<\/span>\r\n        <span class=\"na\">groupId<\/span><span class=\"p\">:<\/span> <span class=\"dl\">\"<\/span><span class=\"s2\">my-consumer<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span>\r\n        <span class=\"na\">autoCommit<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span><span class=\"p\">,<\/span>\r\n        <span class=\"na\">fromOffset<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span>\r\n    <span class=\"p\">}<\/span>\r\n<span class=\"p\">);<\/span>\r\n\r\n<span class=\"nx\">app<\/span><span class=\"p\">.<\/span><span class=\"kd\">get<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">\/<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span> <span class=\"kd\">function<\/span><span class=\"p\">(<\/span><span class=\"nx\">req<\/span><span class=\"p\">,<\/span> <span class=\"nx\">res<\/span><span class=\"p\">,<\/span> <span class=\"nx\">next<\/span><span class=\"p\">){<\/span>\r\n    <span class=\"kd\">const<\/span> <span class=\"nx\">name<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">req<\/span><span class=\"p\">.<\/span><span class=\"nx\">query<\/span><span class=\"p\">.<\/span><span class=\"nx\">name<\/span><span class=\"p\">;<\/span>\r\n    <span class=\"kd\">const<\/span> <span class=\"nx\">age<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">req<\/span><span class=\"p\">.<\/span><span class=\"nx\">query<\/span><span class=\"p\">.<\/span><span class=\"nx\">age<\/span><span class=\"p\">;<\/span>\r\n    <span class=\"kd\">const<\/span> <span class=\"nx\">message<\/span> <span class=\"o\">=<\/span> <span class=\"p\">[<\/span>\r\n        <span class=\"p\">{<\/span>\r\n            <span class=\"na\">topic<\/span><span class=\"p\">:<\/span> <span class=\"dl\">\"<\/span><span class=\"s2\">test<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span>\r\n            <span class=\"na\">messages<\/span><span class=\"p\">:<\/span> <span class=\"nx\">JSON<\/span><span class=\"p\">.<\/span><span class=\"nx\">stringify<\/span><span class=\"p\">({<\/span><span class=\"na\">name<\/span><span class=\"p\">:<\/span> <span class=\"nx\">name<\/span><span class=\"p\">,<\/span> <span class=\"na\">age<\/span><span class=\"p\">:<\/span> <span class=\"nx\">age<\/span><span class=\"p\">})<\/span>\r\n        <span class=\"p\">}<\/span>\r\n    <span class=\"p\">];<\/span>\r\n    <span class=\"nx\">producer<\/span><span class=\"p\">.<\/span><span class=\"nx\">send<\/span><span class=\"p\">(<\/span><span class=\"nx\">message<\/span><span class=\"p\">,<\/span> <span class=\"p\">(<\/span><span class=\"nx\">err<\/span><span class=\"p\">,<\/span> <span class=\"nx\">data<\/span><span class=\"p\">)<\/span> <span class=\"o\">=&gt;<\/span> <span class=\"p\">{<\/span>\r\n        <span class=\"k\">if<\/span> <span class=\"p\">(<\/span><span class=\"nx\">err<\/span><span class=\"p\">)<\/span> <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"nx\">err<\/span><span class=\"p\">);<\/span>\r\n        <span class=\"k\">else<\/span> <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"dl\">'<\/span><span class=\"s1\">send messages<\/span><span class=\"dl\">'<\/span><span class=\"p\">);<\/span>\r\n        <span class=\"c1\">\/\/process.exit();<\/span>\r\n    <span class=\"p\">});<\/span>\r\n    <span class=\"nx\">res<\/span><span class=\"p\">.<\/span><span class=\"nx\">status<\/span><span class=\"p\">(<\/span><span class=\"mi\">200<\/span><span class=\"p\">).<\/span><span class=\"nx\">send<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">SEND<\/span><span class=\"dl\">\"<\/span><span class=\"p\">);<\/span> <span class=\"c1\">\/\/ \u30c6\u30b9\u30c8\u306a\u306e\u3067\u5e38\u306b\u6210\u529f\u6271\u3044<\/span>\r\n<span class=\"p\">});<\/span>\r\n\r\n<span class=\"c1\">\/\/ \u53d7\u4fe1\u3059\u308b\u5834\u5408<\/span>\r\n<span class=\"nx\">consumer<\/span><span class=\"p\">.<\/span><span class=\"nx\">on<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">message<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span> <span class=\"p\">(<\/span><span class=\"nx\">message<\/span><span class=\"p\">,<\/span> <span class=\"nx\">err<\/span><span class=\"p\">)<\/span> <span class=\"o\">=&gt;<\/span> <span class=\"p\">{<\/span>\r\n    <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"nx\">message<\/span><span class=\"p\">);<\/span>\r\n<span class=\"p\">});<\/span>\r\n\r\n<span class=\"nx\">app<\/span><span class=\"p\">.<\/span><span class=\"nx\">listen<\/span><span class=\"p\">(<\/span><span class=\"nx\">port<\/span><span class=\"p\">,<\/span> <span class=\"p\">()<\/span> <span class=\"o\">=&gt;<\/span> <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"s2\">`Example app listening on port <\/span><span class=\"p\">${<\/span><span class=\"nx\">port<\/span><span class=\"p\">}<\/span><span class=\"s2\">!`<\/span><span class=\"p\">));<\/span>\r\n<\/code><\/pre>\n<p>\u9001\u4fe1\u51fa\u6765\u3066\u3044\u308b\u304b\u3069\u3046\u304b\u3092\u30b3\u30de\u30f3\u30c9\u3067\u3082\u78ba\u8a8d\u3057\u3066\u307f\u308b\u3068\u3001\u98db\u3093\u3067\u304d\u3066\u3044\u308b\u4e8b\u304c\u308f\u304b\u308b\u3002<br \/>\n&#8211;from-beginning\u3092\u6307\u5b9a\u3059\u308b\u3068\u6700\u521d\u304b\u3089\u8aad\u307f\u8fbc\u3080\u3002<\/p>\n<pre class=\"post-pre\"><code>bin\\windows\\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic test --from-beginning\r\n<\/code><\/pre>\n<p>\u53d7\u4fe1\u306b\u306f\u3044\u304f\u3064\u304b\u30d1\u30bf\u30fc\u30f3\u304c\u3042\u308b\u3088\u3046\u3067\u3001\u3053\u3053\u898b\u308b\u3068<br \/>\nnew kafka.ConsumerGroupStream\u3092\u4f7f\u3046\u306e\u304c\u4e00\u756a\u9ad8\u6a5f\u80fd\u3063\u307d\u3044\u3002<br \/>\n\u8a73\u7d30\u306f\u516c\u5f0f<\/p>\n<p>SQL\u3092\u4f7f\u3063\u3066kafka\u3092\u30b3\u30f3\u30c8\u30ed\u30fc\u30eb\u3059\u308bKSQL\u306e\u3088\u3046\u306a\u3082\u306e\u3082\u3042\u308b\u304cMSK\u306f\u5bfe\u5fdc\u3057\u3066\u3044\u306a\u3055\u305d\u3046\u3002<\/p>\n<h1>\u30de\u30eb\u30c1Consumer\u5316<\/h1>\n<p>\u8d77\u52d5\u6642\u306b<br \/>\nError while executing topic command : Replication factor: 1 larger than available brokers: 0.<br \/>\n\u3068\u3044\u3046\u3088\u3046\u306a\u30a8\u30e9\u30fc\u304c\u51fa\u3066\u7acb\u3061\u4e0a\u304c\u3089\u306a\u3044\u4e8b\u304c\u3042\u3063\u305f\u304c\u3001tmp\u3092\u5168\u3066\u524a\u9664\u3057\u3066\u3001\u30a2\u30d7\u30ea\u3082\u7d42\u4e86\u3055\u305b\u3066\u304b\u3089\u8d77\u52d5\u3055\u305b\u308b\u3068\u7acb\u3061\u4e0a\u304c\u3063\u305f\u3002<\/p>\n<p>tmp\u7b49\u3092\u524a\u9664\u3057\u3066\u304b\u3089\u518d\u8d77\u52d5\u3057\u3066<br \/>\nbin\\windows\\kafka-topics.bat &#8211;create &#8211;zookeeper localhost:2181 &#8211;replication-factor 1 &#8211;partitions 2 &#8211;topic test<br \/>\n\u3068\u3057\u3066partition\u3092\u8907\u6570\u3067\u7acb\u3061\u4e0a\u3052\u308b\u3002<\/p>\n<p>Consumer\u306f\u5148\u306enode.js\u306e\u3082\u306e\u304b\u3089\u30dd\u30fc\u30c8\u30923001\u306b\u5909\u66f4\u3057\u305f\u3082\u306e\u3092\u4f5c\u6210\u3002<br \/>\npartition\u3092\u6307\u5b9a\u3057\u3066\u3044\u308b\u305f\u3081\u3001[{topic: &#8220;test&#8221;, partition:1}],\u306e\u3088\u3046\u306b\u3057\u3066\u5225\u306e\u3082\u306e\u3092\u6307\u5b9a\u3057\u3066\u8d77\u52d5\u3002<br \/>\n\u30d6\u30e9\u30a6\u30b6\u304b\u3089\u767b\u9332\u3057\u3066\u307f\u308b\u3068\u5225\u3005\u306e\u53d7\u4fe1\u3092\u3057\u3066\u3044\u308b\u4e8b\u304c\u5206\u304b\u308b\u3002<\/p>\n<p>\u3068\u306f\u3044\u3048\u3001\u3053\u308c\u3067\u306f\u81ea\u52d5\u3067partition\u304c\u5272\u308a\u632f\u3089\u308c\u306a\u3044\u306e\u3067\u4f7f\u3044\u306b\u304f\u3044\u3002<br \/>\nConsumerGroupStream\u3092\u4f7f\u3063\u3066\u30b0\u30eb\u30fc\u30d7\u3067\u5272\u308a\u632f\u3089\u308c\u308b\u3088\u3046\u306b\u3059\u308b\u3002<br \/>\n\uff12\u3064\u7528\u610f\u3059\u308b\u304c\u3001\u30dd\u30fc\u30c8\u306e\u9055\u3044\u306e\u307f\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"dl\">'<\/span><span class=\"s1\">use strict<\/span><span class=\"dl\">'<\/span><span class=\"p\">;<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">kafka<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">require<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">kafka-node<\/span><span class=\"dl\">\"<\/span><span class=\"p\">);<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">express<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">require<\/span><span class=\"p\">(<\/span><span class=\"dl\">'<\/span><span class=\"s1\">express<\/span><span class=\"dl\">'<\/span><span class=\"p\">);<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">app<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">express<\/span><span class=\"p\">();<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">port<\/span> <span class=\"o\">=<\/span> <span class=\"mi\">3000<\/span><span class=\"p\">;<\/span>\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">Producer<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">kafka<\/span><span class=\"p\">.<\/span><span class=\"nx\">HighLevelProducer<\/span><span class=\"p\">;<\/span>\r\n\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">producer<\/span> <span class=\"o\">=<\/span> <span class=\"k\">new<\/span> <span class=\"nx\">Producer<\/span><span class=\"p\">(<\/span><span class=\"nx\">client<\/span><span class=\"p\">,<\/span> <span class=\"p\">{<\/span>\r\n    <span class=\"na\">partitionerType<\/span><span class=\"p\">:<\/span> <span class=\"mi\">1<\/span>\r\n<span class=\"p\">});<\/span>\r\n\r\n<span class=\"kd\">const<\/span> <span class=\"nx\">consumer<\/span> <span class=\"o\">=<\/span> <span class=\"k\">new<\/span> <span class=\"nx\">kafka<\/span><span class=\"p\">.<\/span><span class=\"nx\">ConsumerGroupStream<\/span><span class=\"p\">({<\/span>\r\n    <span class=\"na\">kafkaHost<\/span><span class=\"p\">:<\/span> <span class=\"dl\">\"<\/span><span class=\"s2\">localhost:9092<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"na\">groupId<\/span><span class=\"p\">:<\/span> <span class=\"dl\">'<\/span><span class=\"s1\">my-consumer<\/span><span class=\"dl\">'<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"na\">autoCommit<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"na\">fromOffset<\/span><span class=\"p\">:<\/span> <span class=\"dl\">'<\/span><span class=\"s1\">earliest<\/span><span class=\"dl\">'<\/span>\r\n  <span class=\"p\">},<\/span> <span class=\"dl\">'<\/span><span class=\"s1\">test<\/span><span class=\"dl\">'<\/span><span class=\"p\">)<\/span>\r\n\r\n<span class=\"nx\">app<\/span><span class=\"p\">.<\/span><span class=\"kd\">get<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">\/send<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span> <span class=\"kd\">function<\/span><span class=\"p\">(<\/span><span class=\"nx\">req<\/span><span class=\"p\">,<\/span> <span class=\"nx\">res<\/span><span class=\"p\">,<\/span> <span class=\"nx\">next<\/span><span class=\"p\">){<\/span>\r\n    <span class=\"kd\">const<\/span> <span class=\"nx\">name<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">req<\/span><span class=\"p\">.<\/span><span class=\"nx\">query<\/span><span class=\"p\">.<\/span><span class=\"nx\">name<\/span><span class=\"p\">;<\/span>\r\n    <span class=\"kd\">const<\/span> <span class=\"nx\">age<\/span> <span class=\"o\">=<\/span> <span class=\"nx\">req<\/span><span class=\"p\">.<\/span><span class=\"nx\">query<\/span><span class=\"p\">.<\/span><span class=\"nx\">age<\/span><span class=\"p\">;<\/span>\r\n    <span class=\"kd\">const<\/span> <span class=\"nx\">message<\/span> <span class=\"o\">=<\/span> <span class=\"p\">[<\/span>\r\n        <span class=\"p\">{<\/span>\r\n            <span class=\"na\">topic<\/span><span class=\"p\">:<\/span> <span class=\"dl\">\"<\/span><span class=\"s2\">test<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span>\r\n            <span class=\"na\">messages<\/span><span class=\"p\">:<\/span> <span class=\"nx\">JSON<\/span><span class=\"p\">.<\/span><span class=\"nx\">stringify<\/span><span class=\"p\">({<\/span><span class=\"na\">name<\/span><span class=\"p\">:<\/span> <span class=\"nx\">name<\/span><span class=\"p\">,<\/span> <span class=\"na\">age<\/span><span class=\"p\">:<\/span> <span class=\"nx\">age<\/span><span class=\"p\">})<\/span>\r\n        <span class=\"p\">}<\/span>\r\n    <span class=\"p\">];<\/span>\r\n    <span class=\"nx\">producer<\/span><span class=\"p\">.<\/span><span class=\"nx\">send<\/span><span class=\"p\">(<\/span><span class=\"nx\">message<\/span><span class=\"p\">,<\/span> <span class=\"p\">(<\/span><span class=\"nx\">err<\/span><span class=\"p\">,<\/span> <span class=\"nx\">data<\/span><span class=\"p\">)<\/span> <span class=\"o\">=&gt;<\/span> <span class=\"p\">{<\/span>\r\n        <span class=\"k\">if<\/span> <span class=\"p\">(<\/span><span class=\"nx\">err<\/span><span class=\"p\">)<\/span> <span class=\"p\">{<\/span><span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"nx\">err<\/span><span class=\"p\">);<\/span> <span class=\"nx\">res<\/span><span class=\"p\">.<\/span><span class=\"nx\">status<\/span><span class=\"p\">(<\/span><span class=\"mi\">500<\/span><span class=\"p\">);}<\/span>\r\n        <span class=\"k\">else<\/span> <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"dl\">'<\/span><span class=\"s1\">send messages<\/span><span class=\"dl\">'<\/span><span class=\"p\">);<\/span>\r\n        <span class=\"c1\">\/\/process.exit();<\/span>\r\n    <span class=\"p\">});<\/span>\r\n    <span class=\"nx\">res<\/span><span class=\"p\">.<\/span><span class=\"nx\">status<\/span><span class=\"p\">(<\/span><span class=\"mi\">200<\/span><span class=\"p\">).<\/span><span class=\"nx\">send<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">SEND<\/span><span class=\"dl\">\"<\/span><span class=\"p\">);<\/span>\r\n<span class=\"p\">});<\/span>\r\n\r\n<span class=\"c1\">\/\/ message\u3067\u306f\u306a\u304fdata\u306b\u306a\u308b<\/span>\r\n<span class=\"nx\">consumer<\/span><span class=\"p\">.<\/span><span class=\"nx\">on<\/span><span class=\"p\">(<\/span><span class=\"dl\">\"<\/span><span class=\"s2\">data<\/span><span class=\"dl\">\"<\/span><span class=\"p\">,<\/span> <span class=\"p\">(<\/span><span class=\"nx\">message<\/span><span class=\"p\">,<\/span> <span class=\"nx\">err<\/span><span class=\"p\">)<\/span> <span class=\"o\">=&gt;<\/span> <span class=\"p\">{<\/span>\r\n    <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"nx\">message<\/span><span class=\"p\">);<\/span>\r\n<span class=\"p\">});<\/span>\r\n\r\n<span class=\"nx\">app<\/span><span class=\"p\">.<\/span><span class=\"nx\">listen<\/span><span class=\"p\">(<\/span><span class=\"nx\">port<\/span><span class=\"p\">,<\/span> <span class=\"p\">()<\/span> <span class=\"o\">=&gt;<\/span> <span class=\"nx\">console<\/span><span class=\"p\">.<\/span><span class=\"nx\">log<\/span><span class=\"p\">(<\/span><span class=\"s2\">`Example app listening on port <\/span><span class=\"p\">${<\/span><span class=\"nx\">port<\/span><span class=\"p\">}<\/span><span class=\"s2\">!`<\/span><span class=\"p\">));<\/span>\r\n<\/code><\/pre>\n<p>\u3053\u308c\u3067\u5b9f\u9a13\u3059\u308b\u3068\u5404\u3005\u304c\u7570\u306a\u308b\u30c7\u30fc\u30bf\u3092\u53d7\u4fe1\u51fa\u6765\u305f\u306e\u3067\u6982\u306dOK\u307d\u3044\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5206\u6563\u30e1\u30c3\u30bb\u30fc\u30b8\u30ad\u30e5\u30fckafka\u305d\u306e\u3082\u306e\u306b\u3064\u3044\u3066\u306f\u3053\u3053\u306e\u89e3\u8aac\u304c\u8a73\u3057\u3044\u3002 \u3042\u3068\u306f\u3053\u308c\u3068\u304b\u3002 AWS\u306eAmazonM [&hellip;]<\/p>\n","protected":false},"author":11,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-46736","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>- Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"\u5206\u6563\u30e1\u30c3\u30bb\u30fc\u30b8\u30ad\u30e5\u30fckafka\u305d\u306e\u3082\u306e\u306b\u3064\u3044\u3066\u306f\u3053\u3053\u306e\u89e3\u8aac\u304c\u8a73\u3057\u3044\u3002 \u3042\u3068\u306f\u3053\u308c\u3068\u304b\u3002 AWS\u306eAmazonM [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-19T09:32:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-30T10:27:14+00:00\" \/>\n<meta name=\"author\" content=\"\u65b0, \u97f5\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u65b0, \u97f5\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/\",\"name\":\"- Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-10-19T09:32:32+00:00\",\"dateModified\":\"2024-04-30T10:27:14+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9\",\"name\":\"\u65b0, \u97f5\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g\",\"caption\":\"\u65b0, \u97f5\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/yunxin\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/","og_locale":"zh_CN","og_type":"article","og_description":"\u5206\u6563\u30e1\u30c3\u30bb\u30fc\u30b8\u30ad\u30e5\u30fckafka\u305d\u306e\u3082\u306e\u306b\u3064\u3044\u3066\u306f\u3053\u3053\u306e\u89e3\u8aac\u304c\u8a73\u3057\u3044\u3002 \u3042\u3068\u306f\u3053\u308c\u3068\u304b\u3002 AWS\u306eAmazonM [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-10-19T09:32:32+00:00","article_modified_time":"2024-04-30T10:27:14+00:00","author":"\u65b0, \u97f5","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u65b0, \u97f5","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"2 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/","name":"- Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-10-19T09:32:32+00:00","dateModified":"2024-04-30T10:27:14+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/"]}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9","name":"\u65b0, \u97f5","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g","caption":"\u65b0, \u97f5"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/yunxin\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46736-2\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46736","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=46736"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46736\/revisions"}],"predecessor-version":[{"id":93552,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46736\/revisions\/93552"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=46736"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=46736"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=46736"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}