{"id":46661,"date":"2023-01-07T04:50:34","date_gmt":"2024-01-23T14:26:34","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/"},"modified":"2024-04-29T08:52:19","modified_gmt":"2024-04-29T00:52:19","slug":"46661-2","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/","title":{"rendered":""},"content":{"rendered":"

Kafka\u3068\u306f\uff1f<\/h2>\n

Kafka
\n\u5927\u91cf\u306e\u30e1\u30c3\u30bb\u30fc\u30b8\u51e6\u7406\u306b\u5229\u7528\u3059\u308b\u30e1\u30c3\u30bb\u30fc\u30b8\u30f3\u30b0\u30b7\u30b9\u30c6\u30e0\u3002
\n\u5206\u6563\u51e6\u7406\u306fZooKeeper\u304c\u62c5\u3046\u3002<\/p>\n

\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h2>\n

zookeeper\u304c\u5fc5\u8981\u3002
\n\u8a73\u3057\u304f\u306f\u3053\u3061\u3089\u306e\u8a18\u4e8b\u3092\u53c2\u7167\u3002<\/p>\n

$ <\/span>brew install <\/span>zookeeper\r\n<\/code><\/pre>\n
kafka\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/p>\n
$ <\/span>brew install <\/span>kafka\r\n<\/code><\/pre>\n
zookeeper\u3092\u8d77\u52d5<\/h2>\n
$ <\/span>sudo <\/span>zkServer start\r\nZooKeeper JMX enabled by default\r\nUsing config: \/usr\/local\/etc\/zookeeper\/zoo.cfg\r\nStarting zookeeper ... STARTED\r\n<\/code><\/pre>\n
kafka\u3092\u8d77\u52d5<\/h2>\n
# \u30b3\u30de\u30f3\u30c9\u306e\u78ba\u8a8d<\/span>\r\n$ <\/span>which kafka-server-start\r\n\/usr\/local\/bin\/kafka-server-start\r\n\r\n# \u8d77\u52d5<\/span>\r\n$ <\/span>sudo <\/span>kafka-server-start \/usr\/local\/etc\/kafka\/server.properties\r\n<\/code><\/pre>\n
\u30e1\u30c3\u30bb\u30fc\u30b8\u30f3\u30b0\u3092\u8a66\u3057\u3066\u307f\u308b<\/h2>\n
kafka\u3067\u306f\u300ctopic\u300d\u3068\u3044\u3046\u5358\u4f4d\u3067\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u3084\u308a\u53d6\u308a\u3059\u308b\u6a21\u69d8\u3002
\n\u3053\u3053\u3067\u306f\u300chello_kafka\u300d\u3068\u3044\u3046topic\u3092\u9001\u4fe1(produce) -> \u53d7\u4fe1(consume)\u3059\u308b\u3002<\/p>\n
\u30c8\u30d4\u30c3\u30af\u306e\u751f\u6210<\/h3>\n
# \u30b3\u30de\u30f3\u30c9\u306e\u78ba\u8a8d<\/span>\r\n$ <\/span>which kafka-topics\r\n\/usr\/local\/bin\/kafka-topics\r\n\r\n# \u30c8\u30d4\u30c3\u30af\u306e\u4f5c\u6210<\/span>\r\n$ <\/span>kafka-topics --create<\/span> --zookeeper<\/span> localhost:2181 --replication-factor<\/span> 1 --partitions<\/span> 1 --topic<\/span> hello_kafka\r\nWARNING: Due to limitations in <\/span>metric names, topics with a period (<\/span>'.'<\/span>)<\/span> or underscore (<\/span>'_'<\/span>)<\/span> could collide. To avoid issues it is best to use either, but not both.\r\nCreated topic \"hello_kafka\"<\/span>.<\/span>\r\n\r\n# \u30c8\u30d4\u30c3\u30af\u306e\u751f\u6210\u78ba\u8a8d<\/span>\r\n$ <\/span>kafka-topics --list<\/span> --zookeeper<\/span> localhost:2181\r\nhello_kafka\r\n<\/code><\/pre>\n
\u53d7\u4fe1\u5074(consumer)<\/h3>\n
# \u30b3\u30de\u30f3\u30c9\u306e\u78ba\u8a8d<\/span>\r\n$ <\/span>which kafka-console-consumer\r\n\/usr\/local\/bin\/kafka-console-consumer\r\n\r\n# \u53d7\u4fe1\u5f85\u6a5f<\/span>\r\n$ <\/span>kafka-console-consumer --zookeeper<\/span> localhost:2181 --topic<\/span> hello_kafka --from-beginning<\/span>\r\n<\/code><\/pre>\n
\u9001\u4fe1\u5074(producer)<\/h3>\n
# \u30b3\u30de\u30f3\u30c9\u306e\u78ba\u8a8d\r\n$ which kafka-console-producer\r\n\/usr\/local\/bin\/kafka-console-producer\r\n\r\n# \u30e1\u30c3\u30bb\u30fc\u30b8\u9001\u4fe1(\u5bfe\u8a71\u578b)\r\n$ kafka-console-producer --broker-list localhost:9092 --topic hello_kafka\r\nmy first kafka message!\r\n<\/code><\/pre>\n
consumer\u5074\u3067\u4e0b\u8a18\u306e\u3088\u3046\u306b\u30e1\u30c3\u30bb\u30fc\u30b8\u304c\u53d7\u4fe1\u3067\u304d\u308c\u3070OK<\/p>\n
my first kafka message!\r\n<\/code><\/pre>\n
php\u3067\u4f7f\u3063\u3066\u307f\u308b<\/h2>\n
\u516c\u5f0f\u306b\u5e7e\u3064\u304b\u63a8\u5968\u306e\u30e9\u30a4\u30d6\u30e9\u30ea\u304c\u8f09\u3063\u3066\u3044\u308b\u3002
\n\u3053\u3053\u3067\u306fphpkafka\u3092\u5229\u7528\u3059\u308b\u3002<\/p>\n
\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h3>\n
$ <\/span>git clone https:\/\/github.com\/edenhill\/librdkafka\/\r\n$ <\/span>cd <\/span>librdkafka\r\n$ <\/span>.\/configure\r\n$ <\/span>make\r\n$ <\/span>sudo <\/span>make install<\/span>\r\n<\/code><\/pre>\n
$ <\/span>git clone git@github.com:EVODelavega\/phpkafka.git\r\n$ <\/span>cd <\/span>phpkafka\/\r\n$ <\/span>phpize\r\n$ <\/span>.\/configure --enable-kafka<\/span>\r\n$ <\/span>make\r\n$ <\/span>make test\r\n<\/span>Do you want to send this report now? [<\/span>Yns]: n\r\n$ <\/span>sudo <\/span>make install\r\n<\/span>Installing shared extensions:     \/usr\/local\/Cellar\/php56\/5.6.29_5\/lib\/php\/extensions\/no-debug-non-zts-20131226\/\r\n<\/code><\/pre>\n
Mac\u4e0a\u3067\u30d1\u30b9\u3092\u901a\u3059\u3002<\/p>\n
# php.ini\u306e\u5834\u6240\u3092\u78ba\u8a8d<\/span>\r\n$ <\/span>php -i<\/span> | grep <\/span>php.ini\r\nConfiguration File (<\/span>php.ini)<\/span> Path =><\/span> \/usr\/local\/etc\/php\/5.6\r\nLoaded Configuration File =><\/span> \/usr\/local\/etc\/php\/5.6\/php.ini\r\n\r\n$ <\/span>sudo <\/span>sh -c<\/span> 'echo \"extension=kafka.so\" >> \/usr\/local\/etc\/php\/5.6\/conf.d\/kafka.ini'<\/span>\r\n\r\n# cli<\/span>\r\n$ <\/span>mkdir<\/span> -p<\/span> \/usr\/local\/etc\/php\/5.6\/cli\/conf.d\r\n$ <\/span>sudo <\/span>sh -c<\/span> 'echo \"extension=kafka.so\" >> \/usr\/local\/etc\/php\/5.6\/cli\/conf.d\/20-kafka.ini'<\/span>\r\n\r\n# \u78ba\u8a8d<\/span>\r\n$ <\/span>php -m<\/span> | grep <\/span>kafka\r\nkafka\r\n<\/code><\/pre>\n
producer \/ consumer\u3092\u4f5c\u6210<\/h3>\n
\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306f\u3053\u3061\u3089\u3002
\n\u3053\u3061\u3089\u306e\u8a18\u4e8b\u306e\u307b\u3046\u304c\u308f\u304b\u308a\u3084\u3059\u3044\u306e\u3067\u5199\u7d4c\u3055\u305b\u3066\u3044\u305f\u3060\u304d\u307e\u3057\u305fmm<\/p>\n
producer(\u9001\u4fe1\u5074)<\/h4>\n
<?php<\/span>\r\n\r\nif<\/span> (<\/span>$argc<\/span> <<\/span> 2<\/span>)<\/span> {<\/span>\r\n    exit<\/span>(<\/span>'\u9001\u4fe1\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u6307\u5b9a\u3057\u3066\u304f\u3060\u3055\u3044'<\/span>.<\/span>PHP_EOL<\/span>);<\/span>\r\n}<\/span>\r\n$message<\/span> =<\/span> $argv<\/span>[<\/span>1<\/span>];<\/span>\r\n\r\n$kafka<\/span> =<\/span> new<\/span> Kafka<\/span>(<\/span>'localhost:9092'<\/span>);<\/span>\r\ntry<\/span> {<\/span>\r\n    \/\/ \u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u9001\u4fe1<\/span>\r\n    $kafka<\/span>-><\/span>produce<\/span>(<\/span>'hello_topic'<\/span>,<\/span> $message<\/span>);<\/span>\r\n}<\/span> catch<\/span> (<\/span>Exception<\/span> $e<\/span>)<\/span> {<\/span>\r\n    exit<\/span>(<\/span>$e<\/span>-><\/span>getMessage<\/span>()<\/span>.<\/span>PHP_EOL<\/span>);<\/span>\r\n}<\/span>\r\n\r\n$kafka<\/span>-><\/span>disconnect<\/span>(<\/span>Kafka<\/span>::<\/span>MODE_PRODUCER<\/span>);<\/span>\r\nexit<\/span>(<\/span>'done send message. message='<\/span>.<\/span>$message<\/span>.<\/span>PHP_EOL<\/span>);<\/span>\r\n<\/code><\/pre>\n
consumer(\u53d7\u4fe1\u5074)<\/h4>\n
<?php<\/span>\r\n\r\n$kafka<\/span> =<\/span> new<\/span> Kafka<\/span>(<\/span>'localhost:9092'<\/span>);<\/span>\r\n$partitions<\/span> =<\/span> $kafka<\/span>-><\/span>getPartitionsForTopic<\/span>(<\/span>'hello_topic'<\/span>);<\/span>\r\n$kafka<\/span>-><\/span>setPartition<\/span>(<\/span>$partitions<\/span>[<\/span>0<\/span>]);<\/span>\r\n$offset<\/span> =<\/span> 1<\/span>;<\/span>\r\n$size<\/span> =<\/span> 1<\/span>;<\/span>\r\n\r\nwhile<\/span> (<\/span>1<\/span>)<\/span> {<\/span>\r\n    try<\/span> {<\/span>\r\n        \/\/ \u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u53d7\u4fe1<\/span>\r\n        $messages<\/span> =<\/span> $kafka<\/span>-><\/span>consume<\/span>(<\/span>'hello_topic'<\/span>,<\/span> $offset<\/span>,<\/span> $size<\/span>);<\/span>\r\n        if<\/span> (<\/span>count<\/span>(<\/span>$messages<\/span>)<\/span> ><\/span> 0<\/span>)<\/span> {<\/span>\r\n            foreach<\/span> (<\/span>$messages<\/span> as<\/span> $message<\/span>)<\/span> {<\/span>\r\n                echo<\/span> $message<\/span>.<\/span>PHP_EOL<\/span>;<\/span>\r\n                $offset<\/span> +=<\/span> 1<\/span>;<\/span>\r\n            }<\/span>\r\n        }<\/span>\r\n    }<\/span> catch<\/span> (<\/span>Exception<\/span> $e<\/span>)<\/span> {<\/span>\r\n        echo<\/span> $e<\/span>-><\/span>getMessage<\/span>()<\/span>.<\/span>PHP_EOL<\/span>;<\/span>\r\n        break<\/span>;<\/span>\r\n    }<\/span>\r\n}<\/span>\r\n\r\n$kafka<\/span>-><\/span>disconnect<\/span>();<\/span>\r\n<\/code><\/pre>\n
\u5b9f\u884c<\/h3>\n
# \u9001\u4fe1<\/span>\r\n$ <\/span>php producer.php \"this is test message\"<\/span>\r\ndone <\/span>send message. message<\/span>=<\/span>this is test <\/span>message\r\n\r\n# \u53d7\u4fe1<\/span>\r\n$ <\/span>php consumer.php\r\nthis is test <\/span>message\r\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"
Kafka\u3068\u306f\uff1f Kafka \u5927\u91cf\u306e\u30e1\u30c3\u30bb\u30fc\u30b8\u51e6\u7406\u306b\u5229\u7528\u3059\u308b\u30e1\u30c3\u30bb\u30fc\u30b8\u30f3\u30b0\u30b7\u30b9\u30c6\u30e0\u3002 \u5206\u6563\u51e6\u7406\u306fZooKeep […]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-46661","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"\n- Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"Kafka\u3068\u306f\uff1f Kafka \u5927\u91cf\u306e\u30e1\u30c3\u30bb\u30fc\u30b8\u51e6\u7406\u306b\u5229\u7528\u3059\u308b\u30e1\u30c3\u30bb\u30fc\u30b8\u30f3\u30b0\u30b7\u30b9\u30c6\u30e0\u3002 \u5206\u6563\u51e6\u7406\u306fZooKeep […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-23T14:26:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-29T00:52:19+00:00\" \/>\n<meta name=\"author\" content=\"\u6e05, \u626c\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u6e05, \u626c\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/\",\"name\":\"- Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2024-01-23T14:26:34+00:00\",\"dateModified\":\"2024-04-29T00:52:19+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/cb5556d2501da73d864cac945e8d9461\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/cb5556d2501da73d864cac945e8d9461\",\"name\":\"\u6e05, \u626c\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/32a4239de8ff29adace466261d309424a1e5fe9f7e3036bf89fe03f2e3dbe717?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/32a4239de8ff29adace466261d309424a1e5fe9f7e3036bf89fe03f2e3dbe717?s=96&d=mm&r=g\",\"caption\":\"\u6e05, \u626c\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/qingyang\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/","og_locale":"zh_CN","og_type":"article","og_description":"Kafka\u3068\u306f\uff1f Kafka \u5927\u91cf\u306e\u30e1\u30c3\u30bb\u30fc\u30b8\u51e6\u7406\u306b\u5229\u7528\u3059\u308b\u30e1\u30c3\u30bb\u30fc\u30b8\u30f3\u30b0\u30b7\u30b9\u30c6\u30e0\u3002 \u5206\u6563\u51e6\u7406\u306fZooKeep […]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2024-01-23T14:26:34+00:00","article_modified_time":"2024-04-29T00:52:19+00:00","author":"\u6e05, \u626c","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u6e05, \u626c","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"2 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/","name":"- Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2024-01-23T14:26:34+00:00","dateModified":"2024-04-29T00:52:19+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/cb5556d2501da73d864cac945e8d9461"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/"]}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/cb5556d2501da73d864cac945e8d9461","name":"\u6e05, \u626c","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/32a4239de8ff29adace466261d309424a1e5fe9f7e3036bf89fe03f2e3dbe717?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/32a4239de8ff29adace466261d309424a1e5fe9f7e3036bf89fe03f2e3dbe717?s=96&d=mm&r=g","caption":"\u6e05, \u626c"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/qingyang\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46661-2\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46661","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=46661"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46661\/revisions"}],"predecessor-version":[{"id":84270,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46661\/revisions\/84270"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=46661"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=46661"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=46661"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}